Aug 09 06:44:18 user nova-compute[72809]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 09 06:44:21 user nova-compute[72809]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72809) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 09 06:44:21 user nova-compute[72809]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72809) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 09 06:44:21 user nova-compute[72809]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72809) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 09 06:44:21 user nova-compute[72809]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 09 06:44:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:44:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.024s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:44:21 user nova-compute[72809]: INFO nova.virt.driver [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 09 06:44:21 user nova-compute[72809]: INFO nova.compute.provider_config [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] Acquiring lock "singleton_lock" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] Acquired lock "singleton_lock" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] Releasing lock "singleton_lock" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] Full set of CONF: {{(pid=72809) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ******************************************************************************** {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] Configuration options gathered from: {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ================================================================================ {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] allow_resize_to_same_host      = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] arq_binding_timeout            = 300 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] backdoor_port                  = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] backdoor_socket                = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] block_device_allocate_retries  = 300 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] block_device_allocate_retries_interval = 5 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cert                           = self.pem {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] compute_monitors               = [] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] config_dir                     = [] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] config_drive_format            = iso9660 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] config_source                  = [] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] console_host                   = user {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] control_exchange               = nova {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cpu_allocation_ratio           = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] daemon                         = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] debug                          = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] default_access_ip_network_name = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] default_availability_zone      = nova {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] default_ephemeral_format       = ext4 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] default_schedule_zone          = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] disk_allocation_ratio          = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] enable_new_services            = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] enabled_apis                   = ['osapi_compute'] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] enabled_ssl_apis               = [] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] flat_injected                  = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] force_config_drive             = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] force_raw_images               = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] graceful_shutdown_timeout      = 5 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] heal_instance_info_cache_interval = 60 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] host                           = user {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] instance_build_timeout         = 0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] instance_delete_interval       = 300 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] instance_name_template         = instance-%08x {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] instance_usage_audit           = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] instance_usage_audit_period    = month {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] internal_service_availability_zone = internal {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] key                            = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] live_migration_retry_count     = 30 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] log_config_append              = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] log_dir                        = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] log_file                       = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] log_options                    = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] log_rotate_interval            = 1 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] log_rotate_interval_type       = days {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] log_rotation_type              = none {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] long_rpc_timeout               = 1800 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] max_concurrent_builds          = 10 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] max_concurrent_live_migrations = 1 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] max_concurrent_snapshots       = 5 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] max_local_block_devices        = 3 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] max_logfile_count              = 30 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] max_logfile_size_mb            = 200 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] maximum_instance_delete_attempts = 5 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] metadata_listen                = 0.0.0.0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] metadata_listen_port           = 8775 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] metadata_workers               = 3 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] migrate_max_retries            = -1 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] mkisofs_cmd                    = genisoimage {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] my_ip                          = 10.0.0.210 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] network_allocate_retries       = 0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] osapi_compute_listen_port      = 8774 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] osapi_compute_unique_server_name_scope =  {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] osapi_compute_workers          = 3 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] password_length                = 12 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] periodic_enable                = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] periodic_fuzzy_delay           = 60 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] pointer_model                  = ps2mouse {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] preallocate_images             = none {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] publish_errors                 = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] pybasedir                      = /opt/stack/nova {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ram_allocation_ratio           = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] rate_limit_burst               = 0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] rate_limit_except_level        = CRITICAL {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] rate_limit_interval            = 0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] reboot_timeout                 = 0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] reclaim_instance_interval      = 0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] record                         = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] reimage_timeout_per_gb         = 60 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] report_interval                = 120 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] rescue_timeout                 = 0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] reserved_host_cpus             = 0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] reserved_host_disk_mb          = 0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] reserved_host_memory_mb        = 512 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] reserved_huge_pages            = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] resize_confirm_window          = 0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] resize_fs_using_block_device   = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] resume_guests_state_on_host_boot = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] rpc_response_timeout           = 60 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] run_external_periodic_tasks    = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] running_deleted_instance_action = reap {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] running_deleted_instance_poll_interval = 1800 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] running_deleted_instance_timeout = 0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] scheduler_instance_sync_interval = 120 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] service_down_time              = 720 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] servicegroup_driver            = db {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] shelved_offload_time           = 0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] shelved_poll_interval          = 3600 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] shutdown_timeout               = 0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] source_is_ipv6                 = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ssl_only                       = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] state_path                     = /opt/stack/data/nova {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] sync_power_state_interval      = 600 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] sync_power_state_pool_size     = 1000 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] syslog_log_facility            = LOG_USER {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] tempdir                        = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] timeout_nbd                    = 10 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] transport_url                  = **** {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] update_resources_interval      = 0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] use_cow_images                 = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] use_eventlog                   = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] use_journal                    = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] use_json                       = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] use_rootwrap_daemon            = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] use_stderr                     = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] use_syslog                     = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vcpu_pin_set                   = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vif_plugging_is_fatal          = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vif_plugging_timeout           = 0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] virt_mkfs                      = [] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] volume_usage_poll_interval     = 0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] watch_log_file                 = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] web                            = /usr/share/spice-html5 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_concurrency.disable_process_locking = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api.auth_strategy              = keystone {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api.compute_link_prefix        = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api.dhcp_domain                = novalocal {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api.enable_instance_password   = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api.glance_link_prefix         = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api.instance_list_per_project_cells = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api.list_records_by_skipping_down_cells = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api.local_metadata_per_cell    = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api.max_limit                  = 1000 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api.metadata_cache_expiration  = 15 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api.neutron_default_tenant_id  = default {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api.use_forwarded_for          = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api.use_neutron_default_nets   = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api.vendordata_dynamic_targets = [] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api.vendordata_jsonfile_path   = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cache.backend                  = dogpile.cache.memcached {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cache.backend_argument         = **** {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cache.config_prefix            = cache.oslo {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cache.dead_timeout             = 60.0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cache.debug_cache_backend      = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cache.enable_retry_client      = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cache.enable_socket_keepalive  = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cache.enabled                  = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cache.expiration_time          = 600 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cache.hashclient_retry_attempts = 2 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cache.memcache_dead_retry      = 300 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cache.memcache_password        =  {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cache.memcache_sasl_enabled    = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cache.memcache_username        =  {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cache.proxies                  = [] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cache.retry_attempts           = 2 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cache.retry_delay              = 0.0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cache.socket_keepalive_count   = 1 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cache.socket_keepalive_idle    = 1 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cache.socket_keepalive_interval = 1 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cache.tls_allowed_ciphers      = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cache.tls_cafile               = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cache.tls_certfile             = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cache.tls_enabled              = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cache.tls_keyfile              = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cinder.auth_section            = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cinder.auth_type               = password {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cinder.cafile                  = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cinder.certfile                = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cinder.collect_timing          = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cinder.cross_az_attach         = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cinder.debug                   = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cinder.endpoint_template       = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cinder.http_retries            = 3 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cinder.insecure                = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cinder.keyfile                 = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cinder.os_region_name          = RegionOne {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cinder.split_loggers           = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cinder.timeout                 = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] compute.cpu_dedicated_set      = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] compute.cpu_shared_set         = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] compute.image_type_exclude_list = [] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] compute.max_concurrent_disk_ops = 0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] compute.max_disk_devices_to_attach = -1 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] compute.resource_provider_association_refresh = 300 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] compute.shutdown_retry_interval = 10 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] conductor.workers              = 3 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] console.allowed_origins        = [] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] console.ssl_ciphers            = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] console.ssl_minimum_version    = default {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] consoleauth.token_ttl          = 600 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cyborg.cafile                  = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cyborg.certfile                = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cyborg.collect_timing          = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cyborg.connect_retries         = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cyborg.connect_retry_delay     = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cyborg.endpoint_override       = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cyborg.insecure                = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cyborg.keyfile                 = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cyborg.max_version             = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cyborg.min_version             = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cyborg.region_name             = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cyborg.service_name            = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cyborg.service_type            = accelerator {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cyborg.split_loggers           = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cyborg.status_code_retries     = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cyborg.status_code_retry_delay = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cyborg.timeout                 = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] cyborg.version                 = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] database.backend               = sqlalchemy {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] database.connection            = **** {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] database.connection_debug      = 0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] database.connection_parameters =  {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] database.connection_recycle_time = 3600 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] database.connection_trace      = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] database.db_inc_retry_interval = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] database.db_max_retries        = 20 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] database.db_max_retry_interval = 10 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] database.db_retry_interval     = 1 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] database.max_overflow          = 50 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] database.max_pool_size         = 5 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] database.max_retries           = 10 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] database.mysql_enable_ndb      = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] database.mysql_wsrep_sync_wait = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] database.pool_timeout          = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] database.retry_interval        = 10 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] database.slave_connection      = **** {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] database.sqlite_synchronous    = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api_database.backend           = sqlalchemy {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api_database.connection        = **** {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api_database.connection_debug  = 0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api_database.connection_parameters =  {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api_database.connection_recycle_time = 3600 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api_database.connection_trace  = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api_database.db_inc_retry_interval = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api_database.db_max_retries    = 20 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api_database.db_max_retry_interval = 10 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api_database.db_retry_interval = 1 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api_database.max_overflow      = 50 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api_database.max_pool_size     = 5 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api_database.max_retries       = 10 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api_database.mysql_enable_ndb  = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api_database.pool_timeout      = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api_database.retry_interval    = 10 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api_database.slave_connection  = **** {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] api_database.sqlite_synchronous = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] devices.enabled_mdev_types     = [] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ephemeral_storage_encryption.enabled = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] glance.api_servers             = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] glance.cafile                  = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] glance.certfile                = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] glance.collect_timing          = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] glance.connect_retries         = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] glance.connect_retry_delay     = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] glance.debug                   = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] glance.default_trusted_certificate_ids = [] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] glance.enable_certificate_validation = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] glance.enable_rbd_download     = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] glance.endpoint_override       = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] glance.insecure                = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] glance.keyfile                 = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] glance.max_version             = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] glance.min_version             = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] glance.num_retries             = 3 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] glance.rbd_ceph_conf           =  {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] glance.rbd_connect_timeout     = 5 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] glance.rbd_pool                =  {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] glance.rbd_user                =  {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] glance.region_name             = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] glance.service_name            = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] glance.service_type            = image {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] glance.split_loggers           = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] glance.status_code_retries     = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] glance.status_code_retry_delay = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] glance.timeout                 = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] glance.verify_glance_signatures = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] glance.version                 = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] guestfs.debug                  = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] hyperv.config_drive_cdrom      = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] hyperv.config_drive_inject_password = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] hyperv.enable_instance_metrics_collection = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] hyperv.enable_remotefx         = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] hyperv.instances_path_share    =  {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] hyperv.iscsi_initiator_list    = [] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] hyperv.limit_cpu_features      = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] hyperv.power_state_check_timeframe = 60 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] hyperv.use_multipath_io        = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] hyperv.volume_attach_retry_count = 10 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] hyperv.vswitch_name            = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] mks.enabled                    = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] image_cache.manager_interval   = 2400 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] image_cache.precache_concurrency = 1 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] image_cache.remove_unused_base_images = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] image_cache.subdirectory_name  = _base {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ironic.api_max_retries         = 60 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ironic.api_retry_interval      = 2 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ironic.auth_section            = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ironic.auth_type               = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ironic.cafile                  = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ironic.certfile                = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ironic.collect_timing          = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ironic.connect_retries         = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ironic.connect_retry_delay     = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ironic.endpoint_override       = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ironic.insecure                = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ironic.keyfile                 = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ironic.max_version             = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ironic.min_version             = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ironic.partition_key           = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ironic.peer_list               = [] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ironic.region_name             = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ironic.serial_console_state_timeout = 10 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ironic.service_name            = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ironic.service_type            = baremetal {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ironic.split_loggers           = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ironic.status_code_retries     = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ironic.status_code_retry_delay = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ironic.timeout                 = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ironic.version                 = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] key_manager.fixed_key          = **** {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] barbican.barbican_api_version  = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] barbican.barbican_endpoint     = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] barbican.barbican_endpoint_type = public {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] barbican.barbican_region_name  = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] barbican.cafile                = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] barbican.certfile              = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] barbican.collect_timing        = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] barbican.insecure              = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] barbican.keyfile               = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] barbican.number_of_retries     = 60 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] barbican.retry_delay           = 1 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] barbican.send_service_user_token = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] barbican.split_loggers         = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] barbican.timeout               = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] barbican.verify_ssl            = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] barbican.verify_ssl_path       = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] barbican_service_user.auth_section = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] barbican_service_user.auth_type = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] barbican_service_user.cafile   = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] barbican_service_user.certfile = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] barbican_service_user.collect_timing = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] barbican_service_user.insecure = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] barbican_service_user.keyfile  = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] barbican_service_user.split_loggers = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] barbican_service_user.timeout  = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vault.approle_role_id          = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vault.approle_secret_id        = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vault.cafile                   = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vault.certfile                 = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vault.collect_timing           = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vault.insecure                 = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vault.keyfile                  = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vault.kv_mountpoint            = secret {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vault.kv_version               = 2 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vault.namespace                = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vault.root_token_id            = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vault.split_loggers            = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vault.ssl_ca_crt_file          = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vault.timeout                  = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vault.use_ssl                  = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] keystone.cafile                = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] keystone.certfile              = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] keystone.collect_timing        = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] keystone.connect_retries       = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] keystone.connect_retry_delay   = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] keystone.endpoint_override     = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] keystone.insecure              = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] keystone.keyfile               = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] keystone.max_version           = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] keystone.min_version           = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] keystone.region_name           = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] keystone.service_name          = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] keystone.service_type          = identity {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] keystone.split_loggers         = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] keystone.status_code_retries   = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] keystone.status_code_retry_delay = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] keystone.timeout               = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] keystone.version               = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.connection_uri         =  {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.cpu_mode               = custom {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: WARNING oslo_config.cfg [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.cpu_power_governor_high = performance {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.cpu_power_governor_low = powersave {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.cpu_power_management   = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.device_detach_attempts = 8 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.device_detach_timeout  = 20 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.disk_cachemodes        = [] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.disk_prefix            = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.enabled_perf_events    = [] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.file_backed_memory     = 0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.gid_maps               = [] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.hw_disk_discard        = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.hw_machine_type        = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.images_rbd_glance_store_name =  {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.images_rbd_pool        = rbd {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.images_type            = default {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.images_volume_group    = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.inject_key             = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.inject_partition       = -2 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.inject_password        = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.iscsi_iface            = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.iser_use_multipath     = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.live_migration_bandwidth = 0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.live_migration_downtime = 500 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.live_migration_inbound_addr = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.live_migration_permit_post_copy = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.live_migration_scheme  = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.live_migration_timeout_action = abort {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.live_migration_tunnelled = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: WARNING oslo_config.cfg [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 09 06:44:22 user nova-compute[72809]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 09 06:44:22 user nova-compute[72809]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 09 06:44:22 user nova-compute[72809]: and ``live_migration_inbound_addr`` respectively.
Aug 09 06:44:22 user nova-compute[72809]: ).  Its value may be silently ignored in the future.
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.live_migration_with_native_tls = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.max_queues             = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.nfs_mount_options      = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.num_memory_encrypted_guests = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.num_pcie_ports         = 0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.pmem_namespaces        = [] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.quobyte_client_cfg     = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.rbd_secret_uuid        = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.rbd_user               = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.remote_filesystem_transport = ssh {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.rescue_image_id        = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.rescue_kernel_id       = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.rescue_ramdisk_id      = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.rx_queue_size          = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.smbfs_mount_options    =  {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.snapshot_compression   = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.snapshot_image_format  = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.sparse_logical_volumes = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.swtpm_enabled          = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.swtpm_group            = tss {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.swtpm_user             = tss {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.sysinfo_serial         = unique {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.tb_cache_size          = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.tx_queue_size          = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.uid_maps               = [] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.use_virtio_for_bridges = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.virt_type              = kvm {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.volume_clear           = zero {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.volume_clear_size      = 0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.volume_use_multipath   = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.vzstorage_cache_path   = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.vzstorage_mount_user   = stack {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] neutron.auth_section           = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] neutron.auth_type              = password {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] neutron.cafile                 = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] neutron.certfile               = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] neutron.collect_timing         = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] neutron.connect_retries        = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] neutron.connect_retry_delay    = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] neutron.default_floating_pool  = public {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] neutron.endpoint_override      = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] neutron.extension_sync_interval = 600 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] neutron.http_retries           = 3 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] neutron.insecure               = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] neutron.keyfile                = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] neutron.max_version            = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] neutron.min_version            = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] neutron.ovs_bridge             = br-int {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] neutron.physnets               = [] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] neutron.region_name            = RegionOne {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] neutron.service_metadata_proxy = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] neutron.service_name           = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] neutron.service_type           = network {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] neutron.split_loggers          = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] neutron.status_code_retries    = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] neutron.status_code_retry_delay = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] neutron.timeout                = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] neutron.version                = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] notifications.bdms_in_notifications = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] notifications.default_level    = INFO {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] notifications.notification_format = unversioned {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] notifications.notify_on_state_change = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] pci.alias                      = [] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] pci.device_spec                = [] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] pci.report_in_placement        = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.auth_section         = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.auth_type            = password {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.cafile               = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.certfile             = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.collect_timing       = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.connect_retries      = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.connect_retry_delay  = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.default_domain_id    = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.default_domain_name  = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.domain_id            = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.domain_name          = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.endpoint_override    = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.insecure             = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.keyfile              = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.max_version          = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.min_version          = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.password             = **** {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.project_domain_id    = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.project_domain_name  = Default {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.project_id           = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.project_name         = service {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.region_name          = RegionOne {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.service_name         = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.service_type         = placement {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.split_loggers        = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.status_code_retries  = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.status_code_retry_delay = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.system_scope         = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.timeout              = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.trust_id             = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.user_domain_id       = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.user_domain_name     = Default {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.user_id              = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.username             = placement {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] placement.version              = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] quota.cores                    = 20 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] quota.count_usage_from_placement = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] quota.injected_file_content_bytes = 10240 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] quota.injected_file_path_length = 255 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] quota.injected_files           = 5 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] quota.instances                = 10 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] quota.key_pairs                = 100 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] quota.metadata_items           = 128 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] quota.ram                      = 51200 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] quota.recheck_quota            = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] quota.server_group_members     = 10 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] quota.server_groups            = 10 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] rdp.enabled                    = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] scheduler.image_metadata_prefilter = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] scheduler.max_attempts         = 3 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] scheduler.max_placement_results = 1000 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] scheduler.query_placement_for_availability_zone = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] scheduler.query_placement_for_image_type_support = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] scheduler.workers              = 3 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] filter_scheduler.host_subset_size = 1 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] filter_scheduler.isolated_hosts = [] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] filter_scheduler.isolated_images = [] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] filter_scheduler.pci_in_placement = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] filter_scheduler.track_instance_changes = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] metrics.required               = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] metrics.weight_multiplier      = 1.0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] metrics.weight_setting         = [] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] serial_console.enabled         = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] serial_console.port_range      = 10000:20000 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] serial_console.serialproxy_port = 6083 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] service_user.auth_section      = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] service_user.auth_type         = password {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] service_user.cafile            = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] service_user.certfile          = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] service_user.collect_timing    = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] service_user.insecure          = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] service_user.keyfile           = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] service_user.send_service_user_token = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] service_user.split_loggers     = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] service_user.timeout           = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] spice.agent_enabled            = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] spice.enabled                  = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] spice.html5proxy_port          = 6082 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] spice.image_compression        = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] spice.jpeg_compression         = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] spice.playback_compression     = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] spice.server_listen            = 127.0.0.1 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] spice.streaming_mode           = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] spice.zlib_compression         = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] upgrade_levels.baseapi         = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] upgrade_levels.cert            = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] upgrade_levels.compute         = auto {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] upgrade_levels.conductor       = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] upgrade_levels.scheduler       = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vendordata_dynamic_auth.auth_section = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vendordata_dynamic_auth.auth_type = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vendordata_dynamic_auth.cafile = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vendordata_dynamic_auth.certfile = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vendordata_dynamic_auth.insecure = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vendordata_dynamic_auth.keyfile = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vendordata_dynamic_auth.timeout = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vmware.api_retry_count         = 10 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vmware.ca_file                 = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vmware.cache_prefix            = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vmware.cluster_name            = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vmware.connection_pool_size    = 10 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vmware.console_delay_seconds   = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vmware.datastore_regex         = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vmware.host_ip                 = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vmware.host_password           = **** {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vmware.host_port               = 443 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vmware.host_username           = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vmware.insecure                = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vmware.integration_bridge      = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vmware.maximum_objects         = 100 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vmware.pbm_default_policy      = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vmware.pbm_enabled             = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vmware.pbm_wsdl_location       = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vmware.serial_port_proxy_uri   = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vmware.serial_port_service_uri = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vmware.task_poll_interval      = 0.5 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vmware.use_linked_clone        = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vmware.vnc_keymap              = en-us {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vmware.vnc_port                = 5900 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vmware.vnc_port_total          = 10000 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vnc.auth_schemes               = ['none'] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vnc.enabled                    = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vnc.novncproxy_port            = 6080 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vnc.server_listen              = 0.0.0.0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vnc.vencrypt_ca_certs          = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vnc.vencrypt_client_cert       = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vnc.vencrypt_client_key        = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] workarounds.disable_rootwrap   = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] workarounds.enable_numa_live_migration = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] workarounds.libvirt_disable_apic = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] wsgi.client_socket_timeout     = 900 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] wsgi.default_pool_size         = 1000 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] wsgi.keep_alive                = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] wsgi.max_header_line           = 16384 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] wsgi.ssl_ca_file               = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] wsgi.ssl_cert_file             = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] wsgi.ssl_key_file              = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] wsgi.tcp_keepidle              = 600 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] zvm.ca_file                    = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] zvm.cloud_connector_url        = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] zvm.reachable_timeout          = 300 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_policy.enforce_new_defaults = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_policy.enforce_scope      = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_policy.policy_default_rule = default {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] profiler.connection_string     = messaging:// {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] profiler.enabled               = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] profiler.es_doc_type           = notification {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] profiler.es_scroll_size        = 10000 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] profiler.es_scroll_time        = 2m {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] profiler.filter_error_trace    = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] profiler.hmac_keys             = **** {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] profiler.sentinel_service_name = mymaster {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] profiler.socket_timeout        = 0.1 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] profiler.trace_requests        = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] profiler.trace_sqlalchemy      = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] profiler_jaeger.process_tags   = {} {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] profiler_jaeger.service_name_prefix = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] profiler_otlp.service_name_prefix = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] remote_debug.host              = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] remote_debug.port              = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_notifications.retry = -1 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_limit.auth_section        = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_limit.auth_type           = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_limit.cafile              = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_limit.certfile            = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_limit.collect_timing      = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_limit.connect_retries     = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_limit.connect_retry_delay = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_limit.endpoint_id         = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_limit.endpoint_override   = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_limit.insecure            = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_limit.keyfile             = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_limit.max_version         = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_limit.min_version         = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_limit.region_name         = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_limit.service_name        = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_limit.service_type        = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_limit.split_loggers       = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_limit.status_code_retries = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_limit.status_code_retry_delay = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_limit.timeout             = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_limit.valid_interfaces    = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_limit.version             = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_reports.file_event_handler = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] oslo_reports.log_dir           = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vif_plug_ovs_privileged.group  = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] vif_plug_ovs_privileged.user   = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] os_vif_linux_bridge.flat_interface = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] os_vif_ovs.isolate_vif         = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] os_vif_ovs.per_port_bridge     = False {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] os_brick.lock_path             = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] privsep_osbrick.capabilities   = [21] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] privsep_osbrick.group          = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] privsep_osbrick.helper_command = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] privsep_osbrick.user           = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] nova_sys_admin.group           = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] nova_sys_admin.helper_command  = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] nova_sys_admin.user            = None {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG oslo_service.service [None req-0789e863-5180-42ab-8a3a-f72a75bd8949 None None] ******************************************************************************** {{(pid=72809) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Aug 09 06:44:22 user nova-compute[72809]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 09 06:44:22 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Starting native event thread {{(pid=72809) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Starting green dispatch thread {{(pid=72809) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Starting connection event dispatch thread {{(pid=72809) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Connecting to libvirt: qemu:///system {{(pid=72809) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fc1681f8b20> {{(pid=72809) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 09 06:44:22 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fc1681f8b20> {{(pid=72809) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 09 06:44:22 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Connection event '1' reason 'None'
Aug 09 06:44:22 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 09 06:44:22 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.mount [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Initialising _HostMountState generation 0 {{(pid=72809) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 09 06:44:29 user nova-compute[72809]: INFO nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Libvirt host capabilities <capabilities>
Aug 09 06:44:29 user nova-compute[72809]:   <host>
Aug 09 06:44:29 user nova-compute[72809]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 09 06:44:29 user nova-compute[72809]:     <cpu>
Aug 09 06:44:29 user nova-compute[72809]:       <arch>x86_64</arch>
Aug 09 06:44:29 user nova-compute[72809]:       <model>IvyBridge-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <vendor>Intel</vendor>
Aug 09 06:44:29 user nova-compute[72809]:       <microcode version='1070'/>
Aug 09 06:44:29 user nova-compute[72809]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 09 06:44:29 user nova-compute[72809]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature name='ss'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature name='vmx'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature name='pcid'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature name='osxsave'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature name='hypervisor'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature name='arat'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature name='tsc_adjust'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature name='md-clear'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature name='stibp'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature name='arch-capabilities'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature name='ssbd'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature name='invtsc'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature name='rsba'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature name='skip-l1dfl-vmentry'/>
Aug 09 06:44:29 user nova-compute[72809]:       <pages unit='KiB' size='4'/>
Aug 09 06:44:29 user nova-compute[72809]:       <pages unit='KiB' size='2048'/>
Aug 09 06:44:29 user nova-compute[72809]:     </cpu>
Aug 09 06:44:29 user nova-compute[72809]:     <power_management>
Aug 09 06:44:29 user nova-compute[72809]:       <suspend_mem/>
Aug 09 06:44:29 user nova-compute[72809]:       <suspend_disk/>
Aug 09 06:44:29 user nova-compute[72809]:       <suspend_hybrid/>
Aug 09 06:44:29 user nova-compute[72809]:     </power_management>
Aug 09 06:44:29 user nova-compute[72809]:     <iommu support='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     <migration_features>
Aug 09 06:44:29 user nova-compute[72809]:       <live/>
Aug 09 06:44:29 user nova-compute[72809]:       <uri_transports>
Aug 09 06:44:29 user nova-compute[72809]:         <uri_transport>tcp</uri_transport>
Aug 09 06:44:29 user nova-compute[72809]:         <uri_transport>rdma</uri_transport>
Aug 09 06:44:29 user nova-compute[72809]:       </uri_transports>
Aug 09 06:44:29 user nova-compute[72809]:     </migration_features>
Aug 09 06:44:29 user nova-compute[72809]:     <topology>
Aug 09 06:44:29 user nova-compute[72809]:       <cells num='2'>
Aug 09 06:44:29 user nova-compute[72809]:         <cell id='0'>
Aug 09 06:44:29 user nova-compute[72809]:           <memory unit='KiB'>8140616</memory>
Aug 09 06:44:29 user nova-compute[72809]:           <pages unit='KiB' size='4'>2035154</pages>
Aug 09 06:44:29 user nova-compute[72809]:           <pages unit='KiB' size='2048'>0</pages>
Aug 09 06:44:29 user nova-compute[72809]:           <distances>
Aug 09 06:44:29 user nova-compute[72809]:             <sibling id='0' value='10'/>
Aug 09 06:44:29 user nova-compute[72809]:             <sibling id='1' value='20'/>
Aug 09 06:44:29 user nova-compute[72809]:           </distances>
Aug 09 06:44:29 user nova-compute[72809]:           <cpus num='6'>
Aug 09 06:44:29 user nova-compute[72809]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 09 06:44:29 user nova-compute[72809]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 09 06:44:29 user nova-compute[72809]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 09 06:44:29 user nova-compute[72809]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 09 06:44:29 user nova-compute[72809]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 09 06:44:29 user nova-compute[72809]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 09 06:44:29 user nova-compute[72809]:           </cpus>
Aug 09 06:44:29 user nova-compute[72809]:         </cell>
Aug 09 06:44:29 user nova-compute[72809]:         <cell id='1'>
Aug 09 06:44:29 user nova-compute[72809]:           <memory unit='KiB'>8255100</memory>
Aug 09 06:44:29 user nova-compute[72809]:           <pages unit='KiB' size='4'>2063775</pages>
Aug 09 06:44:29 user nova-compute[72809]:           <pages unit='KiB' size='2048'>0</pages>
Aug 09 06:44:29 user nova-compute[72809]:           <distances>
Aug 09 06:44:29 user nova-compute[72809]:             <sibling id='0' value='20'/>
Aug 09 06:44:29 user nova-compute[72809]:             <sibling id='1' value='10'/>
Aug 09 06:44:29 user nova-compute[72809]:           </distances>
Aug 09 06:44:29 user nova-compute[72809]:           <cpus num='6'>
Aug 09 06:44:29 user nova-compute[72809]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 09 06:44:29 user nova-compute[72809]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 09 06:44:29 user nova-compute[72809]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 09 06:44:29 user nova-compute[72809]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 09 06:44:29 user nova-compute[72809]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 09 06:44:29 user nova-compute[72809]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 09 06:44:29 user nova-compute[72809]:           </cpus>
Aug 09 06:44:29 user nova-compute[72809]:         </cell>
Aug 09 06:44:29 user nova-compute[72809]:       </cells>
Aug 09 06:44:29 user nova-compute[72809]:     </topology>
Aug 09 06:44:29 user nova-compute[72809]:     <cache>
Aug 09 06:44:29 user nova-compute[72809]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 09 06:44:29 user nova-compute[72809]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 09 06:44:29 user nova-compute[72809]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 09 06:44:29 user nova-compute[72809]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 09 06:44:29 user nova-compute[72809]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 09 06:44:29 user nova-compute[72809]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 09 06:44:29 user nova-compute[72809]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 09 06:44:29 user nova-compute[72809]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 09 06:44:29 user nova-compute[72809]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 09 06:44:29 user nova-compute[72809]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 09 06:44:29 user nova-compute[72809]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 09 06:44:29 user nova-compute[72809]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 09 06:44:29 user nova-compute[72809]:     </cache>
Aug 09 06:44:29 user nova-compute[72809]:     <secmodel>
Aug 09 06:44:29 user nova-compute[72809]:       <model>apparmor</model>
Aug 09 06:44:29 user nova-compute[72809]:       <doi>0</doi>
Aug 09 06:44:29 user nova-compute[72809]:     </secmodel>
Aug 09 06:44:29 user nova-compute[72809]:     <secmodel>
Aug 09 06:44:29 user nova-compute[72809]:       <model>dac</model>
Aug 09 06:44:29 user nova-compute[72809]:       <doi>0</doi>
Aug 09 06:44:29 user nova-compute[72809]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 09 06:44:29 user nova-compute[72809]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 09 06:44:29 user nova-compute[72809]:     </secmodel>
Aug 09 06:44:29 user nova-compute[72809]:   </host>
Aug 09 06:44:29 user nova-compute[72809]:   <guest>
Aug 09 06:44:29 user nova-compute[72809]:     <os_type>hvm</os_type>
Aug 09 06:44:29 user nova-compute[72809]:     <arch name='alpha'>
Aug 09 06:44:29 user nova-compute[72809]:       <wordsize>64</wordsize>
Aug 09 06:44:29 user nova-compute[72809]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>clipper</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <domain type='qemu'/>
Aug 09 06:44:29 user nova-compute[72809]:     </arch>
Aug 09 06:44:29 user nova-compute[72809]:     <features>
Aug 09 06:44:29 user nova-compute[72809]:       <cpuselection/>
Aug 09 06:44:29 user nova-compute[72809]:       <deviceboot/>
Aug 09 06:44:29 user nova-compute[72809]:       <disksnapshot default='on' toggle='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     </features>
Aug 09 06:44:29 user nova-compute[72809]:   </guest>
Aug 09 06:44:29 user nova-compute[72809]:   <guest>
Aug 09 06:44:29 user nova-compute[72809]:     <os_type>hvm</os_type>
Aug 09 06:44:29 user nova-compute[72809]:     <arch name='armv6l'>
Aug 09 06:44:29 user nova-compute[72809]:       <wordsize>32</wordsize>
Aug 09 06:44:29 user nova-compute[72809]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>integratorcp</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>borzoi</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>spitz</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>nuri</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>musca-b1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>versatileab</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>kzm</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>musca-a</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>smdkc210</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>sx1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>z2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>tosa</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>sabrelite</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>realview-eb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>n810</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>n800</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>versatilepb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>terrier</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>mainstone</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>midway</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>musicpal</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>microbit</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>cubieboard</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>verdex</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>netduino2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>raspi2b</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>cheetah</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>highbank</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>akita</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>connex</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>collie</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>raspi0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <domain type='qemu'/>
Aug 09 06:44:29 user nova-compute[72809]:     </arch>
Aug 09 06:44:29 user nova-compute[72809]:     <features>
Aug 09 06:44:29 user nova-compute[72809]:       <cpuselection/>
Aug 09 06:44:29 user nova-compute[72809]:       <deviceboot/>
Aug 09 06:44:29 user nova-compute[72809]:       <disksnapshot default='on' toggle='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     </features>
Aug 09 06:44:29 user nova-compute[72809]:   </guest>
Aug 09 06:44:29 user nova-compute[72809]:   <guest>
Aug 09 06:44:29 user nova-compute[72809]:     <os_type>hvm</os_type>
Aug 09 06:44:29 user nova-compute[72809]:     <arch name='armv7l'>
Aug 09 06:44:29 user nova-compute[72809]:       <wordsize>32</wordsize>
Aug 09 06:44:29 user nova-compute[72809]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>integratorcp</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>borzoi</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>spitz</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>nuri</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>musca-b1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>versatileab</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>kzm</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>musca-a</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>smdkc210</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>sx1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>z2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>tosa</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>sabrelite</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>realview-eb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>n810</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>n800</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>versatilepb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>terrier</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>mainstone</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>midway</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>musicpal</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>microbit</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>cubieboard</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>verdex</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>netduino2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>raspi2b</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>cheetah</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>highbank</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>akita</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>connex</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>collie</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>raspi0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <domain type='qemu'/>
Aug 09 06:44:29 user nova-compute[72809]:     </arch>
Aug 09 06:44:29 user nova-compute[72809]:     <features>
Aug 09 06:44:29 user nova-compute[72809]:       <cpuselection/>
Aug 09 06:44:29 user nova-compute[72809]:       <deviceboot/>
Aug 09 06:44:29 user nova-compute[72809]:       <disksnapshot default='on' toggle='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     </features>
Aug 09 06:44:29 user nova-compute[72809]:   </guest>
Aug 09 06:44:29 user nova-compute[72809]:   <guest>
Aug 09 06:44:29 user nova-compute[72809]:     <os_type>hvm</os_type>
Aug 09 06:44:29 user nova-compute[72809]:     <arch name='aarch64'>
Aug 09 06:44:29 user nova-compute[72809]:       <wordsize>64</wordsize>
Aug 09 06:44:29 user nova-compute[72809]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>integratorcp</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>borzoi</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>spitz</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>nuri</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>musca-b1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>versatileab</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>kzm</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>musca-a</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>smdkc210</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>sx1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>z2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>tosa</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>sabrelite</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>realview-eb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>n810</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>n800</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>versatilepb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>terrier</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>mainstone</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>midway</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>musicpal</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>microbit</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>cubieboard</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>verdex</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>netduino2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>raspi3b</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>raspi2b</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>cheetah</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>highbank</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>akita</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>connex</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>collie</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>raspi0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <domain type='qemu'/>
Aug 09 06:44:29 user nova-compute[72809]:     </arch>
Aug 09 06:44:29 user nova-compute[72809]:     <features>
Aug 09 06:44:29 user nova-compute[72809]:       <acpi default='on' toggle='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:       <cpuselection/>
Aug 09 06:44:29 user nova-compute[72809]:       <deviceboot/>
Aug 09 06:44:29 user nova-compute[72809]:       <disksnapshot default='on' toggle='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     </features>
Aug 09 06:44:29 user nova-compute[72809]:   </guest>
Aug 09 06:44:29 user nova-compute[72809]:   <guest>
Aug 09 06:44:29 user nova-compute[72809]:     <os_type>hvm</os_type>
Aug 09 06:44:29 user nova-compute[72809]:     <arch name='cris'>
Aug 09 06:44:29 user nova-compute[72809]:       <wordsize>32</wordsize>
Aug 09 06:44:29 user nova-compute[72809]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <domain type='qemu'/>
Aug 09 06:44:29 user nova-compute[72809]:     </arch>
Aug 09 06:44:29 user nova-compute[72809]:     <features>
Aug 09 06:44:29 user nova-compute[72809]:       <cpuselection/>
Aug 09 06:44:29 user nova-compute[72809]:       <deviceboot/>
Aug 09 06:44:29 user nova-compute[72809]:       <disksnapshot default='on' toggle='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     </features>
Aug 09 06:44:29 user nova-compute[72809]:   </guest>
Aug 09 06:44:29 user nova-compute[72809]:   <guest>
Aug 09 06:44:29 user nova-compute[72809]:     <os_type>hvm</os_type>
Aug 09 06:44:29 user nova-compute[72809]:     <arch name='i686'>
Aug 09 06:44:29 user nova-compute[72809]:       <wordsize>32</wordsize>
Aug 09 06:44:29 user nova-compute[72809]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>x-remote</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>isapc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>microvm</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <domain type='qemu'/>
Aug 09 06:44:29 user nova-compute[72809]:       <domain type='kvm'/>
Aug 09 06:44:29 user nova-compute[72809]:     </arch>
Aug 09 06:44:29 user nova-compute[72809]:     <features>
Aug 09 06:44:29 user nova-compute[72809]:       <pae/>
Aug 09 06:44:29 user nova-compute[72809]:       <nonpae/>
Aug 09 06:44:29 user nova-compute[72809]:       <acpi default='on' toggle='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:       <apic default='on' toggle='no'/>
Aug 09 06:44:29 user nova-compute[72809]:       <cpuselection/>
Aug 09 06:44:29 user nova-compute[72809]:       <deviceboot/>
Aug 09 06:44:29 user nova-compute[72809]:       <disksnapshot default='on' toggle='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     </features>
Aug 09 06:44:29 user nova-compute[72809]:   </guest>
Aug 09 06:44:29 user nova-compute[72809]:   <guest>
Aug 09 06:44:29 user nova-compute[72809]:     <os_type>hvm</os_type>
Aug 09 06:44:29 user nova-compute[72809]:     <arch name='m68k'>
Aug 09 06:44:29 user nova-compute[72809]:       <wordsize>32</wordsize>
Aug 09 06:44:29 user nova-compute[72809]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>an5206</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>q800</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>next-cube</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <domain type='qemu'/>
Aug 09 06:44:29 user nova-compute[72809]:     </arch>
Aug 09 06:44:29 user nova-compute[72809]:     <features>
Aug 09 06:44:29 user nova-compute[72809]:       <cpuselection/>
Aug 09 06:44:29 user nova-compute[72809]:       <deviceboot/>
Aug 09 06:44:29 user nova-compute[72809]:       <disksnapshot default='on' toggle='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     </features>
Aug 09 06:44:29 user nova-compute[72809]:   </guest>
Aug 09 06:44:29 user nova-compute[72809]:   <guest>
Aug 09 06:44:29 user nova-compute[72809]:     <os_type>hvm</os_type>
Aug 09 06:44:29 user nova-compute[72809]:     <arch name='microblaze'>
Aug 09 06:44:29 user nova-compute[72809]:       <wordsize>32</wordsize>
Aug 09 06:44:29 user nova-compute[72809]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <domain type='qemu'/>
Aug 09 06:44:29 user nova-compute[72809]:     </arch>
Aug 09 06:44:29 user nova-compute[72809]:     <features>
Aug 09 06:44:29 user nova-compute[72809]:       <cpuselection/>
Aug 09 06:44:29 user nova-compute[72809]:       <deviceboot/>
Aug 09 06:44:29 user nova-compute[72809]:       <disksnapshot default='on' toggle='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     </features>
Aug 09 06:44:29 user nova-compute[72809]:   </guest>
Aug 09 06:44:29 user nova-compute[72809]:   <guest>
Aug 09 06:44:29 user nova-compute[72809]:     <os_type>hvm</os_type>
Aug 09 06:44:29 user nova-compute[72809]:     <arch name='microblazeel'>
Aug 09 06:44:29 user nova-compute[72809]:       <wordsize>32</wordsize>
Aug 09 06:44:29 user nova-compute[72809]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <domain type='qemu'/>
Aug 09 06:44:29 user nova-compute[72809]:     </arch>
Aug 09 06:44:29 user nova-compute[72809]:     <features>
Aug 09 06:44:29 user nova-compute[72809]:       <cpuselection/>
Aug 09 06:44:29 user nova-compute[72809]:       <deviceboot/>
Aug 09 06:44:29 user nova-compute[72809]:       <disksnapshot default='on' toggle='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     </features>
Aug 09 06:44:29 user nova-compute[72809]:   </guest>
Aug 09 06:44:29 user nova-compute[72809]:   <guest>
Aug 09 06:44:29 user nova-compute[72809]:     <os_type>hvm</os_type>
Aug 09 06:44:29 user nova-compute[72809]:     <arch name='mips'>
Aug 09 06:44:29 user nova-compute[72809]:       <wordsize>32</wordsize>
Aug 09 06:44:29 user nova-compute[72809]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='16'>malta</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <domain type='qemu'/>
Aug 09 06:44:29 user nova-compute[72809]:     </arch>
Aug 09 06:44:29 user nova-compute[72809]:     <features>
Aug 09 06:44:29 user nova-compute[72809]:       <cpuselection/>
Aug 09 06:44:29 user nova-compute[72809]:       <deviceboot/>
Aug 09 06:44:29 user nova-compute[72809]:       <disksnapshot default='on' toggle='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     </features>
Aug 09 06:44:29 user nova-compute[72809]:   </guest>
Aug 09 06:44:29 user nova-compute[72809]:   <guest>
Aug 09 06:44:29 user nova-compute[72809]:     <os_type>hvm</os_type>
Aug 09 06:44:29 user nova-compute[72809]:     <arch name='mipsel'>
Aug 09 06:44:29 user nova-compute[72809]:       <wordsize>32</wordsize>
Aug 09 06:44:29 user nova-compute[72809]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='16'>malta</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <domain type='qemu'/>
Aug 09 06:44:29 user nova-compute[72809]:     </arch>
Aug 09 06:44:29 user nova-compute[72809]:     <features>
Aug 09 06:44:29 user nova-compute[72809]:       <cpuselection/>
Aug 09 06:44:29 user nova-compute[72809]:       <deviceboot/>
Aug 09 06:44:29 user nova-compute[72809]:       <disksnapshot default='on' toggle='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     </features>
Aug 09 06:44:29 user nova-compute[72809]:   </guest>
Aug 09 06:44:29 user nova-compute[72809]:   <guest>
Aug 09 06:44:29 user nova-compute[72809]:     <os_type>hvm</os_type>
Aug 09 06:44:29 user nova-compute[72809]:     <arch name='mips64'>
Aug 09 06:44:29 user nova-compute[72809]:       <wordsize>64</wordsize>
Aug 09 06:44:29 user nova-compute[72809]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='16'>malta</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>pica61</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>magnum</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <domain type='qemu'/>
Aug 09 06:44:29 user nova-compute[72809]:     </arch>
Aug 09 06:44:29 user nova-compute[72809]:     <features>
Aug 09 06:44:29 user nova-compute[72809]:       <cpuselection/>
Aug 09 06:44:29 user nova-compute[72809]:       <deviceboot/>
Aug 09 06:44:29 user nova-compute[72809]:       <disksnapshot default='on' toggle='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     </features>
Aug 09 06:44:29 user nova-compute[72809]:   </guest>
Aug 09 06:44:29 user nova-compute[72809]:   <guest>
Aug 09 06:44:29 user nova-compute[72809]:     <os_type>hvm</os_type>
Aug 09 06:44:29 user nova-compute[72809]:     <arch name='mips64el'>
Aug 09 06:44:29 user nova-compute[72809]:       <wordsize>64</wordsize>
Aug 09 06:44:29 user nova-compute[72809]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='16'>malta</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>pica61</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>magnum</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='16'>boston</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <domain type='qemu'/>
Aug 09 06:44:29 user nova-compute[72809]:     </arch>
Aug 09 06:44:29 user nova-compute[72809]:     <features>
Aug 09 06:44:29 user nova-compute[72809]:       <cpuselection/>
Aug 09 06:44:29 user nova-compute[72809]:       <deviceboot/>
Aug 09 06:44:29 user nova-compute[72809]:       <disksnapshot default='on' toggle='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     </features>
Aug 09 06:44:29 user nova-compute[72809]:   </guest>
Aug 09 06:44:29 user nova-compute[72809]:   <guest>
Aug 09 06:44:29 user nova-compute[72809]:     <os_type>hvm</os_type>
Aug 09 06:44:29 user nova-compute[72809]:     <arch name='ppc'>
Aug 09 06:44:29 user nova-compute[72809]:       <wordsize>32</wordsize>
Aug 09 06:44:29 user nova-compute[72809]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>g3beige</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>mac99</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='32'>ppce500</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>pegasos2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>sam460ex</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>bamboo</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>40p</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>ref405ep</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>taihu</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <domain type='qemu'/>
Aug 09 06:44:29 user nova-compute[72809]:     </arch>
Aug 09 06:44:29 user nova-compute[72809]:     <features>
Aug 09 06:44:29 user nova-compute[72809]:       <cpuselection/>
Aug 09 06:44:29 user nova-compute[72809]:       <deviceboot/>
Aug 09 06:44:29 user nova-compute[72809]:       <disksnapshot default='on' toggle='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     </features>
Aug 09 06:44:29 user nova-compute[72809]:   </guest>
Aug 09 06:44:29 user nova-compute[72809]:   <guest>
Aug 09 06:44:29 user nova-compute[72809]:     <os_type>hvm</os_type>
Aug 09 06:44:29 user nova-compute[72809]:     <arch name='ppc64'>
Aug 09 06:44:29 user nova-compute[72809]:       <wordsize>64</wordsize>
Aug 09 06:44:29 user nova-compute[72809]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2048'>powernv9</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>taihu</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2048'>powernv10</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='32'>ppce500</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>40p</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>pegasos2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>bamboo</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>g3beige</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>mac99</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>sam460ex</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>ref405ep</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2048'>powernv8</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <domain type='qemu'/>
Aug 09 06:44:29 user nova-compute[72809]:     </arch>
Aug 09 06:44:29 user nova-compute[72809]:     <features>
Aug 09 06:44:29 user nova-compute[72809]:       <cpuselection/>
Aug 09 06:44:29 user nova-compute[72809]:       <deviceboot/>
Aug 09 06:44:29 user nova-compute[72809]:       <disksnapshot default='on' toggle='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     </features>
Aug 09 06:44:29 user nova-compute[72809]:   </guest>
Aug 09 06:44:29 user nova-compute[72809]:   <guest>
Aug 09 06:44:29 user nova-compute[72809]:     <os_type>hvm</os_type>
Aug 09 06:44:29 user nova-compute[72809]:     <arch name='ppc64le'>
Aug 09 06:44:29 user nova-compute[72809]:       <wordsize>64</wordsize>
Aug 09 06:44:29 user nova-compute[72809]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2048'>powernv9</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>taihu</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2048'>powernv10</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='32'>ppce500</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>40p</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>pegasos2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>bamboo</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>g3beige</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>mac99</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>sam460ex</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>ref405ep</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2048'>powernv8</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <domain type='qemu'/>
Aug 09 06:44:29 user nova-compute[72809]:     </arch>
Aug 09 06:44:29 user nova-compute[72809]:     <features>
Aug 09 06:44:29 user nova-compute[72809]:       <cpuselection/>
Aug 09 06:44:29 user nova-compute[72809]:       <deviceboot/>
Aug 09 06:44:29 user nova-compute[72809]:       <disksnapshot default='on' toggle='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     </features>
Aug 09 06:44:29 user nova-compute[72809]:   </guest>
Aug 09 06:44:29 user nova-compute[72809]:   <guest>
Aug 09 06:44:29 user nova-compute[72809]:     <os_type>hvm</os_type>
Aug 09 06:44:29 user nova-compute[72809]:     <arch name='riscv32'>
Aug 09 06:44:29 user nova-compute[72809]:       <wordsize>32</wordsize>
Aug 09 06:44:29 user nova-compute[72809]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='8'>spike</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>opentitan</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='5'>sifive_u</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>sifive_e</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='8'>virt</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <domain type='qemu'/>
Aug 09 06:44:29 user nova-compute[72809]:     </arch>
Aug 09 06:44:29 user nova-compute[72809]:     <features>
Aug 09 06:44:29 user nova-compute[72809]:       <cpuselection/>
Aug 09 06:44:29 user nova-compute[72809]:       <deviceboot/>
Aug 09 06:44:29 user nova-compute[72809]:       <disksnapshot default='on' toggle='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     </features>
Aug 09 06:44:29 user nova-compute[72809]:   </guest>
Aug 09 06:44:29 user nova-compute[72809]:   <guest>
Aug 09 06:44:29 user nova-compute[72809]:     <os_type>hvm</os_type>
Aug 09 06:44:29 user nova-compute[72809]:     <arch name='riscv64'>
Aug 09 06:44:29 user nova-compute[72809]:       <wordsize>64</wordsize>
Aug 09 06:44:29 user nova-compute[72809]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='8'>spike</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='5'>sifive_u</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>shakti_c</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>sifive_e</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='8'>virt</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <domain type='qemu'/>
Aug 09 06:44:29 user nova-compute[72809]:     </arch>
Aug 09 06:44:29 user nova-compute[72809]:     <features>
Aug 09 06:44:29 user nova-compute[72809]:       <cpuselection/>
Aug 09 06:44:29 user nova-compute[72809]:       <deviceboot/>
Aug 09 06:44:29 user nova-compute[72809]:       <disksnapshot default='on' toggle='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     </features>
Aug 09 06:44:29 user nova-compute[72809]:   </guest>
Aug 09 06:44:29 user nova-compute[72809]:   <guest>
Aug 09 06:44:29 user nova-compute[72809]:     <os_type>hvm</os_type>
Aug 09 06:44:29 user nova-compute[72809]:     <arch name='s390x'>
Aug 09 06:44:29 user nova-compute[72809]:       <wordsize>64</wordsize>
Aug 09 06:44:29 user nova-compute[72809]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <domain type='qemu'/>
Aug 09 06:44:29 user nova-compute[72809]:     </arch>
Aug 09 06:44:29 user nova-compute[72809]:     <features>
Aug 09 06:44:29 user nova-compute[72809]:       <cpuselection/>
Aug 09 06:44:29 user nova-compute[72809]:       <deviceboot/>
Aug 09 06:44:29 user nova-compute[72809]:       <disksnapshot default='on' toggle='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     </features>
Aug 09 06:44:29 user nova-compute[72809]:   </guest>
Aug 09 06:44:29 user nova-compute[72809]:   <guest>
Aug 09 06:44:29 user nova-compute[72809]:     <os_type>hvm</os_type>
Aug 09 06:44:29 user nova-compute[72809]:     <arch name='sh4'>
Aug 09 06:44:29 user nova-compute[72809]:       <wordsize>32</wordsize>
Aug 09 06:44:29 user nova-compute[72809]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>shix</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>r2d</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <domain type='qemu'/>
Aug 09 06:44:29 user nova-compute[72809]:     </arch>
Aug 09 06:44:29 user nova-compute[72809]:     <features>
Aug 09 06:44:29 user nova-compute[72809]:       <cpuselection/>
Aug 09 06:44:29 user nova-compute[72809]:       <deviceboot/>
Aug 09 06:44:29 user nova-compute[72809]:       <disksnapshot default='on' toggle='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     </features>
Aug 09 06:44:29 user nova-compute[72809]:   </guest>
Aug 09 06:44:29 user nova-compute[72809]:   <guest>
Aug 09 06:44:29 user nova-compute[72809]:     <os_type>hvm</os_type>
Aug 09 06:44:29 user nova-compute[72809]:     <arch name='sh4eb'>
Aug 09 06:44:29 user nova-compute[72809]:       <wordsize>64</wordsize>
Aug 09 06:44:29 user nova-compute[72809]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>shix</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>r2d</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <domain type='qemu'/>
Aug 09 06:44:29 user nova-compute[72809]:     </arch>
Aug 09 06:44:29 user nova-compute[72809]:     <features>
Aug 09 06:44:29 user nova-compute[72809]:       <cpuselection/>
Aug 09 06:44:29 user nova-compute[72809]:       <deviceboot/>
Aug 09 06:44:29 user nova-compute[72809]:       <disksnapshot default='on' toggle='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     </features>
Aug 09 06:44:29 user nova-compute[72809]:   </guest>
Aug 09 06:44:29 user nova-compute[72809]:   <guest>
Aug 09 06:44:29 user nova-compute[72809]:     <os_type>hvm</os_type>
Aug 09 06:44:29 user nova-compute[72809]:     <arch name='sparc'>
Aug 09 06:44:29 user nova-compute[72809]:       <wordsize>32</wordsize>
Aug 09 06:44:29 user nova-compute[72809]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>SS-5</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>SS-20</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>LX</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>SS-4</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>SS-10</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>Voyager</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <domain type='qemu'/>
Aug 09 06:44:29 user nova-compute[72809]:     </arch>
Aug 09 06:44:29 user nova-compute[72809]:     <features>
Aug 09 06:44:29 user nova-compute[72809]:       <cpuselection/>
Aug 09 06:44:29 user nova-compute[72809]:       <deviceboot/>
Aug 09 06:44:29 user nova-compute[72809]:       <disksnapshot default='on' toggle='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     </features>
Aug 09 06:44:29 user nova-compute[72809]:   </guest>
Aug 09 06:44:29 user nova-compute[72809]:   <guest>
Aug 09 06:44:29 user nova-compute[72809]:     <os_type>hvm</os_type>
Aug 09 06:44:29 user nova-compute[72809]:     <arch name='sparc64'>
Aug 09 06:44:29 user nova-compute[72809]:       <wordsize>64</wordsize>
Aug 09 06:44:29 user nova-compute[72809]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>sun4u</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>niagara</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>sun4v</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <domain type='qemu'/>
Aug 09 06:44:29 user nova-compute[72809]:     </arch>
Aug 09 06:44:29 user nova-compute[72809]:     <features>
Aug 09 06:44:29 user nova-compute[72809]:       <cpuselection/>
Aug 09 06:44:29 user nova-compute[72809]:       <deviceboot/>
Aug 09 06:44:29 user nova-compute[72809]:       <disksnapshot default='on' toggle='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     </features>
Aug 09 06:44:29 user nova-compute[72809]:   </guest>
Aug 09 06:44:29 user nova-compute[72809]:   <guest>
Aug 09 06:44:29 user nova-compute[72809]:     <os_type>hvm</os_type>
Aug 09 06:44:29 user nova-compute[72809]:     <arch name='x86_64'>
Aug 09 06:44:29 user nova-compute[72809]:       <wordsize>64</wordsize>
Aug 09 06:44:29 user nova-compute[72809]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>x-remote</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='1'>isapc</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>microvm</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <domain type='qemu'/>
Aug 09 06:44:29 user nova-compute[72809]:       <domain type='kvm'/>
Aug 09 06:44:29 user nova-compute[72809]:     </arch>
Aug 09 06:44:29 user nova-compute[72809]:     <features>
Aug 09 06:44:29 user nova-compute[72809]:       <acpi default='on' toggle='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:       <apic default='on' toggle='no'/>
Aug 09 06:44:29 user nova-compute[72809]:       <cpuselection/>
Aug 09 06:44:29 user nova-compute[72809]:       <deviceboot/>
Aug 09 06:44:29 user nova-compute[72809]:       <disksnapshot default='on' toggle='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     </features>
Aug 09 06:44:29 user nova-compute[72809]:   </guest>
Aug 09 06:44:29 user nova-compute[72809]:   <guest>
Aug 09 06:44:29 user nova-compute[72809]:     <os_type>hvm</os_type>
Aug 09 06:44:29 user nova-compute[72809]:     <arch name='xtensa'>
Aug 09 06:44:29 user nova-compute[72809]:       <wordsize>32</wordsize>
Aug 09 06:44:29 user nova-compute[72809]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>sim</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='32'>kc705</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='32'>ml605</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='32'>virt</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='32'>lx200</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='32'>lx60</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <domain type='qemu'/>
Aug 09 06:44:29 user nova-compute[72809]:     </arch>
Aug 09 06:44:29 user nova-compute[72809]:     <features>
Aug 09 06:44:29 user nova-compute[72809]:       <cpuselection/>
Aug 09 06:44:29 user nova-compute[72809]:       <deviceboot/>
Aug 09 06:44:29 user nova-compute[72809]:       <disksnapshot default='on' toggle='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     </features>
Aug 09 06:44:29 user nova-compute[72809]:   </guest>
Aug 09 06:44:29 user nova-compute[72809]:   <guest>
Aug 09 06:44:29 user nova-compute[72809]:     <os_type>hvm</os_type>
Aug 09 06:44:29 user nova-compute[72809]:     <arch name='xtensaeb'>
Aug 09 06:44:29 user nova-compute[72809]:       <wordsize>32</wordsize>
Aug 09 06:44:29 user nova-compute[72809]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='4'>sim</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='32'>kc705</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='32'>ml605</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='32'>virt</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='32'>lx200</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='32'>lx60</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 09 06:44:29 user nova-compute[72809]:       <domain type='qemu'/>
Aug 09 06:44:29 user nova-compute[72809]:     </arch>
Aug 09 06:44:29 user nova-compute[72809]:     <features>
Aug 09 06:44:29 user nova-compute[72809]:       <cpuselection/>
Aug 09 06:44:29 user nova-compute[72809]:       <deviceboot/>
Aug 09 06:44:29 user nova-compute[72809]:       <disksnapshot default='on' toggle='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     </features>
Aug 09 06:44:29 user nova-compute[72809]:   </guest>
Aug 09 06:44:29 user nova-compute[72809]: </capabilities>
Aug 09 06:44:29 user nova-compute[72809]: 
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72809) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72809) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72809) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72809) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72809) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72809) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72809) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72809) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72809) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72809) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72809) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'q35', 'pc', 'ubuntu-q35'} {{(pid=72809) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 09 06:44:29 user nova-compute[72809]: <domainCapabilities>
Aug 09 06:44:29 user nova-compute[72809]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 06:44:29 user nova-compute[72809]:   <domain>kvm</domain>
Aug 09 06:44:29 user nova-compute[72809]:   <machine>pc-i440fx-jammy</machine>
Aug 09 06:44:29 user nova-compute[72809]:   <arch>i686</arch>
Aug 09 06:44:29 user nova-compute[72809]:   <vcpu max='255'/>
Aug 09 06:44:29 user nova-compute[72809]:   <iothreads supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:   <os supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:     <enum name='firmware'/>
Aug 09 06:44:29 user nova-compute[72809]:     <loader supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='type'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>rom</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>pflash</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='readonly'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>yes</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>no</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='secure'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>no</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </loader>
Aug 09 06:44:29 user nova-compute[72809]:   </os>
Aug 09 06:44:29 user nova-compute[72809]:   <cpu>
Aug 09 06:44:29 user nova-compute[72809]:     <mode name='host-passthrough' supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='hostPassthroughMigratable'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>off</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </mode>
Aug 09 06:44:29 user nova-compute[72809]:     <mode name='maximum' supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='maximumMigratable'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>on</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>off</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </mode>
Aug 09 06:44:29 user nova-compute[72809]:     <mode name='host-model' supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <vendor>Intel</vendor>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='ss'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='vmx'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='pcid'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='hypervisor'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='arat'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='umip'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='md-clear'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='stibp'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='ssbd'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='ibpb'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='ibrs'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='amd-stibp'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='disable' name='erms'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='disable' name='lm'/>
Aug 09 06:44:29 user nova-compute[72809]:     </mode>
Aug 09 06:44:29 user nova-compute[72809]:     <mode name='custom' supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>qemu64</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>qemu32</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>phenom</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>pentium3</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>pentium2</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>pentium</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>n270</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>kvm64</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>kvm32</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>coreduo</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>core2duo</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>athlon</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Westmere</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Snowridge</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Server</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Client</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>SandyBridge</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Penryn</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G5</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G4</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G3</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G2</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G1</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Nehalem</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>IvyBridge</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Icelake-Server</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Haswell</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>EPYC-Rome</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>EPYC-Milan</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>EPYC</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Dhyana</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Cooperlake</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Conroe</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Broadwell</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>486</model>
Aug 09 06:44:29 user nova-compute[72809]:     </mode>
Aug 09 06:44:29 user nova-compute[72809]:   </cpu>
Aug 09 06:44:29 user nova-compute[72809]:   <memoryBacking supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:     <enum name='sourceType'>
Aug 09 06:44:29 user nova-compute[72809]:       <value>file</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>anonymous</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>memfd</value>
Aug 09 06:44:29 user nova-compute[72809]:     </enum>
Aug 09 06:44:29 user nova-compute[72809]:   </memoryBacking>
Aug 09 06:44:29 user nova-compute[72809]:   <devices>
Aug 09 06:44:29 user nova-compute[72809]:     <disk supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='diskDevice'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>disk</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>cdrom</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>floppy</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>lun</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='bus'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>ide</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>fdc</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>scsi</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>usb</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>sata</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='model'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio-transitional</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio-non-transitional</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </disk>
Aug 09 06:44:29 user nova-compute[72809]:     <graphics supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='type'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>sdl</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>vnc</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>spice</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>egl-headless</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </graphics>
Aug 09 06:44:29 user nova-compute[72809]:     <video supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='modelType'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>vga</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>cirrus</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>vmvga</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>qxl</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>none</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>bochs</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>ramfb</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </video>
Aug 09 06:44:29 user nova-compute[72809]:     <hostdev supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='mode'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>subsystem</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='startupPolicy'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>default</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>mandatory</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>requisite</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>optional</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='subsysType'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>usb</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>pci</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>scsi</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='capsType'/>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='pciBackend'/>
Aug 09 06:44:29 user nova-compute[72809]:     </hostdev>
Aug 09 06:44:29 user nova-compute[72809]:     <rng supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='model'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio-transitional</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio-non-transitional</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='backendModel'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>random</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>egd</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>builtin</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </rng>
Aug 09 06:44:29 user nova-compute[72809]:     <filesystem supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='driverType'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>path</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>handle</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtiofs</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </filesystem>
Aug 09 06:44:29 user nova-compute[72809]:     <tpm supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='model'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>tpm-tis</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>tpm-crb</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='backendModel'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>passthrough</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>emulator</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </tpm>
Aug 09 06:44:29 user nova-compute[72809]:   </devices>
Aug 09 06:44:29 user nova-compute[72809]:   <features>
Aug 09 06:44:29 user nova-compute[72809]:     <gic supported='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     <vmcoreinfo supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:     <genid supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:     <backingStoreInput supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:     <backup supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:     <sev supported='no'/>
Aug 09 06:44:29 user nova-compute[72809]:   </features>
Aug 09 06:44:29 user nova-compute[72809]: </domainCapabilities>
Aug 09 06:44:29 user nova-compute[72809]:  {{(pid=72809) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 09 06:44:29 user nova-compute[72809]: <domainCapabilities>
Aug 09 06:44:29 user nova-compute[72809]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 06:44:29 user nova-compute[72809]:   <domain>kvm</domain>
Aug 09 06:44:29 user nova-compute[72809]:   <machine>pc-q35-6.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:   <arch>i686</arch>
Aug 09 06:44:29 user nova-compute[72809]:   <vcpu max='288'/>
Aug 09 06:44:29 user nova-compute[72809]:   <iothreads supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:   <os supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:     <enum name='firmware'/>
Aug 09 06:44:29 user nova-compute[72809]:     <loader supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='type'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>rom</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>pflash</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='readonly'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>yes</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>no</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='secure'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>no</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </loader>
Aug 09 06:44:29 user nova-compute[72809]:   </os>
Aug 09 06:44:29 user nova-compute[72809]:   <cpu>
Aug 09 06:44:29 user nova-compute[72809]:     <mode name='host-passthrough' supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='hostPassthroughMigratable'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>off</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </mode>
Aug 09 06:44:29 user nova-compute[72809]:     <mode name='maximum' supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='maximumMigratable'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>on</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>off</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </mode>
Aug 09 06:44:29 user nova-compute[72809]:     <mode name='host-model' supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <vendor>Intel</vendor>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='ss'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='vmx'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='pcid'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='hypervisor'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='arat'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='umip'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='md-clear'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='stibp'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='ssbd'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='ibpb'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='ibrs'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='amd-stibp'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='disable' name='erms'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='disable' name='lm'/>
Aug 09 06:44:29 user nova-compute[72809]:     </mode>
Aug 09 06:44:29 user nova-compute[72809]:     <mode name='custom' supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>qemu64</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>qemu32</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>phenom</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>pentium3</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>pentium2</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>pentium</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>n270</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>kvm64</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>kvm32</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>coreduo</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>core2duo</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>athlon</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Westmere</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Snowridge</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Server</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Client</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>SandyBridge</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Penryn</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G5</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G4</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G3</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G2</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G1</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Nehalem</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>IvyBridge</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Icelake-Server</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Haswell</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>EPYC-Rome</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>EPYC-Milan</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>EPYC</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Dhyana</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Cooperlake</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Conroe</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Broadwell</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>486</model>
Aug 09 06:44:29 user nova-compute[72809]:     </mode>
Aug 09 06:44:29 user nova-compute[72809]:   </cpu>
Aug 09 06:44:29 user nova-compute[72809]:   <memoryBacking supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:     <enum name='sourceType'>
Aug 09 06:44:29 user nova-compute[72809]:       <value>file</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>anonymous</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>memfd</value>
Aug 09 06:44:29 user nova-compute[72809]:     </enum>
Aug 09 06:44:29 user nova-compute[72809]:   </memoryBacking>
Aug 09 06:44:29 user nova-compute[72809]:   <devices>
Aug 09 06:44:29 user nova-compute[72809]:     <disk supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='diskDevice'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>disk</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>cdrom</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>floppy</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>lun</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='bus'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>fdc</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>scsi</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>usb</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>sata</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='model'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio-transitional</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio-non-transitional</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </disk>
Aug 09 06:44:29 user nova-compute[72809]:     <graphics supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='type'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>sdl</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>vnc</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>spice</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>egl-headless</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </graphics>
Aug 09 06:44:29 user nova-compute[72809]:     <video supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='modelType'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>vga</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>cirrus</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>vmvga</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>qxl</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>none</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>bochs</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>ramfb</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </video>
Aug 09 06:44:29 user nova-compute[72809]:     <hostdev supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='mode'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>subsystem</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='startupPolicy'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>default</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>mandatory</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>requisite</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>optional</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='subsysType'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>usb</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>pci</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>scsi</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='capsType'/>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='pciBackend'/>
Aug 09 06:44:29 user nova-compute[72809]:     </hostdev>
Aug 09 06:44:29 user nova-compute[72809]:     <rng supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='model'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio-transitional</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio-non-transitional</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='backendModel'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>random</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>egd</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>builtin</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </rng>
Aug 09 06:44:29 user nova-compute[72809]:     <filesystem supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='driverType'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>path</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>handle</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtiofs</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </filesystem>
Aug 09 06:44:29 user nova-compute[72809]:     <tpm supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='model'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>tpm-tis</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>tpm-crb</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='backendModel'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>passthrough</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>emulator</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </tpm>
Aug 09 06:44:29 user nova-compute[72809]:   </devices>
Aug 09 06:44:29 user nova-compute[72809]:   <features>
Aug 09 06:44:29 user nova-compute[72809]:     <gic supported='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     <vmcoreinfo supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:     <genid supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:     <backingStoreInput supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:     <backup supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:     <sev supported='no'/>
Aug 09 06:44:29 user nova-compute[72809]:   </features>
Aug 09 06:44:29 user nova-compute[72809]: </domainCapabilities>
Aug 09 06:44:29 user nova-compute[72809]:  {{(pid=72809) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 09 06:44:29 user nova-compute[72809]: <domainCapabilities>
Aug 09 06:44:29 user nova-compute[72809]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 06:44:29 user nova-compute[72809]:   <domain>kvm</domain>
Aug 09 06:44:29 user nova-compute[72809]:   <machine>pc-i440fx-6.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:   <arch>i686</arch>
Aug 09 06:44:29 user nova-compute[72809]:   <vcpu max='255'/>
Aug 09 06:44:29 user nova-compute[72809]:   <iothreads supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:   <os supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:     <enum name='firmware'/>
Aug 09 06:44:29 user nova-compute[72809]:     <loader supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='type'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>rom</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>pflash</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='readonly'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>yes</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>no</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='secure'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>no</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </loader>
Aug 09 06:44:29 user nova-compute[72809]:   </os>
Aug 09 06:44:29 user nova-compute[72809]:   <cpu>
Aug 09 06:44:29 user nova-compute[72809]:     <mode name='host-passthrough' supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='hostPassthroughMigratable'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>off</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </mode>
Aug 09 06:44:29 user nova-compute[72809]:     <mode name='maximum' supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='maximumMigratable'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>on</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>off</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </mode>
Aug 09 06:44:29 user nova-compute[72809]:     <mode name='host-model' supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <vendor>Intel</vendor>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='ss'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='vmx'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='pcid'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='hypervisor'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='arat'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='umip'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='md-clear'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='stibp'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='ssbd'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='ibpb'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='ibrs'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='amd-stibp'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='disable' name='erms'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='disable' name='lm'/>
Aug 09 06:44:29 user nova-compute[72809]:     </mode>
Aug 09 06:44:29 user nova-compute[72809]:     <mode name='custom' supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>qemu64</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>qemu32</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>phenom</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>pentium3</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>pentium2</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>pentium</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>n270</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>kvm64</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>kvm32</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>coreduo</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>core2duo</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>athlon</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Westmere</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Snowridge</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Server</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Client</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>SandyBridge</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Penryn</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G5</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G4</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G3</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G2</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G1</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Nehalem</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>IvyBridge</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Icelake-Server</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Haswell</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>EPYC-Rome</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>EPYC-Milan</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>EPYC</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Dhyana</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Cooperlake</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Conroe</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Broadwell</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>486</model>
Aug 09 06:44:29 user nova-compute[72809]:     </mode>
Aug 09 06:44:29 user nova-compute[72809]:   </cpu>
Aug 09 06:44:29 user nova-compute[72809]:   <memoryBacking supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:     <enum name='sourceType'>
Aug 09 06:44:29 user nova-compute[72809]:       <value>file</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>anonymous</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>memfd</value>
Aug 09 06:44:29 user nova-compute[72809]:     </enum>
Aug 09 06:44:29 user nova-compute[72809]:   </memoryBacking>
Aug 09 06:44:29 user nova-compute[72809]:   <devices>
Aug 09 06:44:29 user nova-compute[72809]:     <disk supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='diskDevice'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>disk</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>cdrom</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>floppy</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>lun</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='bus'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>ide</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>fdc</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>scsi</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>usb</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>sata</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='model'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio-transitional</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio-non-transitional</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </disk>
Aug 09 06:44:29 user nova-compute[72809]:     <graphics supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='type'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>sdl</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>vnc</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>spice</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>egl-headless</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </graphics>
Aug 09 06:44:29 user nova-compute[72809]:     <video supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='modelType'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>vga</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>cirrus</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>vmvga</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>qxl</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>none</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>bochs</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>ramfb</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </video>
Aug 09 06:44:29 user nova-compute[72809]:     <hostdev supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='mode'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>subsystem</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='startupPolicy'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>default</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>mandatory</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>requisite</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>optional</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='subsysType'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>usb</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>pci</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>scsi</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='capsType'/>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='pciBackend'/>
Aug 09 06:44:29 user nova-compute[72809]:     </hostdev>
Aug 09 06:44:29 user nova-compute[72809]:     <rng supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='model'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio-transitional</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio-non-transitional</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='backendModel'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>random</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>egd</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>builtin</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </rng>
Aug 09 06:44:29 user nova-compute[72809]:     <filesystem supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='driverType'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>path</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>handle</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtiofs</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </filesystem>
Aug 09 06:44:29 user nova-compute[72809]:     <tpm supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='model'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>tpm-tis</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>tpm-crb</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='backendModel'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>passthrough</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>emulator</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </tpm>
Aug 09 06:44:29 user nova-compute[72809]:   </devices>
Aug 09 06:44:29 user nova-compute[72809]:   <features>
Aug 09 06:44:29 user nova-compute[72809]:     <gic supported='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     <vmcoreinfo supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:     <genid supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:     <backingStoreInput supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:     <backup supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:     <sev supported='no'/>
Aug 09 06:44:29 user nova-compute[72809]:   </features>
Aug 09 06:44:29 user nova-compute[72809]: </domainCapabilities>
Aug 09 06:44:29 user nova-compute[72809]:  {{(pid=72809) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 09 06:44:29 user nova-compute[72809]: <domainCapabilities>
Aug 09 06:44:29 user nova-compute[72809]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 06:44:29 user nova-compute[72809]:   <domain>kvm</domain>
Aug 09 06:44:29 user nova-compute[72809]:   <machine>pc-q35-jammy</machine>
Aug 09 06:44:29 user nova-compute[72809]:   <arch>i686</arch>
Aug 09 06:44:29 user nova-compute[72809]:   <vcpu max='288'/>
Aug 09 06:44:29 user nova-compute[72809]:   <iothreads supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:   <os supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:     <enum name='firmware'/>
Aug 09 06:44:29 user nova-compute[72809]:     <loader supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='type'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>rom</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>pflash</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='readonly'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>yes</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>no</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='secure'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>no</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </loader>
Aug 09 06:44:29 user nova-compute[72809]:   </os>
Aug 09 06:44:29 user nova-compute[72809]:   <cpu>
Aug 09 06:44:29 user nova-compute[72809]:     <mode name='host-passthrough' supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='hostPassthroughMigratable'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>off</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </mode>
Aug 09 06:44:29 user nova-compute[72809]:     <mode name='maximum' supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='maximumMigratable'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>on</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>off</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </mode>
Aug 09 06:44:29 user nova-compute[72809]:     <mode name='host-model' supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <vendor>Intel</vendor>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='ss'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='vmx'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='pcid'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='hypervisor'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='arat'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='umip'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='md-clear'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='stibp'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='ssbd'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='ibpb'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='ibrs'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='amd-stibp'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='disable' name='erms'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='disable' name='lm'/>
Aug 09 06:44:29 user nova-compute[72809]:     </mode>
Aug 09 06:44:29 user nova-compute[72809]:     <mode name='custom' supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>qemu64</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>qemu32</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>phenom</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>pentium3</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>pentium2</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>pentium</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>n270</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>kvm64</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>kvm32</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>coreduo</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>core2duo</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>athlon</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Westmere</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Snowridge</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Server</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Client</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>SandyBridge</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Penryn</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G5</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G4</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G3</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G2</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G1</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Nehalem</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>IvyBridge</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Icelake-Server</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Haswell</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>EPYC-Rome</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>EPYC-Milan</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>EPYC</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Dhyana</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Cooperlake</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Conroe</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Broadwell</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>486</model>
Aug 09 06:44:29 user nova-compute[72809]:     </mode>
Aug 09 06:44:29 user nova-compute[72809]:   </cpu>
Aug 09 06:44:29 user nova-compute[72809]:   <memoryBacking supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:     <enum name='sourceType'>
Aug 09 06:44:29 user nova-compute[72809]:       <value>file</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>anonymous</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>memfd</value>
Aug 09 06:44:29 user nova-compute[72809]:     </enum>
Aug 09 06:44:29 user nova-compute[72809]:   </memoryBacking>
Aug 09 06:44:29 user nova-compute[72809]:   <devices>
Aug 09 06:44:29 user nova-compute[72809]:     <disk supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='diskDevice'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>disk</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>cdrom</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>floppy</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>lun</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='bus'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>fdc</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>scsi</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>usb</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>sata</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='model'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio-transitional</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio-non-transitional</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </disk>
Aug 09 06:44:29 user nova-compute[72809]:     <graphics supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='type'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>sdl</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>vnc</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>spice</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>egl-headless</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </graphics>
Aug 09 06:44:29 user nova-compute[72809]:     <video supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='modelType'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>vga</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>cirrus</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>vmvga</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>qxl</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>none</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>bochs</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>ramfb</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </video>
Aug 09 06:44:29 user nova-compute[72809]:     <hostdev supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='mode'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>subsystem</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='startupPolicy'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>default</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>mandatory</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>requisite</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>optional</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='subsysType'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>usb</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>pci</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>scsi</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='capsType'/>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='pciBackend'/>
Aug 09 06:44:29 user nova-compute[72809]:     </hostdev>
Aug 09 06:44:29 user nova-compute[72809]:     <rng supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='model'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio-transitional</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio-non-transitional</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='backendModel'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>random</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>egd</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>builtin</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </rng>
Aug 09 06:44:29 user nova-compute[72809]:     <filesystem supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='driverType'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>path</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>handle</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtiofs</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </filesystem>
Aug 09 06:44:29 user nova-compute[72809]:     <tpm supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='model'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>tpm-tis</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>tpm-crb</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='backendModel'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>passthrough</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>emulator</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </tpm>
Aug 09 06:44:29 user nova-compute[72809]:   </devices>
Aug 09 06:44:29 user nova-compute[72809]:   <features>
Aug 09 06:44:29 user nova-compute[72809]:     <gic supported='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     <vmcoreinfo supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:     <genid supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:     <backingStoreInput supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:     <backup supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:     <sev supported='no'/>
Aug 09 06:44:29 user nova-compute[72809]:   </features>
Aug 09 06:44:29 user nova-compute[72809]: </domainCapabilities>
Aug 09 06:44:29 user nova-compute[72809]:  {{(pid=72809) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72809) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72809) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72809) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72809) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72809) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72809) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72809) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72809) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72809) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72809) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72809) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72809) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72809) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72809) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72809) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72809) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72809) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=72809) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72809) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72809) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72809) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=72809) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72809) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72809) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72809) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72809) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72809) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72809) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72809) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72809) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72809) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72809) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72809) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72809) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72809) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72809) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72809) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72809) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'q35', 'pc', 'ubuntu-q35'} {{(pid=72809) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 09 06:44:29 user nova-compute[72809]: <domainCapabilities>
Aug 09 06:44:29 user nova-compute[72809]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 06:44:29 user nova-compute[72809]:   <domain>kvm</domain>
Aug 09 06:44:29 user nova-compute[72809]:   <machine>pc-i440fx-jammy</machine>
Aug 09 06:44:29 user nova-compute[72809]:   <arch>x86_64</arch>
Aug 09 06:44:29 user nova-compute[72809]:   <vcpu max='255'/>
Aug 09 06:44:29 user nova-compute[72809]:   <iothreads supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:   <os supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:     <enum name='firmware'>
Aug 09 06:44:29 user nova-compute[72809]:       <value>efi</value>
Aug 09 06:44:29 user nova-compute[72809]:     </enum>
Aug 09 06:44:29 user nova-compute[72809]:     <loader supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='type'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>rom</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>pflash</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='readonly'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>yes</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>no</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='secure'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>no</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </loader>
Aug 09 06:44:29 user nova-compute[72809]:   </os>
Aug 09 06:44:29 user nova-compute[72809]:   <cpu>
Aug 09 06:44:29 user nova-compute[72809]:     <mode name='host-passthrough' supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='hostPassthroughMigratable'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>on</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>off</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </mode>
Aug 09 06:44:29 user nova-compute[72809]:     <mode name='maximum' supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='maximumMigratable'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>on</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>off</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </mode>
Aug 09 06:44:29 user nova-compute[72809]:     <mode name='host-model' supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <vendor>Intel</vendor>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='ss'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='vmx'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='pcid'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='hypervisor'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='arat'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='umip'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='md-clear'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='stibp'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='ssbd'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='invtsc'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='ibpb'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='ibrs'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='amd-stibp'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='rsba'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='disable' name='erms'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 06:44:29 user nova-compute[72809]:     </mode>
Aug 09 06:44:29 user nova-compute[72809]:     <mode name='custom' supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>qemu64</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>qemu32</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>phenom</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>pentium3</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>pentium2</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>pentium</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>n270</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>kvm64</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>kvm32</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>coreduo</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>core2duo</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>athlon</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>Westmere</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Snowridge</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Server</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Client</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>SandyBridge</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>Penryn</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G5</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G4</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G3</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G2</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>Opteron_G1</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>Nehalem</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>IvyBridge</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Icelake-Server</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Haswell</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>EPYC-Rome</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>EPYC-Milan</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>EPYC</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Dhyana</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Cooperlake</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>Conroe</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Broadwell</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>486</model>
Aug 09 06:44:29 user nova-compute[72809]:     </mode>
Aug 09 06:44:29 user nova-compute[72809]:   </cpu>
Aug 09 06:44:29 user nova-compute[72809]:   <memoryBacking supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:     <enum name='sourceType'>
Aug 09 06:44:29 user nova-compute[72809]:       <value>file</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>anonymous</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>memfd</value>
Aug 09 06:44:29 user nova-compute[72809]:     </enum>
Aug 09 06:44:29 user nova-compute[72809]:   </memoryBacking>
Aug 09 06:44:29 user nova-compute[72809]:   <devices>
Aug 09 06:44:29 user nova-compute[72809]:     <disk supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='diskDevice'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>disk</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>cdrom</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>floppy</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>lun</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='bus'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>ide</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>fdc</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>scsi</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>usb</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>sata</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='model'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio-transitional</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio-non-transitional</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </disk>
Aug 09 06:44:29 user nova-compute[72809]:     <graphics supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='type'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>sdl</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>vnc</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>spice</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>egl-headless</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </graphics>
Aug 09 06:44:29 user nova-compute[72809]:     <video supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='modelType'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>vga</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>cirrus</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>vmvga</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>qxl</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>none</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>bochs</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>ramfb</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </video>
Aug 09 06:44:29 user nova-compute[72809]:     <hostdev supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='mode'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>subsystem</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='startupPolicy'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>default</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>mandatory</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>requisite</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>optional</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='subsysType'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>usb</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>pci</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>scsi</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='capsType'/>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='pciBackend'/>
Aug 09 06:44:29 user nova-compute[72809]:     </hostdev>
Aug 09 06:44:29 user nova-compute[72809]:     <rng supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='model'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio-transitional</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio-non-transitional</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='backendModel'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>random</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>egd</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>builtin</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </rng>
Aug 09 06:44:29 user nova-compute[72809]:     <filesystem supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='driverType'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>path</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>handle</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtiofs</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </filesystem>
Aug 09 06:44:29 user nova-compute[72809]:     <tpm supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='model'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>tpm-tis</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>tpm-crb</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='backendModel'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>passthrough</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>emulator</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </tpm>
Aug 09 06:44:29 user nova-compute[72809]:   </devices>
Aug 09 06:44:29 user nova-compute[72809]:   <features>
Aug 09 06:44:29 user nova-compute[72809]:     <gic supported='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     <vmcoreinfo supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:     <genid supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:     <backingStoreInput supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:     <backup supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:     <sev supported='no'/>
Aug 09 06:44:29 user nova-compute[72809]:   </features>
Aug 09 06:44:29 user nova-compute[72809]: </domainCapabilities>
Aug 09 06:44:29 user nova-compute[72809]:  {{(pid=72809) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 09 06:44:29 user nova-compute[72809]: <domainCapabilities>
Aug 09 06:44:29 user nova-compute[72809]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 06:44:29 user nova-compute[72809]:   <domain>kvm</domain>
Aug 09 06:44:29 user nova-compute[72809]:   <machine>pc-q35-6.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:   <arch>x86_64</arch>
Aug 09 06:44:29 user nova-compute[72809]:   <vcpu max='288'/>
Aug 09 06:44:29 user nova-compute[72809]:   <iothreads supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:   <os supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:     <enum name='firmware'>
Aug 09 06:44:29 user nova-compute[72809]:       <value>efi</value>
Aug 09 06:44:29 user nova-compute[72809]:     </enum>
Aug 09 06:44:29 user nova-compute[72809]:     <loader supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='type'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>rom</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>pflash</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='readonly'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>yes</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>no</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='secure'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>yes</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>no</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </loader>
Aug 09 06:44:29 user nova-compute[72809]:   </os>
Aug 09 06:44:29 user nova-compute[72809]:   <cpu>
Aug 09 06:44:29 user nova-compute[72809]:     <mode name='host-passthrough' supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='hostPassthroughMigratable'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>on</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>off</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </mode>
Aug 09 06:44:29 user nova-compute[72809]:     <mode name='maximum' supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='maximumMigratable'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>on</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>off</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </mode>
Aug 09 06:44:29 user nova-compute[72809]:     <mode name='host-model' supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <vendor>Intel</vendor>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='ss'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='vmx'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='pcid'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='hypervisor'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='arat'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='umip'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='md-clear'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='stibp'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='ssbd'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='invtsc'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='ibpb'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='ibrs'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='amd-stibp'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='rsba'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='disable' name='erms'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 06:44:29 user nova-compute[72809]:     </mode>
Aug 09 06:44:29 user nova-compute[72809]:     <mode name='custom' supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>qemu64</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>qemu32</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>phenom</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>pentium3</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>pentium2</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>pentium</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>n270</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>kvm64</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>kvm32</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>coreduo</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>core2duo</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>athlon</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>Westmere</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Snowridge</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Server</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Client</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>SandyBridge</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>Penryn</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G5</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G4</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G3</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G2</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>Opteron_G1</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>Nehalem</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>IvyBridge</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Icelake-Server</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Haswell</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>EPYC-Rome</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>EPYC-Milan</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>EPYC</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Dhyana</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Cooperlake</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>Conroe</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Broadwell</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>486</model>
Aug 09 06:44:29 user nova-compute[72809]:     </mode>
Aug 09 06:44:29 user nova-compute[72809]:   </cpu>
Aug 09 06:44:29 user nova-compute[72809]:   <memoryBacking supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:     <enum name='sourceType'>
Aug 09 06:44:29 user nova-compute[72809]:       <value>file</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>anonymous</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>memfd</value>
Aug 09 06:44:29 user nova-compute[72809]:     </enum>
Aug 09 06:44:29 user nova-compute[72809]:   </memoryBacking>
Aug 09 06:44:29 user nova-compute[72809]:   <devices>
Aug 09 06:44:29 user nova-compute[72809]:     <disk supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='diskDevice'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>disk</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>cdrom</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>floppy</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>lun</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='bus'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>fdc</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>scsi</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>usb</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>sata</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='model'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio-transitional</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio-non-transitional</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </disk>
Aug 09 06:44:29 user nova-compute[72809]:     <graphics supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='type'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>sdl</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>vnc</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>spice</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>egl-headless</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </graphics>
Aug 09 06:44:29 user nova-compute[72809]:     <video supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='modelType'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>vga</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>cirrus</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>vmvga</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>qxl</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>none</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>bochs</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>ramfb</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </video>
Aug 09 06:44:29 user nova-compute[72809]:     <hostdev supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='mode'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>subsystem</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='startupPolicy'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>default</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>mandatory</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>requisite</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>optional</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='subsysType'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>usb</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>pci</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>scsi</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='capsType'/>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='pciBackend'/>
Aug 09 06:44:29 user nova-compute[72809]:     </hostdev>
Aug 09 06:44:29 user nova-compute[72809]:     <rng supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='model'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio-transitional</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio-non-transitional</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='backendModel'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>random</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>egd</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>builtin</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </rng>
Aug 09 06:44:29 user nova-compute[72809]:     <filesystem supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='driverType'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>path</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>handle</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtiofs</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </filesystem>
Aug 09 06:44:29 user nova-compute[72809]:     <tpm supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='model'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>tpm-tis</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>tpm-crb</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='backendModel'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>passthrough</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>emulator</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </tpm>
Aug 09 06:44:29 user nova-compute[72809]:   </devices>
Aug 09 06:44:29 user nova-compute[72809]:   <features>
Aug 09 06:44:29 user nova-compute[72809]:     <gic supported='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     <vmcoreinfo supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:     <genid supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:     <backingStoreInput supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:     <backup supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:     <sev supported='no'/>
Aug 09 06:44:29 user nova-compute[72809]:   </features>
Aug 09 06:44:29 user nova-compute[72809]: </domainCapabilities>
Aug 09 06:44:29 user nova-compute[72809]:  {{(pid=72809) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 09 06:44:29 user nova-compute[72809]: <domainCapabilities>
Aug 09 06:44:29 user nova-compute[72809]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 06:44:29 user nova-compute[72809]:   <domain>kvm</domain>
Aug 09 06:44:29 user nova-compute[72809]:   <machine>pc-i440fx-6.2</machine>
Aug 09 06:44:29 user nova-compute[72809]:   <arch>x86_64</arch>
Aug 09 06:44:29 user nova-compute[72809]:   <vcpu max='255'/>
Aug 09 06:44:29 user nova-compute[72809]:   <iothreads supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:   <os supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:     <enum name='firmware'>
Aug 09 06:44:29 user nova-compute[72809]:       <value>efi</value>
Aug 09 06:44:29 user nova-compute[72809]:     </enum>
Aug 09 06:44:29 user nova-compute[72809]:     <loader supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='type'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>rom</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>pflash</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='readonly'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>yes</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>no</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='secure'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>no</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </loader>
Aug 09 06:44:29 user nova-compute[72809]:   </os>
Aug 09 06:44:29 user nova-compute[72809]:   <cpu>
Aug 09 06:44:29 user nova-compute[72809]:     <mode name='host-passthrough' supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='hostPassthroughMigratable'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>on</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>off</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </mode>
Aug 09 06:44:29 user nova-compute[72809]:     <mode name='maximum' supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='maximumMigratable'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>on</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>off</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </mode>
Aug 09 06:44:29 user nova-compute[72809]:     <mode name='host-model' supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <vendor>Intel</vendor>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='ss'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='vmx'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='pcid'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='hypervisor'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='arat'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='umip'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='md-clear'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='stibp'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='ssbd'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='invtsc'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='ibpb'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='ibrs'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='amd-stibp'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='rsba'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='disable' name='erms'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 06:44:29 user nova-compute[72809]:     </mode>
Aug 09 06:44:29 user nova-compute[72809]:     <mode name='custom' supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>qemu64</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>qemu32</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>phenom</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>pentium3</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>pentium2</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>pentium</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>n270</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>kvm64</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>kvm32</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>coreduo</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>core2duo</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>athlon</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>Westmere</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Snowridge</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Server</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Client</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>SandyBridge</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>Penryn</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G5</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G4</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G3</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G2</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>Opteron_G1</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>Nehalem</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>IvyBridge</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Icelake-Server</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Haswell</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>EPYC-Rome</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>EPYC-Milan</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>EPYC</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Dhyana</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Cooperlake</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>Conroe</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Broadwell</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>486</model>
Aug 09 06:44:29 user nova-compute[72809]:     </mode>
Aug 09 06:44:29 user nova-compute[72809]:   </cpu>
Aug 09 06:44:29 user nova-compute[72809]:   <memoryBacking supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:     <enum name='sourceType'>
Aug 09 06:44:29 user nova-compute[72809]:       <value>file</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>anonymous</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>memfd</value>
Aug 09 06:44:29 user nova-compute[72809]:     </enum>
Aug 09 06:44:29 user nova-compute[72809]:   </memoryBacking>
Aug 09 06:44:29 user nova-compute[72809]:   <devices>
Aug 09 06:44:29 user nova-compute[72809]:     <disk supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='diskDevice'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>disk</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>cdrom</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>floppy</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>lun</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='bus'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>ide</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>fdc</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>scsi</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>usb</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>sata</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='model'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio-transitional</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio-non-transitional</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </disk>
Aug 09 06:44:29 user nova-compute[72809]:     <graphics supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='type'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>sdl</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>vnc</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>spice</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>egl-headless</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </graphics>
Aug 09 06:44:29 user nova-compute[72809]:     <video supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='modelType'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>vga</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>cirrus</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>vmvga</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>qxl</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>none</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>bochs</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>ramfb</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </video>
Aug 09 06:44:29 user nova-compute[72809]:     <hostdev supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='mode'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>subsystem</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='startupPolicy'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>default</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>mandatory</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>requisite</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>optional</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='subsysType'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>usb</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>pci</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>scsi</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='capsType'/>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='pciBackend'/>
Aug 09 06:44:29 user nova-compute[72809]:     </hostdev>
Aug 09 06:44:29 user nova-compute[72809]:     <rng supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='model'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio-transitional</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio-non-transitional</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='backendModel'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>random</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>egd</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>builtin</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </rng>
Aug 09 06:44:29 user nova-compute[72809]:     <filesystem supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='driverType'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>path</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>handle</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtiofs</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </filesystem>
Aug 09 06:44:29 user nova-compute[72809]:     <tpm supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='model'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>tpm-tis</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>tpm-crb</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='backendModel'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>passthrough</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>emulator</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </tpm>
Aug 09 06:44:29 user nova-compute[72809]:   </devices>
Aug 09 06:44:29 user nova-compute[72809]:   <features>
Aug 09 06:44:29 user nova-compute[72809]:     <gic supported='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     <vmcoreinfo supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:     <genid supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:     <backingStoreInput supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:     <backup supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:     <sev supported='no'/>
Aug 09 06:44:29 user nova-compute[72809]:   </features>
Aug 09 06:44:29 user nova-compute[72809]: </domainCapabilities>
Aug 09 06:44:29 user nova-compute[72809]:  {{(pid=72809) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 09 06:44:29 user nova-compute[72809]: <domainCapabilities>
Aug 09 06:44:29 user nova-compute[72809]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 06:44:29 user nova-compute[72809]:   <domain>kvm</domain>
Aug 09 06:44:29 user nova-compute[72809]:   <machine>pc-q35-jammy</machine>
Aug 09 06:44:29 user nova-compute[72809]:   <arch>x86_64</arch>
Aug 09 06:44:29 user nova-compute[72809]:   <vcpu max='288'/>
Aug 09 06:44:29 user nova-compute[72809]:   <iothreads supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:   <os supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:     <enum name='firmware'>
Aug 09 06:44:29 user nova-compute[72809]:       <value>efi</value>
Aug 09 06:44:29 user nova-compute[72809]:     </enum>
Aug 09 06:44:29 user nova-compute[72809]:     <loader supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='type'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>rom</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>pflash</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='readonly'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>yes</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>no</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='secure'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>yes</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>no</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </loader>
Aug 09 06:44:29 user nova-compute[72809]:   </os>
Aug 09 06:44:29 user nova-compute[72809]:   <cpu>
Aug 09 06:44:29 user nova-compute[72809]:     <mode name='host-passthrough' supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='hostPassthroughMigratable'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>on</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>off</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </mode>
Aug 09 06:44:29 user nova-compute[72809]:     <mode name='maximum' supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='maximumMigratable'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>on</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>off</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </mode>
Aug 09 06:44:29 user nova-compute[72809]:     <mode name='host-model' supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <vendor>Intel</vendor>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='ss'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='vmx'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='pcid'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='hypervisor'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='arat'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='umip'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='md-clear'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='stibp'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='ssbd'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='invtsc'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='ibpb'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='ibrs'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='amd-stibp'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='rsba'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='disable' name='erms'/>
Aug 09 06:44:29 user nova-compute[72809]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 06:44:29 user nova-compute[72809]:     </mode>
Aug 09 06:44:29 user nova-compute[72809]:     <mode name='custom' supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>qemu64</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>qemu32</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>phenom</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>pentium3</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>pentium2</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>pentium</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>n270</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>kvm64</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>kvm32</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>coreduo</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>core2duo</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>athlon</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>Westmere</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Snowridge</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Server</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Skylake-Client</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>SandyBridge</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>Penryn</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G5</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G4</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G3</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Opteron_G2</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>Opteron_G1</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>Nehalem</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>IvyBridge</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Icelake-Server</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Haswell</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>EPYC-Rome</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>EPYC-Milan</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>EPYC</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Dhyana</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Cooperlake</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>Conroe</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='no'>Broadwell</model>
Aug 09 06:44:29 user nova-compute[72809]:       <model usable='yes'>486</model>
Aug 09 06:44:29 user nova-compute[72809]:     </mode>
Aug 09 06:44:29 user nova-compute[72809]:   </cpu>
Aug 09 06:44:29 user nova-compute[72809]:   <memoryBacking supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:     <enum name='sourceType'>
Aug 09 06:44:29 user nova-compute[72809]:       <value>file</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>anonymous</value>
Aug 09 06:44:29 user nova-compute[72809]:       <value>memfd</value>
Aug 09 06:44:29 user nova-compute[72809]:     </enum>
Aug 09 06:44:29 user nova-compute[72809]:   </memoryBacking>
Aug 09 06:44:29 user nova-compute[72809]:   <devices>
Aug 09 06:44:29 user nova-compute[72809]:     <disk supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='diskDevice'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>disk</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>cdrom</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>floppy</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>lun</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='bus'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>fdc</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>scsi</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>usb</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>sata</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='model'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio-transitional</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio-non-transitional</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </disk>
Aug 09 06:44:29 user nova-compute[72809]:     <graphics supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='type'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>sdl</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>vnc</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>spice</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>egl-headless</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </graphics>
Aug 09 06:44:29 user nova-compute[72809]:     <video supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='modelType'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>vga</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>cirrus</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>vmvga</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>qxl</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>none</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>bochs</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>ramfb</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </video>
Aug 09 06:44:29 user nova-compute[72809]:     <hostdev supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='mode'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>subsystem</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='startupPolicy'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>default</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>mandatory</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>requisite</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>optional</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='subsysType'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>usb</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>pci</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>scsi</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='capsType'/>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='pciBackend'/>
Aug 09 06:44:29 user nova-compute[72809]:     </hostdev>
Aug 09 06:44:29 user nova-compute[72809]:     <rng supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='model'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio-transitional</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtio-non-transitional</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='backendModel'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>random</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>egd</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>builtin</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </rng>
Aug 09 06:44:29 user nova-compute[72809]:     <filesystem supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='driverType'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>path</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>handle</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>virtiofs</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </filesystem>
Aug 09 06:44:29 user nova-compute[72809]:     <tpm supported='yes'>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='model'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>tpm-tis</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>tpm-crb</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:       <enum name='backendModel'>
Aug 09 06:44:29 user nova-compute[72809]:         <value>passthrough</value>
Aug 09 06:44:29 user nova-compute[72809]:         <value>emulator</value>
Aug 09 06:44:29 user nova-compute[72809]:       </enum>
Aug 09 06:44:29 user nova-compute[72809]:     </tpm>
Aug 09 06:44:29 user nova-compute[72809]:   </devices>
Aug 09 06:44:29 user nova-compute[72809]:   <features>
Aug 09 06:44:29 user nova-compute[72809]:     <gic supported='no'/>
Aug 09 06:44:29 user nova-compute[72809]:     <vmcoreinfo supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:     <genid supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:     <backingStoreInput supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:     <backup supported='yes'/>
Aug 09 06:44:29 user nova-compute[72809]:     <sev supported='no'/>
Aug 09 06:44:29 user nova-compute[72809]:   </features>
Aug 09 06:44:29 user nova-compute[72809]: </domainCapabilities>
Aug 09 06:44:29 user nova-compute[72809]:  {{(pid=72809) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72809) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72809) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72809) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72809) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Checking secure boot support for host arch (x86_64) {{(pid=72809) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Checking secure boot support for host arch (x86_64) {{(pid=72809) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Checking secure boot support for host arch (x86_64) {{(pid=72809) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 09 06:44:29 user nova-compute[72809]: INFO nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Secure Boot support detected
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] cpu compare xml: <cpu match="exact">
Aug 09 06:44:29 user nova-compute[72809]:   <model>Nehalem</model>
Aug 09 06:44:29 user nova-compute[72809]: </cpu>
Aug 09 06:44:29 user nova-compute[72809]:  {{(pid=72809) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 09 06:44:29 user nova-compute[72809]: INFO nova.virt.node [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Generated node identity 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3
Aug 09 06:44:29 user nova-compute[72809]: INFO nova.virt.node [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Wrote node identity 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 to /opt/stack/data/nova/compute_id
Aug 09 06:44:29 user nova-compute[72809]: WARNING nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Compute nodes ['28f55a7b-2cb8-4eb0-b993-21feaf69c3a3'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 09 06:44:29 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 09 06:44:29 user nova-compute[72809]: WARNING nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 09 06:44:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:44:29 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 06:44:30 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:44:30 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:44:30 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Hypervisor/Node resource view: name=user free_ram=10844MB free_disk=26.267005920410156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 06:44:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:44:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:44:30 user nova-compute[72809]: WARNING nova.compute.resource_tracker [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] No compute node record for user:28f55a7b-2cb8-4eb0-b993-21feaf69c3a3: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 could not be found.
Aug 09 06:44:30 user nova-compute[72809]: INFO nova.compute.resource_tracker [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Compute node record created for user:user with uuid: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3
Aug 09 06:44:30 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 06:44:30 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 06:44:30 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [req-038c8d45-42d3-48fc-9953-e7f9a3ab9866] Created resource provider record via placement API for resource provider with UUID 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 and name user.
Aug 09 06:44:30 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72809) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 09 06:44:30 user nova-compute[72809]: INFO nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] kernel doesn't support AMD SEV
Aug 09 06:44:30 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Updating inventory in ProviderTree for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 06:44:30 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:44:30 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Libvirt baseline CPU <cpu>
Aug 09 06:44:30 user nova-compute[72809]:   <arch>x86_64</arch>
Aug 09 06:44:30 user nova-compute[72809]:   <model>Nehalem</model>
Aug 09 06:44:30 user nova-compute[72809]:   <vendor>Intel</vendor>
Aug 09 06:44:30 user nova-compute[72809]:   <topology sockets="6" cores="1" threads="1"/>
Aug 09 06:44:30 user nova-compute[72809]: </cpu>
Aug 09 06:44:30 user nova-compute[72809]:  {{(pid=72809) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 09 06:44:30 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Updated inventory for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 09 06:44:30 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Updating resource provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 generation from 0 to 1 during operation: update_inventory {{(pid=72809) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 09 06:44:30 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Updating inventory in ProviderTree for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 06:44:30 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Updating resource provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 generation from 1 to 2 during operation: update_traits {{(pid=72809) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 09 06:44:30 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 06:44:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.645s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:44:30 user nova-compute[72809]: DEBUG nova.service [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Creating RPC server for service compute {{(pid=72809) start /opt/stack/nova/nova/service.py:182}}
Aug 09 06:44:30 user nova-compute[72809]: DEBUG nova.service [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Join ServiceGroup membership for this service compute {{(pid=72809) start /opt/stack/nova/nova/service.py:199}}
Aug 09 06:44:30 user nova-compute[72809]: DEBUG nova.servicegroup.drivers.db [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72809) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 09 06:45:15 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._sync_power_states {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:45:15 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:45:21 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:45:21 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:45:21 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 06:45:21 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Rebuilding the list of instances to heal {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 06:45:21 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Didn't find any instances for network info cache update. {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 06:45:21 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:45:21 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:45:21 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:45:21 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:45:21 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:45:21 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:45:21 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 06:45:21 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:45:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:45:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:45:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:45:21 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 06:45:22 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:45:22 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:45:22 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=10234MB free_disk=26.170757293701172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 06:45:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:45:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:45:22 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 06:45:22 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 06:45:22 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:45:22 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:45:22 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 06:45:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:46:22 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:46:22 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:46:22 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:46:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:46:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:46:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:46:22 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 06:46:22 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:46:22 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:46:22 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=10188MB free_disk=26.216571807861328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 06:46:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:46:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:46:22 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 06:46:22 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 06:46:22 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:46:22 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:46:22 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 06:46:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.103s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:46:23 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:46:23 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 06:46:23 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Rebuilding the list of instances to heal {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 06:46:23 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Didn't find any instances for network info cache update. {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 06:46:23 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:46:23 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:46:23 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:46:23 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:46:23 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:46:23 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:46:23 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 06:47:21 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:47:21 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:47:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:47:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:47:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:47:21 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 06:47:22 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:47:22 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:47:22 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=10173MB free_disk=25.989978790283203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 06:47:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:47:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:47:22 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 06:47:22 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 06:47:22 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:47:22 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:47:22 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 06:47:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:47:23 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:47:23 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:47:23 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 06:47:23 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Rebuilding the list of instances to heal {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 06:47:23 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Didn't find any instances for network info cache update. {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 06:47:23 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:47:23 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:47:23 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 06:47:25 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:47:25 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:47:25 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:48:21 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:48:23 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:48:23 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:48:23 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:48:23 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 06:48:23 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:48:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:23 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 06:48:24 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:48:24 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:48:24 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=9459MB free_disk=26.012653350830078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 06:48:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:24 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 06:48:24 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 06:48:24 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:48:24 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:48:24 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 06:48:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:25 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:48:25 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 06:48:25 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Rebuilding the list of instances to heal {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 06:48:25 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Didn't find any instances for network info cache update. {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 06:48:25 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:48:26 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:48:27 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:48:27 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:48:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Acquiring lock "f647a50e-ee90-480a-ad5d-68f1782628d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Lock "f647a50e-ee90-480a-ad5d-68f1782628d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:36 user nova-compute[72809]: DEBUG nova.compute.manager [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 06:48:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:36 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 06:48:36 user nova-compute[72809]: INFO nova.compute.claims [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Claim successful on node user
Aug 09 06:48:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:36 user nova-compute[72809]: DEBUG nova.compute.manager [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 06:48:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:36 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:48:36 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:48:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.372s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:36 user nova-compute[72809]: DEBUG nova.compute.manager [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 06:48:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.107s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:36 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 06:48:36 user nova-compute[72809]: INFO nova.compute.claims [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Claim successful on node user
Aug 09 06:48:36 user nova-compute[72809]: DEBUG nova.compute.manager [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 06:48:36 user nova-compute[72809]: DEBUG nova.network.neutron [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 06:48:36 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 06:48:36 user nova-compute[72809]: DEBUG nova.compute.manager [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 06:48:37 user nova-compute[72809]: DEBUG nova.compute.manager [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 06:48:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 06:48:37 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Creating image(s)
Aug 09 06:48:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Acquiring lock "/opt/stack/data/nova/instances/f647a50e-ee90-480a-ad5d-68f1782628d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Lock "/opt/stack/data/nova/instances/f647a50e-ee90-480a-ad5d-68f1782628d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Lock "/opt/stack/data/nova/instances/f647a50e-ee90-480a-ad5d-68f1782628d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:37 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:48:37 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:48:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:37 user nova-compute[72809]: DEBUG nova.compute.manager [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 06:48:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquiring lock "15dda080-3487-4316-ab7b-f7185f0a4519" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "15dda080-3487-4316-ab7b-f7185f0a4519" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:37 user nova-compute[72809]: DEBUG nova.compute.manager [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 06:48:37 user nova-compute[72809]: DEBUG nova.compute.manager [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 06:48:37 user nova-compute[72809]: DEBUG nova.network.neutron [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 06:48:37 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 06:48:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8.part --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:48:37 user nova-compute[72809]: DEBUG nova.policy [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ab5538447c24e2dadf6e69617f39f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3636086472e14f9099379775a9321b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 06:48:37 user nova-compute[72809]: DEBUG nova.policy [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '87785e8362a14385a951638f4d7cf817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a7945f87914776a3f58bda58b7c90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 06:48:37 user nova-compute[72809]: DEBUG nova.compute.manager [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 06:48:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Acquiring lock "3640991e-8a5b-4674-af81-3117d4269a68" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "3640991e-8a5b-4674-af81-3117d4269a68" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8.part --force-share --output=json" returned: 0 in 0.141s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:48:37 user nova-compute[72809]: DEBUG nova.virt.images [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] ba0d3e02-2e8a-403f-97cd-a9787534aa58 was qcow2, converting to raw {{(pid=72809) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 06:48:37 user nova-compute[72809]: DEBUG nova.privsep.utils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72809) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 06:48:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8.part /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8.converted {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:48:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:37 user nova-compute[72809]: DEBUG nova.compute.manager [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 06:48:37 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 06:48:37 user nova-compute[72809]: INFO nova.compute.claims [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Claim successful on node user
Aug 09 06:48:38 user nova-compute[72809]: DEBUG nova.compute.manager [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 06:48:38 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 06:48:38 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Creating image(s)
Aug 09 06:48:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "/opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "/opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "/opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8.part /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8.converted" returned: 0 in 0.163s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:48:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8.converted --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:48:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:48:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.203s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:38 user nova-compute[72809]: INFO oslo.privsep.daemon [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp2tm9fjmc/privsep.sock']
Aug 09 06:48:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.235s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:38 user sudo[81956]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp2tm9fjmc/privsep.sock
Aug 09 06:48:38 user sudo[81956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 09 06:48:38 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:48:38 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:48:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:38 user nova-compute[72809]: DEBUG nova.compute.manager [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 06:48:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.330s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:38 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 06:48:38 user nova-compute[72809]: INFO nova.compute.claims [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Claim successful on node user
Aug 09 06:48:38 user nova-compute[72809]: DEBUG nova.compute.manager [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 06:48:38 user nova-compute[72809]: DEBUG nova.network.neutron [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 06:48:38 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 06:48:38 user nova-compute[72809]: DEBUG nova.compute.manager [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 06:48:38 user nova-compute[72809]: DEBUG nova.compute.manager [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 06:48:38 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 06:48:38 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Creating image(s)
Aug 09 06:48:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquiring lock "/opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "/opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "/opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:38 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:48:38 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:48:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:38 user nova-compute[72809]: DEBUG nova.compute.manager [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 06:48:39 user nova-compute[72809]: DEBUG nova.compute.manager [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 06:48:39 user nova-compute[72809]: DEBUG nova.network.neutron [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 06:48:39 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 06:48:39 user nova-compute[72809]: DEBUG nova.compute.manager [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 06:48:39 user nova-compute[72809]: DEBUG nova.policy [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0347074764734e2a8ca3f580efcb1272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb0421f625467a8205b8000a6dcee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 06:48:39 user nova-compute[72809]: DEBUG nova.compute.manager [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 06:48:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 06:48:39 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Creating image(s)
Aug 09 06:48:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Acquiring lock "/opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "/opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "/opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:39 user nova-compute[72809]: DEBUG nova.policy [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '98a58716cb5f4c86952ef9e1f555e6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04f60d3bd9a41fc930f728a74371a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 06:48:40 user sudo[81956]: pam_unix(sudo:session): session closed for user root
Aug 09 06:48:40 user nova-compute[72809]: INFO oslo.privsep.daemon [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Spawned new privsep daemon via rootwrap
Aug 09 06:48:40 user nova-compute[72809]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 09 06:48:40 user nova-compute[72809]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 09 06:48:40 user nova-compute[72809]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 09 06:48:40 user nova-compute[72809]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81959
Aug 09 06:48:40 user nova-compute[72809]: WARNING oslo_privsep.priv_context [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] privsep daemon already running
Aug 09 06:48:40 user nova-compute[72809]: WARNING oslo_privsep.priv_context [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] privsep daemon already running
Aug 09 06:48:40 user nova-compute[72809]: WARNING oslo_privsep.priv_context [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] privsep daemon already running
Aug 09 06:48:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:48:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:48:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:48:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:48:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.148s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:48:40 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:40 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:48:40 user nova-compute[72809]: DEBUG nova.network.neutron [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Successfully created port: 3554b93c-4cee-4835-980f-413908f76f98 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:48:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.166s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:48:40 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.156s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:48:40 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.176s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:48:40 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.147s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:48:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:48:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk 1073741824" returned: 0 in 0.068s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:48:40 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:48:40 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.215s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.168s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Checking if we can resize image /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.178s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/f647a50e-ee90-480a-ad5d-68f1782628d9/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG nova.network.neutron [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Successfully created port: f12bff80-425f-42ba-804d-540ad751f70c {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/f647a50e-ee90-480a-ad5d-68f1782628d9/disk 1073741824" returned: 0 in 0.049s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.460s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Cannot resize image /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG nova.objects.instance [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lazy-loading 'migration_context' on Instance uuid 24ba9b41-d0bf-4a84-9f04-bfda9525b154 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Ensure instance console log exists: /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.177s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f647a50e-ee90-480a-ad5d-68f1782628d9/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f647a50e-ee90-480a-ad5d-68f1782628d9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.180s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk 1073741824" returned: 0 in 0.072s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.700s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f647a50e-ee90-480a-ad5d-68f1782628d9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Cannot resize image /opt/stack/data/nova/instances/f647a50e-ee90-480a-ad5d-68f1782628d9/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG nova.objects.instance [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Lazy-loading 'migration_context' on Instance uuid f647a50e-ee90-480a-ad5d-68f1782628d9 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Ensure instance console log exists: /opt/stack/data/nova/instances/f647a50e-ee90-480a-ad5d-68f1782628d9/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.125s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.168s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk 1073741824" returned: 0 in 0.069s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Cannot resize image /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG nova.objects.instance [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lazy-loading 'migration_context' on Instance uuid 3640991e-8a5b-4674-af81-3117d4269a68 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Ensure instance console log exists: /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.174s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Checking if we can resize image /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 06:48:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:48:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:48:42 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Cannot resize image /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 06:48:42 user nova-compute[72809]: DEBUG nova.objects.instance [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lazy-loading 'migration_context' on Instance uuid 15dda080-3487-4316-ab7b-f7185f0a4519 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:48:42 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 06:48:42 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Ensure instance console log exists: /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 06:48:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:42 user nova-compute[72809]: DEBUG nova.network.neutron [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Successfully created port: 6efe1803-2ae3-490f-8791-c2ba35919f09 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:48:42 user nova-compute[72809]: DEBUG nova.network.neutron [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Successfully created port: 030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:48:43 user nova-compute[72809]: DEBUG nova.network.neutron [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Successfully updated port: 3554b93c-4cee-4835-980f-413908f76f98 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:48:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Acquiring lock "refresh_cache-f647a50e-ee90-480a-ad5d-68f1782628d9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:48:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Acquired lock "refresh_cache-f647a50e-ee90-480a-ad5d-68f1782628d9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:48:43 user nova-compute[72809]: DEBUG nova.network.neutron [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.network.neutron [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.network.neutron [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Successfully updated port: f12bff80-425f-42ba-804d-540ad751f70c {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "refresh_cache-24ba9b41-d0bf-4a84-9f04-bfda9525b154" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquired lock "refresh_cache-24ba9b41-d0bf-4a84-9f04-bfda9525b154" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.network.neutron [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.compute.manager [req-d2835e74-04bd-43c3-8a47-d900966a74fc req-cd52673b-260b-4a79-bb19-410c23088afd service nova] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Received event network-changed-3554b93c-4cee-4835-980f-413908f76f98 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.compute.manager [req-d2835e74-04bd-43c3-8a47-d900966a74fc req-cd52673b-260b-4a79-bb19-410c23088afd service nova] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Refreshing instance network info cache due to event network-changed-3554b93c-4cee-4835-980f-413908f76f98. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d2835e74-04bd-43c3-8a47-d900966a74fc req-cd52673b-260b-4a79-bb19-410c23088afd service nova] Acquiring lock "refresh_cache-f647a50e-ee90-480a-ad5d-68f1782628d9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.network.neutron [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.compute.manager [req-038c2165-3184-4e29-b6bd-3df3d38f5e4e req-16195543-135c-4930-8d5f-071ea8030082 service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Received event network-changed-f12bff80-425f-42ba-804d-540ad751f70c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.compute.manager [req-038c2165-3184-4e29-b6bd-3df3d38f5e4e req-16195543-135c-4930-8d5f-071ea8030082 service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Refreshing instance network info cache due to event network-changed-f12bff80-425f-42ba-804d-540ad751f70c. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-038c2165-3184-4e29-b6bd-3df3d38f5e4e req-16195543-135c-4930-8d5f-071ea8030082 service nova] Acquiring lock "refresh_cache-24ba9b41-d0bf-4a84-9f04-bfda9525b154" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.network.neutron [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Updating instance_info_cache with network_info: [{"id": "3554b93c-4cee-4835-980f-413908f76f98", "address": "fa:16:3e:d2:c2:42", "network": {"id": "c3574890-d7f0-44ba-8d4c-eb378ab1c691", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-307148854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3636086472e14f9099379775a9321b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3554b93c-4c", "ovs_interfaceid": "3554b93c-4cee-4835-980f-413908f76f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Releasing lock "refresh_cache-f647a50e-ee90-480a-ad5d-68f1782628d9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.compute.manager [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Instance network_info: |[{"id": "3554b93c-4cee-4835-980f-413908f76f98", "address": "fa:16:3e:d2:c2:42", "network": {"id": "c3574890-d7f0-44ba-8d4c-eb378ab1c691", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-307148854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3636086472e14f9099379775a9321b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3554b93c-4c", "ovs_interfaceid": "3554b93c-4cee-4835-980f-413908f76f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d2835e74-04bd-43c3-8a47-d900966a74fc req-cd52673b-260b-4a79-bb19-410c23088afd service nova] Acquired lock "refresh_cache-f647a50e-ee90-480a-ad5d-68f1782628d9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.network.neutron [req-d2835e74-04bd-43c3-8a47-d900966a74fc req-cd52673b-260b-4a79-bb19-410c23088afd service nova] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Refreshing network info cache for port 3554b93c-4cee-4835-980f-413908f76f98 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Start _get_guest_xml network_info=[{"id": "3554b93c-4cee-4835-980f-413908f76f98", "address": "fa:16:3e:d2:c2:42", "network": {"id": "c3574890-d7f0-44ba-8d4c-eb378ab1c691", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-307148854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3636086472e14f9099379775a9321b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3554b93c-4c", "ovs_interfaceid": "3554b93c-4cee-4835-980f-413908f76f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:48:44 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:48:44 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.privsep.utils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72809) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:48:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1450180385',display_name='tempest-DeleteServersTestJSON-server-1450180385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1450180385',id=1,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3636086472e14f9099379775a9321b39',ramdisk_id='',reservation_id='r-amgb8p8v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1175700212',owner_user_name='tempest-DeleteServersTestJSON-1175700212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:48:37Z,user_data=None,user_id='3ab5538447c24e2dadf6e69617f39f73',uuid=f647a50e-ee90-480a-ad5d-68f1782628d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3554b93c-4cee-4835-980f-413908f76f98", "address": "fa:16:3e:d2:c2:42", "network": {"id": "c3574890-d7f0-44ba-8d4c-eb378ab1c691", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-307148854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3636086472e14f9099379775a9321b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3554b93c-4c", "ovs_interfaceid": "3554b93c-4cee-4835-980f-413908f76f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Converting VIF {"id": "3554b93c-4cee-4835-980f-413908f76f98", "address": "fa:16:3e:d2:c2:42", "network": {"id": "c3574890-d7f0-44ba-8d4c-eb378ab1c691", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-307148854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3636086472e14f9099379775a9321b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3554b93c-4c", "ovs_interfaceid": "3554b93c-4cee-4835-980f-413908f76f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:c2:42,bridge_name='br-int',has_traffic_filtering=True,id=3554b93c-4cee-4835-980f-413908f76f98,network=Network(c3574890-d7f0-44ba-8d4c-eb378ab1c691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3554b93c-4c') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.objects.instance [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Lazy-loading 'pci_devices' on Instance uuid f647a50e-ee90-480a-ad5d-68f1782628d9 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:48:44 user nova-compute[72809]:   <uuid>f647a50e-ee90-480a-ad5d-68f1782628d9</uuid>
Aug 09 06:48:44 user nova-compute[72809]:   <name>instance-00000001</name>
Aug 09 06:48:44 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:48:44 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:48:44 user nova-compute[72809]:   <metadata>
Aug 09 06:48:44 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:48:44 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:48:44 user nova-compute[72809]:       <nova:name>tempest-DeleteServersTestJSON-server-1450180385</nova:name>
Aug 09 06:48:44 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:48:44</nova:creationTime>
Aug 09 06:48:44 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:48:44 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:48:44 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:48:44 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:48:44 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:48:44 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:48:44 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:48:44 user nova-compute[72809]:       <nova:owner>
Aug 09 06:48:44 user nova-compute[72809]:         <nova:user uuid="3ab5538447c24e2dadf6e69617f39f73">tempest-DeleteServersTestJSON-1175700212-project-member</nova:user>
Aug 09 06:48:44 user nova-compute[72809]:         <nova:project uuid="3636086472e14f9099379775a9321b39">tempest-DeleteServersTestJSON-1175700212</nova:project>
Aug 09 06:48:44 user nova-compute[72809]:       </nova:owner>
Aug 09 06:48:44 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:48:44 user nova-compute[72809]:       <nova:ports>
Aug 09 06:48:44 user nova-compute[72809]:         <nova:port uuid="3554b93c-4cee-4835-980f-413908f76f98">
Aug 09 06:48:44 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 06:48:44 user nova-compute[72809]:         </nova:port>
Aug 09 06:48:44 user nova-compute[72809]:       </nova:ports>
Aug 09 06:48:44 user nova-compute[72809]:     </nova:instance>
Aug 09 06:48:44 user nova-compute[72809]:   </metadata>
Aug 09 06:48:44 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:48:44 user nova-compute[72809]:     <system>
Aug 09 06:48:44 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:48:44 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:48:44 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:48:44 user nova-compute[72809]:       <entry name="serial">f647a50e-ee90-480a-ad5d-68f1782628d9</entry>
Aug 09 06:48:44 user nova-compute[72809]:       <entry name="uuid">f647a50e-ee90-480a-ad5d-68f1782628d9</entry>
Aug 09 06:48:44 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:48:44 user nova-compute[72809]:     </system>
Aug 09 06:48:44 user nova-compute[72809]:   </sysinfo>
Aug 09 06:48:44 user nova-compute[72809]:   <os>
Aug 09 06:48:44 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:48:44 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 06:48:44 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:48:44 user nova-compute[72809]:   </os>
Aug 09 06:48:44 user nova-compute[72809]:   <features>
Aug 09 06:48:44 user nova-compute[72809]:     <acpi/>
Aug 09 06:48:44 user nova-compute[72809]:     <apic/>
Aug 09 06:48:44 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:48:44 user nova-compute[72809]:   </features>
Aug 09 06:48:44 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:48:44 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:48:44 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:48:44 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:48:44 user nova-compute[72809]:   </clock>
Aug 09 06:48:44 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:48:44 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:48:44 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:48:44 user nova-compute[72809]:   </cpu>
Aug 09 06:48:44 user nova-compute[72809]:   <devices>
Aug 09 06:48:44 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:48:44 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:48:44 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/f647a50e-ee90-480a-ad5d-68f1782628d9/disk"/>
Aug 09 06:48:44 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:48:44 user nova-compute[72809]:     </disk>
Aug 09 06:48:44 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:48:44 user nova-compute[72809]:       <mac address="fa:16:3e:d2:c2:42"/>
Aug 09 06:48:44 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:48:44 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:48:44 user nova-compute[72809]:       <target dev="tap3554b93c-4c"/>
Aug 09 06:48:44 user nova-compute[72809]:     </interface>
Aug 09 06:48:44 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:48:44 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/f647a50e-ee90-480a-ad5d-68f1782628d9/console.log" append="off"/>
Aug 09 06:48:44 user nova-compute[72809]:     </serial>
Aug 09 06:48:44 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:48:44 user nova-compute[72809]:     <video>
Aug 09 06:48:44 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:48:44 user nova-compute[72809]:     </video>
Aug 09 06:48:44 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:48:44 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:48:44 user nova-compute[72809]:     </rng>
Aug 09 06:48:44 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:48:44 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:48:44 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:48:44 user nova-compute[72809]:     </memballoon>
Aug 09 06:48:44 user nova-compute[72809]:   </devices>
Aug 09 06:48:44 user nova-compute[72809]: </domain>
Aug 09 06:48:44 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:48:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1450180385',display_name='tempest-DeleteServersTestJSON-server-1450180385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1450180385',id=1,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3636086472e14f9099379775a9321b39',ramdisk_id='',reservation_id='r-amgb8p8v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1175700212',owner_user_name='tempest-DeleteServersTestJSON-1175700212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:48:37Z,user_data=None,user_id='3ab5538447c24e2dadf6e69617f39f73',uuid=f647a50e-ee90-480a-ad5d-68f1782628d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3554b93c-4cee-4835-980f-413908f76f98", "address": "fa:16:3e:d2:c2:42", "network": {"id": "c3574890-d7f0-44ba-8d4c-eb378ab1c691", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-307148854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3636086472e14f9099379775a9321b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3554b93c-4c", "ovs_interfaceid": "3554b93c-4cee-4835-980f-413908f76f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Converting VIF {"id": "3554b93c-4cee-4835-980f-413908f76f98", "address": "fa:16:3e:d2:c2:42", "network": {"id": "c3574890-d7f0-44ba-8d4c-eb378ab1c691", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-307148854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3636086472e14f9099379775a9321b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3554b93c-4c", "ovs_interfaceid": "3554b93c-4cee-4835-980f-413908f76f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:c2:42,bridge_name='br-int',has_traffic_filtering=True,id=3554b93c-4cee-4835-980f-413908f76f98,network=Network(c3574890-d7f0-44ba-8d4c-eb378ab1c691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3554b93c-4c') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:48:44 user nova-compute[72809]: DEBUG os_vif [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:c2:42,bridge_name='br-int',has_traffic_filtering=True,id=3554b93c-4cee-4835-980f-413908f76f98,network=Network(c3574890-d7f0-44ba-8d4c-eb378ab1c691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3554b93c-4c') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Created schema index Interface.name {{(pid=72809) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Created schema index Port.name {{(pid=72809) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Created schema index Bridge.name {{(pid=72809) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [POLLOUT] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:48:45 user nova-compute[72809]: INFO oslo.privsep.daemon [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpnt2zhjg9/privsep.sock']
Aug 09 06:48:45 user sudo[82027]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpnt2zhjg9/privsep.sock
Aug 09 06:48:45 user sudo[82027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 09 06:48:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG nova.network.neutron [req-d2835e74-04bd-43c3-8a47-d900966a74fc req-cd52673b-260b-4a79-bb19-410c23088afd service nova] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Updated VIF entry in instance network info cache for port 3554b93c-4cee-4835-980f-413908f76f98. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG nova.network.neutron [req-d2835e74-04bd-43c3-8a47-d900966a74fc req-cd52673b-260b-4a79-bb19-410c23088afd service nova] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Updating instance_info_cache with network_info: [{"id": "3554b93c-4cee-4835-980f-413908f76f98", "address": "fa:16:3e:d2:c2:42", "network": {"id": "c3574890-d7f0-44ba-8d4c-eb378ab1c691", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-307148854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3636086472e14f9099379775a9321b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3554b93c-4c", "ovs_interfaceid": "3554b93c-4cee-4835-980f-413908f76f98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG nova.network.neutron [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Updating instance_info_cache with network_info: [{"id": "f12bff80-425f-42ba-804d-540ad751f70c", "address": "fa:16:3e:36:6c:27", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12bff80-42", "ovs_interfaceid": "f12bff80-425f-42ba-804d-540ad751f70c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d2835e74-04bd-43c3-8a47-d900966a74fc req-cd52673b-260b-4a79-bb19-410c23088afd service nova] Releasing lock "refresh_cache-f647a50e-ee90-480a-ad5d-68f1782628d9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Releasing lock "refresh_cache-24ba9b41-d0bf-4a84-9f04-bfda9525b154" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG nova.compute.manager [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Instance network_info: |[{"id": "f12bff80-425f-42ba-804d-540ad751f70c", "address": "fa:16:3e:36:6c:27", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12bff80-42", "ovs_interfaceid": "f12bff80-425f-42ba-804d-540ad751f70c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-038c2165-3184-4e29-b6bd-3df3d38f5e4e req-16195543-135c-4930-8d5f-071ea8030082 service nova] Acquired lock "refresh_cache-24ba9b41-d0bf-4a84-9f04-bfda9525b154" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG nova.network.neutron [req-038c2165-3184-4e29-b6bd-3df3d38f5e4e req-16195543-135c-4930-8d5f-071ea8030082 service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Refreshing network info cache for port f12bff80-425f-42ba-804d-540ad751f70c {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Start _get_guest_xml network_info=[{"id": "f12bff80-425f-42ba-804d-540ad751f70c", "address": "fa:16:3e:36:6c:27", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12bff80-42", "ovs_interfaceid": "f12bff80-425f-42ba-804d-540ad751f70c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:48:45 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:48:45 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:48:45 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:48:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-450574580',display_name='tempest-AttachVolumeTestJSON-server-450574580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-450574580',id=2,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDJ0cgVVGdxmBusvy2LpBlTCELREPHX0PiRGBl4xUaShS+GxBoB6howy4sQdzJp5xGl40sCcx5e/0j2dhekoUvRjUbaKjJ/gVIKho4UvqK2B4IB5h/y1k8THmm8SIXqLw==',key_name='tempest-keypair-1151798744',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55a7945f87914776a3f58bda58b7c90c',ramdisk_id='',reservation_id='r-0e3nfuh3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1328011883',owner_user_name='tempest-AttachVolumeTestJSON-1328011883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:48:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87785e8362a14385a951638f4d7cf817',uuid=24ba9b41-d0bf-4a84-9f04-bfda9525b154,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f12bff80-425f-42ba-804d-540ad751f70c", "address": "fa:16:3e:36:6c:27", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12bff80-42", "ovs_interfaceid": "f12bff80-425f-42ba-804d-540ad751f70c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Converting VIF {"id": "f12bff80-425f-42ba-804d-540ad751f70c", "address": "fa:16:3e:36:6c:27", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12bff80-42", "ovs_interfaceid": "f12bff80-425f-42ba-804d-540ad751f70c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:6c:27,bridge_name='br-int',has_traffic_filtering=True,id=f12bff80-425f-42ba-804d-540ad751f70c,network=Network(3430cb1f-9729-4613-bc8b-0fcdafd88198),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12bff80-42') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG nova.objects.instance [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lazy-loading 'pci_devices' on Instance uuid 24ba9b41-d0bf-4a84-9f04-bfda9525b154 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:48:45 user nova-compute[72809]:   <uuid>24ba9b41-d0bf-4a84-9f04-bfda9525b154</uuid>
Aug 09 06:48:45 user nova-compute[72809]:   <name>instance-00000002</name>
Aug 09 06:48:45 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:48:45 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:48:45 user nova-compute[72809]:   <metadata>
Aug 09 06:48:45 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:48:45 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:48:45 user nova-compute[72809]:       <nova:name>tempest-AttachVolumeTestJSON-server-450574580</nova:name>
Aug 09 06:48:45 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:48:45</nova:creationTime>
Aug 09 06:48:45 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:48:45 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:48:45 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:48:45 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:48:45 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:48:45 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:48:45 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:48:45 user nova-compute[72809]:       <nova:owner>
Aug 09 06:48:45 user nova-compute[72809]:         <nova:user uuid="87785e8362a14385a951638f4d7cf817">tempest-AttachVolumeTestJSON-1328011883-project-member</nova:user>
Aug 09 06:48:45 user nova-compute[72809]:         <nova:project uuid="55a7945f87914776a3f58bda58b7c90c">tempest-AttachVolumeTestJSON-1328011883</nova:project>
Aug 09 06:48:45 user nova-compute[72809]:       </nova:owner>
Aug 09 06:48:45 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:48:45 user nova-compute[72809]:       <nova:ports>
Aug 09 06:48:45 user nova-compute[72809]:         <nova:port uuid="f12bff80-425f-42ba-804d-540ad751f70c">
Aug 09 06:48:45 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 06:48:45 user nova-compute[72809]:         </nova:port>
Aug 09 06:48:45 user nova-compute[72809]:       </nova:ports>
Aug 09 06:48:45 user nova-compute[72809]:     </nova:instance>
Aug 09 06:48:45 user nova-compute[72809]:   </metadata>
Aug 09 06:48:45 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:48:45 user nova-compute[72809]:     <system>
Aug 09 06:48:45 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:48:45 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:48:45 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:48:45 user nova-compute[72809]:       <entry name="serial">24ba9b41-d0bf-4a84-9f04-bfda9525b154</entry>
Aug 09 06:48:45 user nova-compute[72809]:       <entry name="uuid">24ba9b41-d0bf-4a84-9f04-bfda9525b154</entry>
Aug 09 06:48:45 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:48:45 user nova-compute[72809]:     </system>
Aug 09 06:48:45 user nova-compute[72809]:   </sysinfo>
Aug 09 06:48:45 user nova-compute[72809]:   <os>
Aug 09 06:48:45 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:48:45 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 06:48:45 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:48:45 user nova-compute[72809]:   </os>
Aug 09 06:48:45 user nova-compute[72809]:   <features>
Aug 09 06:48:45 user nova-compute[72809]:     <acpi/>
Aug 09 06:48:45 user nova-compute[72809]:     <apic/>
Aug 09 06:48:45 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:48:45 user nova-compute[72809]:   </features>
Aug 09 06:48:45 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:48:45 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:48:45 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:48:45 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:48:45 user nova-compute[72809]:   </clock>
Aug 09 06:48:45 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:48:45 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:48:45 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:48:45 user nova-compute[72809]:   </cpu>
Aug 09 06:48:45 user nova-compute[72809]:   <devices>
Aug 09 06:48:45 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:48:45 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:48:45 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk"/>
Aug 09 06:48:45 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:48:45 user nova-compute[72809]:     </disk>
Aug 09 06:48:45 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:48:45 user nova-compute[72809]:       <mac address="fa:16:3e:36:6c:27"/>
Aug 09 06:48:45 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:48:45 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:48:45 user nova-compute[72809]:       <target dev="tapf12bff80-42"/>
Aug 09 06:48:45 user nova-compute[72809]:     </interface>
Aug 09 06:48:45 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:48:45 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/console.log" append="off"/>
Aug 09 06:48:45 user nova-compute[72809]:     </serial>
Aug 09 06:48:45 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:48:45 user nova-compute[72809]:     <video>
Aug 09 06:48:45 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:48:45 user nova-compute[72809]:     </video>
Aug 09 06:48:45 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:48:45 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:48:45 user nova-compute[72809]:     </rng>
Aug 09 06:48:45 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:48:45 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:48:45 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:48:45 user nova-compute[72809]:     </memballoon>
Aug 09 06:48:45 user nova-compute[72809]:   </devices>
Aug 09 06:48:45 user nova-compute[72809]: </domain>
Aug 09 06:48:45 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:48:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-450574580',display_name='tempest-AttachVolumeTestJSON-server-450574580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-450574580',id=2,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDJ0cgVVGdxmBusvy2LpBlTCELREPHX0PiRGBl4xUaShS+GxBoB6howy4sQdzJp5xGl40sCcx5e/0j2dhekoUvRjUbaKjJ/gVIKho4UvqK2B4IB5h/y1k8THmm8SIXqLw==',key_name='tempest-keypair-1151798744',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55a7945f87914776a3f58bda58b7c90c',ramdisk_id='',reservation_id='r-0e3nfuh3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1328011883',owner_user_name='tempest-AttachVolumeTestJSON-1328011883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:48:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87785e8362a14385a951638f4d7cf817',uuid=24ba9b41-d0bf-4a84-9f04-bfda9525b154,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f12bff80-425f-42ba-804d-540ad751f70c", "address": "fa:16:3e:36:6c:27", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12bff80-42", "ovs_interfaceid": "f12bff80-425f-42ba-804d-540ad751f70c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Converting VIF {"id": "f12bff80-425f-42ba-804d-540ad751f70c", "address": "fa:16:3e:36:6c:27", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12bff80-42", "ovs_interfaceid": "f12bff80-425f-42ba-804d-540ad751f70c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:6c:27,bridge_name='br-int',has_traffic_filtering=True,id=f12bff80-425f-42ba-804d-540ad751f70c,network=Network(3430cb1f-9729-4613-bc8b-0fcdafd88198),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12bff80-42') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG os_vif [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:6c:27,bridge_name='br-int',has_traffic_filtering=True,id=f12bff80-425f-42ba-804d-540ad751f70c,network=Network(3430cb1f-9729-4613-bc8b-0fcdafd88198),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12bff80-42') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:48:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:48:46 user nova-compute[72809]: DEBUG nova.network.neutron [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Successfully updated port: 6efe1803-2ae3-490f-8791-c2ba35919f09 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:48:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquiring lock "refresh_cache-15dda080-3487-4316-ab7b-f7185f0a4519" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:48:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquired lock "refresh_cache-15dda080-3487-4316-ab7b-f7185f0a4519" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:48:46 user nova-compute[72809]: DEBUG nova.network.neutron [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:48:46 user sudo[82027]: pam_unix(sudo:session): session closed for user root
Aug 09 06:48:46 user nova-compute[72809]: INFO oslo.privsep.daemon [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Spawned new privsep daemon via rootwrap
Aug 09 06:48:46 user nova-compute[72809]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 09 06:48:46 user nova-compute[72809]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 09 06:48:46 user nova-compute[72809]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 09 06:48:46 user nova-compute[72809]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82086
Aug 09 06:48:46 user nova-compute[72809]: WARNING oslo_privsep.priv_context [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] privsep daemon already running
Aug 09 06:48:46 user nova-compute[72809]: DEBUG nova.network.neutron [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:48:46 user nova-compute[72809]: DEBUG nova.network.neutron [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Successfully updated port: 030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:48:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Acquiring lock "refresh_cache-3640991e-8a5b-4674-af81-3117d4269a68" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:48:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Acquired lock "refresh_cache-3640991e-8a5b-4674-af81-3117d4269a68" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:48:46 user nova-compute[72809]: DEBUG nova.network.neutron [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:48:46 user nova-compute[72809]: DEBUG nova.compute.manager [req-408a810e-d55c-4228-8e65-0f587cac154e req-0d410251-5679-472d-8e6f-dd6295c731e0 service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Received event network-changed-6efe1803-2ae3-490f-8791-c2ba35919f09 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:48:46 user nova-compute[72809]: DEBUG nova.compute.manager [req-408a810e-d55c-4228-8e65-0f587cac154e req-0d410251-5679-472d-8e6f-dd6295c731e0 service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Refreshing instance network info cache due to event network-changed-6efe1803-2ae3-490f-8791-c2ba35919f09. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:48:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-408a810e-d55c-4228-8e65-0f587cac154e req-0d410251-5679-472d-8e6f-dd6295c731e0 service nova] Acquiring lock "refresh_cache-15dda080-3487-4316-ab7b-f7185f0a4519" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:48:47 user nova-compute[72809]: DEBUG nova.network.neutron [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:48:47 user nova-compute[72809]: DEBUG nova.network.neutron [req-038c2165-3184-4e29-b6bd-3df3d38f5e4e req-16195543-135c-4930-8d5f-071ea8030082 service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Updated VIF entry in instance network info cache for port f12bff80-425f-42ba-804d-540ad751f70c. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:48:47 user nova-compute[72809]: DEBUG nova.network.neutron [req-038c2165-3184-4e29-b6bd-3df3d38f5e4e req-16195543-135c-4930-8d5f-071ea8030082 service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Updating instance_info_cache with network_info: [{"id": "f12bff80-425f-42ba-804d-540ad751f70c", "address": "fa:16:3e:36:6c:27", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12bff80-42", "ovs_interfaceid": "f12bff80-425f-42ba-804d-540ad751f70c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:48:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-038c2165-3184-4e29-b6bd-3df3d38f5e4e req-16195543-135c-4930-8d5f-071ea8030082 service nova] Releasing lock "refresh_cache-24ba9b41-d0bf-4a84-9f04-bfda9525b154" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:48:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3554b93c-4c, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:48:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3554b93c-4c, col_values=(('external_ids', {'iface-id': '3554b93c-4cee-4835-980f-413908f76f98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:c2:42', 'vm-uuid': 'f647a50e-ee90-480a-ad5d-68f1782628d9'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:48:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:48:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:47 user nova-compute[72809]: INFO os_vif [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:c2:42,bridge_name='br-int',has_traffic_filtering=True,id=3554b93c-4cee-4835-980f-413908f76f98,network=Network(c3574890-d7f0-44ba-8d4c-eb378ab1c691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3554b93c-4c')
Aug 09 06:48:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf12bff80-42, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:48:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf12bff80-42, col_values=(('external_ids', {'iface-id': 'f12bff80-425f-42ba-804d-540ad751f70c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:6c:27', 'vm-uuid': '24ba9b41-d0bf-4a84-9f04-bfda9525b154'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:48:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:48:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:47 user nova-compute[72809]: INFO os_vif [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:6c:27,bridge_name='br-int',has_traffic_filtering=True,id=f12bff80-425f-42ba-804d-540ad751f70c,network=Network(3430cb1f-9729-4613-bc8b-0fcdafd88198),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12bff80-42')
Aug 09 06:48:47 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:48:47 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] No VIF found with MAC fa:16:3e:d2:c2:42, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:48:47 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:48:47 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] No VIF found with MAC fa:16:3e:36:6c:27, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:48:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.network.neutron [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Updating instance_info_cache with network_info: [{"id": "6efe1803-2ae3-490f-8791-c2ba35919f09", "address": "fa:16:3e:a7:75:9f", "network": {"id": "aae92e96-18c4-419a-b1b0-5ab55d8f26c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1926005183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52fb0421f625467a8205b8000a6dcee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efe1803-2a", "ovs_interfaceid": "6efe1803-2ae3-490f-8791-c2ba35919f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Releasing lock "refresh_cache-15dda080-3487-4316-ab7b-f7185f0a4519" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.compute.manager [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Instance network_info: |[{"id": "6efe1803-2ae3-490f-8791-c2ba35919f09", "address": "fa:16:3e:a7:75:9f", "network": {"id": "aae92e96-18c4-419a-b1b0-5ab55d8f26c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1926005183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52fb0421f625467a8205b8000a6dcee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efe1803-2a", "ovs_interfaceid": "6efe1803-2ae3-490f-8791-c2ba35919f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-408a810e-d55c-4228-8e65-0f587cac154e req-0d410251-5679-472d-8e6f-dd6295c731e0 service nova] Acquired lock "refresh_cache-15dda080-3487-4316-ab7b-f7185f0a4519" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.network.neutron [req-408a810e-d55c-4228-8e65-0f587cac154e req-0d410251-5679-472d-8e6f-dd6295c731e0 service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Refreshing network info cache for port 6efe1803-2ae3-490f-8791-c2ba35919f09 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Start _get_guest_xml network_info=[{"id": "6efe1803-2ae3-490f-8791-c2ba35919f09", "address": "fa:16:3e:a7:75:9f", "network": {"id": "aae92e96-18c4-419a-b1b0-5ab55d8f26c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1926005183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52fb0421f625467a8205b8000a6dcee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efe1803-2a", "ovs_interfaceid": "6efe1803-2ae3-490f-8791-c2ba35919f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:48:48 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:48:48 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:48:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1848436274',display_name='tempest-ServerActionsTestOtherB-server-1848436274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1848436274',id=4,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzddBZQV6rBoKhUSr/KZYr11ADyq1HDaJHBbKwm5pCectYOG8Y/A3xcUayq6O8xK7rSLI08X+2Hg8J2DtxIR/GKq1CHmG5GQromz7rdkcwdeRGHWTQ/2HdiKGS29Oa5Sg==',key_name='tempest-keypair-830185710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52fb0421f625467a8205b8000a6dcee5',ramdisk_id='',reservation_id='r-iw1w1c5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1112762044',owner_user_name='tempest-ServerActionsTestOtherB-1112762044-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:48:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0347074764734e2a8ca3f580efcb1272',uuid=15dda080-3487-4316-ab7b-f7185f0a4519,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6efe1803-2ae3-490f-8791-c2ba35919f09", "address": "fa:16:3e:a7:75:9f", "network": {"id": "aae92e96-18c4-419a-b1b0-5ab55d8f26c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1926005183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52fb0421f625467a8205b8000a6dcee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efe1803-2a", "ovs_interfaceid": "6efe1803-2ae3-490f-8791-c2ba35919f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Converting VIF {"id": "6efe1803-2ae3-490f-8791-c2ba35919f09", "address": "fa:16:3e:a7:75:9f", "network": {"id": "aae92e96-18c4-419a-b1b0-5ab55d8f26c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1926005183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52fb0421f625467a8205b8000a6dcee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efe1803-2a", "ovs_interfaceid": "6efe1803-2ae3-490f-8791-c2ba35919f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:75:9f,bridge_name='br-int',has_traffic_filtering=True,id=6efe1803-2ae3-490f-8791-c2ba35919f09,network=Network(aae92e96-18c4-419a-b1b0-5ab55d8f26c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efe1803-2a') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.objects.instance [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lazy-loading 'pci_devices' on Instance uuid 15dda080-3487-4316-ab7b-f7185f0a4519 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.network.neutron [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Updating instance_info_cache with network_info: [{"id": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "address": "fa:16:3e:70:a1:b1", "network": {"id": "d6503417-7fd7-487b-8474-f23e4cc77845", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1134767045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04f60d3bd9a41fc930f728a74371a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030dd6f3-f7", "ovs_interfaceid": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:48:48 user nova-compute[72809]:   <uuid>15dda080-3487-4316-ab7b-f7185f0a4519</uuid>
Aug 09 06:48:48 user nova-compute[72809]:   <name>instance-00000004</name>
Aug 09 06:48:48 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:48:48 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:48:48 user nova-compute[72809]:   <metadata>
Aug 09 06:48:48 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:48:48 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:48:48 user nova-compute[72809]:       <nova:name>tempest-ServerActionsTestOtherB-server-1848436274</nova:name>
Aug 09 06:48:48 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:48:48</nova:creationTime>
Aug 09 06:48:48 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:48:48 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:48:48 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:48:48 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:48:48 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:48:48 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:48:48 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:48:48 user nova-compute[72809]:       <nova:owner>
Aug 09 06:48:48 user nova-compute[72809]:         <nova:user uuid="0347074764734e2a8ca3f580efcb1272">tempest-ServerActionsTestOtherB-1112762044-project-member</nova:user>
Aug 09 06:48:48 user nova-compute[72809]:         <nova:project uuid="52fb0421f625467a8205b8000a6dcee5">tempest-ServerActionsTestOtherB-1112762044</nova:project>
Aug 09 06:48:48 user nova-compute[72809]:       </nova:owner>
Aug 09 06:48:48 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:48:48 user nova-compute[72809]:       <nova:ports>
Aug 09 06:48:48 user nova-compute[72809]:         <nova:port uuid="6efe1803-2ae3-490f-8791-c2ba35919f09">
Aug 09 06:48:48 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 06:48:48 user nova-compute[72809]:         </nova:port>
Aug 09 06:48:48 user nova-compute[72809]:       </nova:ports>
Aug 09 06:48:48 user nova-compute[72809]:     </nova:instance>
Aug 09 06:48:48 user nova-compute[72809]:   </metadata>
Aug 09 06:48:48 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:48:48 user nova-compute[72809]:     <system>
Aug 09 06:48:48 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:48:48 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:48:48 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:48:48 user nova-compute[72809]:       <entry name="serial">15dda080-3487-4316-ab7b-f7185f0a4519</entry>
Aug 09 06:48:48 user nova-compute[72809]:       <entry name="uuid">15dda080-3487-4316-ab7b-f7185f0a4519</entry>
Aug 09 06:48:48 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:48:48 user nova-compute[72809]:     </system>
Aug 09 06:48:48 user nova-compute[72809]:   </sysinfo>
Aug 09 06:48:48 user nova-compute[72809]:   <os>
Aug 09 06:48:48 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:48:48 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 06:48:48 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:48:48 user nova-compute[72809]:   </os>
Aug 09 06:48:48 user nova-compute[72809]:   <features>
Aug 09 06:48:48 user nova-compute[72809]:     <acpi/>
Aug 09 06:48:48 user nova-compute[72809]:     <apic/>
Aug 09 06:48:48 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:48:48 user nova-compute[72809]:   </features>
Aug 09 06:48:48 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:48:48 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:48:48 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:48:48 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:48:48 user nova-compute[72809]:   </clock>
Aug 09 06:48:48 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:48:48 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:48:48 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:48:48 user nova-compute[72809]:   </cpu>
Aug 09 06:48:48 user nova-compute[72809]:   <devices>
Aug 09 06:48:48 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:48:48 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:48:48 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk"/>
Aug 09 06:48:48 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:48:48 user nova-compute[72809]:     </disk>
Aug 09 06:48:48 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:48:48 user nova-compute[72809]:       <mac address="fa:16:3e:a7:75:9f"/>
Aug 09 06:48:48 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:48:48 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:48:48 user nova-compute[72809]:       <target dev="tap6efe1803-2a"/>
Aug 09 06:48:48 user nova-compute[72809]:     </interface>
Aug 09 06:48:48 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:48:48 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/console.log" append="off"/>
Aug 09 06:48:48 user nova-compute[72809]:     </serial>
Aug 09 06:48:48 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:48:48 user nova-compute[72809]:     <video>
Aug 09 06:48:48 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:48:48 user nova-compute[72809]:     </video>
Aug 09 06:48:48 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:48:48 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:48:48 user nova-compute[72809]:     </rng>
Aug 09 06:48:48 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:48:48 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:48:48 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:48:48 user nova-compute[72809]:     </memballoon>
Aug 09 06:48:48 user nova-compute[72809]:   </devices>
Aug 09 06:48:48 user nova-compute[72809]: </domain>
Aug 09 06:48:48 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:48:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1848436274',display_name='tempest-ServerActionsTestOtherB-server-1848436274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1848436274',id=4,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzddBZQV6rBoKhUSr/KZYr11ADyq1HDaJHBbKwm5pCectYOG8Y/A3xcUayq6O8xK7rSLI08X+2Hg8J2DtxIR/GKq1CHmG5GQromz7rdkcwdeRGHWTQ/2HdiKGS29Oa5Sg==',key_name='tempest-keypair-830185710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52fb0421f625467a8205b8000a6dcee5',ramdisk_id='',reservation_id='r-iw1w1c5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1112762044',owner_user_name='tempest-ServerActionsTestOtherB-1112762044-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:48:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0347074764734e2a8ca3f580efcb1272',uuid=15dda080-3487-4316-ab7b-f7185f0a4519,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6efe1803-2ae3-490f-8791-c2ba35919f09", "address": "fa:16:3e:a7:75:9f", "network": {"id": "aae92e96-18c4-419a-b1b0-5ab55d8f26c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1926005183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52fb0421f625467a8205b8000a6dcee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efe1803-2a", "ovs_interfaceid": "6efe1803-2ae3-490f-8791-c2ba35919f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Converting VIF {"id": "6efe1803-2ae3-490f-8791-c2ba35919f09", "address": "fa:16:3e:a7:75:9f", "network": {"id": "aae92e96-18c4-419a-b1b0-5ab55d8f26c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1926005183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52fb0421f625467a8205b8000a6dcee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efe1803-2a", "ovs_interfaceid": "6efe1803-2ae3-490f-8791-c2ba35919f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:75:9f,bridge_name='br-int',has_traffic_filtering=True,id=6efe1803-2ae3-490f-8791-c2ba35919f09,network=Network(aae92e96-18c4-419a-b1b0-5ab55d8f26c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efe1803-2a') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG os_vif [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:75:9f,bridge_name='br-int',has_traffic_filtering=True,id=6efe1803-2ae3-490f-8791-c2ba35919f09,network=Network(aae92e96-18c4-419a-b1b0-5ab55d8f26c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efe1803-2a') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Releasing lock "refresh_cache-3640991e-8a5b-4674-af81-3117d4269a68" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.compute.manager [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Instance network_info: |[{"id": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "address": "fa:16:3e:70:a1:b1", "network": {"id": "d6503417-7fd7-487b-8474-f23e4cc77845", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1134767045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04f60d3bd9a41fc930f728a74371a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030dd6f3-f7", "ovs_interfaceid": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Start _get_guest_xml network_info=[{"id": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "address": "fa:16:3e:70:a1:b1", "network": {"id": "d6503417-7fd7-487b-8474-f23e4cc77845", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1134767045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04f60d3bd9a41fc930f728a74371a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030dd6f3-f7", "ovs_interfaceid": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6efe1803-2a, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6efe1803-2a, col_values=(('external_ids', {'iface-id': '6efe1803-2ae3-490f-8791-c2ba35919f09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:75:9f', 'vm-uuid': '15dda080-3487-4316-ab7b-f7185f0a4519'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:48:48 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:48:48 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:48:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-995514485',display_name='tempest-ServerStableDeviceRescueTest-server-995514485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-995514485',id=3,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNIAOBtUHLY5RLLblzf2H9UgwHfkxVSsn0KqwvIq1wE2eV6oO4rG/G1/BgLg8+rUoZsnFfXiYTDv+fYrNnTfaCu6vpj0/PnCJDru2o8rKGymDnbKqG9XIaRxyfKqJHb7Q==',key_name='tempest-keypair-1989347577',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c04f60d3bd9a41fc930f728a74371a2c',ramdisk_id='',reservation_id='r-w3f3gjq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1178370555',owner_user_name='tempest-ServerStableDeviceRescueTest-1178370555-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:48:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98a58716cb5f4c86952ef9e1f555e6a7',uuid=3640991e-8a5b-4674-af81-3117d4269a68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "address": "fa:16:3e:70:a1:b1", "network": {"id": "d6503417-7fd7-487b-8474-f23e4cc77845", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1134767045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04f60d3bd9a41fc930f728a74371a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030dd6f3-f7", "ovs_interfaceid": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Converting VIF {"id": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "address": "fa:16:3e:70:a1:b1", "network": {"id": "d6503417-7fd7-487b-8474-f23e4cc77845", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1134767045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04f60d3bd9a41fc930f728a74371a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030dd6f3-f7", "ovs_interfaceid": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:a1:b1,bridge_name='br-int',has_traffic_filtering=True,id=030dd6f3-f758-4b5a-b9fb-be3c64cb9341,network=Network(d6503417-7fd7-487b-8474-f23e4cc77845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030dd6f3-f7') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.objects.instance [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lazy-loading 'pci_devices' on Instance uuid 3640991e-8a5b-4674-af81-3117d4269a68 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:48 user nova-compute[72809]: INFO os_vif [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:75:9f,bridge_name='br-int',has_traffic_filtering=True,id=6efe1803-2ae3-490f-8791-c2ba35919f09,network=Network(aae92e96-18c4-419a-b1b0-5ab55d8f26c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efe1803-2a')
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:48:48 user nova-compute[72809]:   <uuid>3640991e-8a5b-4674-af81-3117d4269a68</uuid>
Aug 09 06:48:48 user nova-compute[72809]:   <name>instance-00000003</name>
Aug 09 06:48:48 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:48:48 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:48:48 user nova-compute[72809]:   <metadata>
Aug 09 06:48:48 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:48:48 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:48:48 user nova-compute[72809]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-995514485</nova:name>
Aug 09 06:48:48 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:48:48</nova:creationTime>
Aug 09 06:48:48 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:48:48 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:48:48 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:48:48 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:48:48 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:48:48 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:48:48 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:48:48 user nova-compute[72809]:       <nova:owner>
Aug 09 06:48:48 user nova-compute[72809]:         <nova:user uuid="98a58716cb5f4c86952ef9e1f555e6a7">tempest-ServerStableDeviceRescueTest-1178370555-project-member</nova:user>
Aug 09 06:48:48 user nova-compute[72809]:         <nova:project uuid="c04f60d3bd9a41fc930f728a74371a2c">tempest-ServerStableDeviceRescueTest-1178370555</nova:project>
Aug 09 06:48:48 user nova-compute[72809]:       </nova:owner>
Aug 09 06:48:48 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:48:48 user nova-compute[72809]:       <nova:ports>
Aug 09 06:48:48 user nova-compute[72809]:         <nova:port uuid="030dd6f3-f758-4b5a-b9fb-be3c64cb9341">
Aug 09 06:48:48 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 06:48:48 user nova-compute[72809]:         </nova:port>
Aug 09 06:48:48 user nova-compute[72809]:       </nova:ports>
Aug 09 06:48:48 user nova-compute[72809]:     </nova:instance>
Aug 09 06:48:48 user nova-compute[72809]:   </metadata>
Aug 09 06:48:48 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:48:48 user nova-compute[72809]:     <system>
Aug 09 06:48:48 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:48:48 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:48:48 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:48:48 user nova-compute[72809]:       <entry name="serial">3640991e-8a5b-4674-af81-3117d4269a68</entry>
Aug 09 06:48:48 user nova-compute[72809]:       <entry name="uuid">3640991e-8a5b-4674-af81-3117d4269a68</entry>
Aug 09 06:48:48 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:48:48 user nova-compute[72809]:     </system>
Aug 09 06:48:48 user nova-compute[72809]:   </sysinfo>
Aug 09 06:48:48 user nova-compute[72809]:   <os>
Aug 09 06:48:48 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:48:48 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 06:48:48 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:48:48 user nova-compute[72809]:   </os>
Aug 09 06:48:48 user nova-compute[72809]:   <features>
Aug 09 06:48:48 user nova-compute[72809]:     <acpi/>
Aug 09 06:48:48 user nova-compute[72809]:     <apic/>
Aug 09 06:48:48 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:48:48 user nova-compute[72809]:   </features>
Aug 09 06:48:48 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:48:48 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:48:48 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:48:48 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:48:48 user nova-compute[72809]:   </clock>
Aug 09 06:48:48 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:48:48 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:48:48 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:48:48 user nova-compute[72809]:   </cpu>
Aug 09 06:48:48 user nova-compute[72809]:   <devices>
Aug 09 06:48:48 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:48:48 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:48:48 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk"/>
Aug 09 06:48:48 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:48:48 user nova-compute[72809]:     </disk>
Aug 09 06:48:48 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:48:48 user nova-compute[72809]:       <mac address="fa:16:3e:70:a1:b1"/>
Aug 09 06:48:48 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:48:48 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:48:48 user nova-compute[72809]:       <target dev="tap030dd6f3-f7"/>
Aug 09 06:48:48 user nova-compute[72809]:     </interface>
Aug 09 06:48:48 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:48:48 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/console.log" append="off"/>
Aug 09 06:48:48 user nova-compute[72809]:     </serial>
Aug 09 06:48:48 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:48:48 user nova-compute[72809]:     <video>
Aug 09 06:48:48 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:48:48 user nova-compute[72809]:     </video>
Aug 09 06:48:48 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:48:48 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:48:48 user nova-compute[72809]:     </rng>
Aug 09 06:48:48 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:48:48 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:48:48 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:48:48 user nova-compute[72809]:     </memballoon>
Aug 09 06:48:48 user nova-compute[72809]:   </devices>
Aug 09 06:48:48 user nova-compute[72809]: </domain>
Aug 09 06:48:48 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:48:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-995514485',display_name='tempest-ServerStableDeviceRescueTest-server-995514485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-995514485',id=3,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNIAOBtUHLY5RLLblzf2H9UgwHfkxVSsn0KqwvIq1wE2eV6oO4rG/G1/BgLg8+rUoZsnFfXiYTDv+fYrNnTfaCu6vpj0/PnCJDru2o8rKGymDnbKqG9XIaRxyfKqJHb7Q==',key_name='tempest-keypair-1989347577',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c04f60d3bd9a41fc930f728a74371a2c',ramdisk_id='',reservation_id='r-w3f3gjq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1178370555',owner_user_name='tempest-ServerStableDeviceRescueTest-1178370555-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:48:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98a58716cb5f4c86952ef9e1f555e6a7',uuid=3640991e-8a5b-4674-af81-3117d4269a68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "address": "fa:16:3e:70:a1:b1", "network": {"id": "d6503417-7fd7-487b-8474-f23e4cc77845", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1134767045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04f60d3bd9a41fc930f728a74371a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030dd6f3-f7", "ovs_interfaceid": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Converting VIF {"id": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "address": "fa:16:3e:70:a1:b1", "network": {"id": "d6503417-7fd7-487b-8474-f23e4cc77845", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1134767045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04f60d3bd9a41fc930f728a74371a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030dd6f3-f7", "ovs_interfaceid": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:a1:b1,bridge_name='br-int',has_traffic_filtering=True,id=030dd6f3-f758-4b5a-b9fb-be3c64cb9341,network=Network(d6503417-7fd7-487b-8474-f23e4cc77845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030dd6f3-f7') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG os_vif [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:a1:b1,bridge_name='br-int',has_traffic_filtering=True,id=030dd6f3-f758-4b5a-b9fb-be3c64cb9341,network=Network(d6503417-7fd7-487b-8474-f23e4cc77845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030dd6f3-f7') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap030dd6f3-f7, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap030dd6f3-f7, col_values=(('external_ids', {'iface-id': '030dd6f3-f758-4b5a-b9fb-be3c64cb9341', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:a1:b1', 'vm-uuid': '3640991e-8a5b-4674-af81-3117d4269a68'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:48 user nova-compute[72809]: INFO os_vif [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:a1:b1,bridge_name='br-int',has_traffic_filtering=True,id=030dd6f3-f758-4b5a-b9fb-be3c64cb9341,network=Network(d6503417-7fd7-487b-8474-f23e4cc77845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030dd6f3-f7')
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] No VIF found with MAC fa:16:3e:a7:75:9f, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:48:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] No VIF found with MAC fa:16:3e:70:a1:b1, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:48:49 user nova-compute[72809]: DEBUG nova.compute.manager [req-0b72469b-4612-4f9b-b1e7-56511bae9318 req-4764a430-c4f5-4b3a-8d4f-2649ce5e621c service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received event network-changed-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:48:49 user nova-compute[72809]: DEBUG nova.compute.manager [req-0b72469b-4612-4f9b-b1e7-56511bae9318 req-4764a430-c4f5-4b3a-8d4f-2649ce5e621c service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Refreshing instance network info cache due to event network-changed-030dd6f3-f758-4b5a-b9fb-be3c64cb9341. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:48:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0b72469b-4612-4f9b-b1e7-56511bae9318 req-4764a430-c4f5-4b3a-8d4f-2649ce5e621c service nova] Acquiring lock "refresh_cache-3640991e-8a5b-4674-af81-3117d4269a68" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:48:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0b72469b-4612-4f9b-b1e7-56511bae9318 req-4764a430-c4f5-4b3a-8d4f-2649ce5e621c service nova] Acquired lock "refresh_cache-3640991e-8a5b-4674-af81-3117d4269a68" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:48:49 user nova-compute[72809]: DEBUG nova.network.neutron [req-0b72469b-4612-4f9b-b1e7-56511bae9318 req-4764a430-c4f5-4b3a-8d4f-2649ce5e621c service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Refreshing network info cache for port 030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:48:49 user nova-compute[72809]: DEBUG nova.network.neutron [req-408a810e-d55c-4228-8e65-0f587cac154e req-0d410251-5679-472d-8e6f-dd6295c731e0 service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Updated VIF entry in instance network info cache for port 6efe1803-2ae3-490f-8791-c2ba35919f09. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:48:49 user nova-compute[72809]: DEBUG nova.network.neutron [req-408a810e-d55c-4228-8e65-0f587cac154e req-0d410251-5679-472d-8e6f-dd6295c731e0 service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Updating instance_info_cache with network_info: [{"id": "6efe1803-2ae3-490f-8791-c2ba35919f09", "address": "fa:16:3e:a7:75:9f", "network": {"id": "aae92e96-18c4-419a-b1b0-5ab55d8f26c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1926005183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52fb0421f625467a8205b8000a6dcee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efe1803-2a", "ovs_interfaceid": "6efe1803-2ae3-490f-8791-c2ba35919f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:48:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-408a810e-d55c-4228-8e65-0f587cac154e req-0d410251-5679-472d-8e6f-dd6295c731e0 service nova] Releasing lock "refresh_cache-15dda080-3487-4316-ab7b-f7185f0a4519" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:48:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:50 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:50 user nova-compute[72809]: DEBUG nova.network.neutron [req-0b72469b-4612-4f9b-b1e7-56511bae9318 req-4764a430-c4f5-4b3a-8d4f-2649ce5e621c service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Updated VIF entry in instance network info cache for port 030dd6f3-f758-4b5a-b9fb-be3c64cb9341. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:48:50 user nova-compute[72809]: DEBUG nova.network.neutron [req-0b72469b-4612-4f9b-b1e7-56511bae9318 req-4764a430-c4f5-4b3a-8d4f-2649ce5e621c service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Updating instance_info_cache with network_info: [{"id": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "address": "fa:16:3e:70:a1:b1", "network": {"id": "d6503417-7fd7-487b-8474-f23e4cc77845", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1134767045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04f60d3bd9a41fc930f728a74371a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030dd6f3-f7", "ovs_interfaceid": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:48:50 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0b72469b-4612-4f9b-b1e7-56511bae9318 req-4764a430-c4f5-4b3a-8d4f-2649ce5e621c service nova] Releasing lock "refresh_cache-3640991e-8a5b-4674-af81-3117d4269a68" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:48:50 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:52 user nova-compute[72809]: DEBUG nova.compute.manager [req-3191c1fe-f200-4d91-aa65-f09a9c1dbf93 req-7c680665-57a0-4d4c-8c8e-01b9a884ddf2 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received event network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:48:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3191c1fe-f200-4d91-aa65-f09a9c1dbf93 req-7c680665-57a0-4d4c-8c8e-01b9a884ddf2 service nova] Acquiring lock "3640991e-8a5b-4674-af81-3117d4269a68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3191c1fe-f200-4d91-aa65-f09a9c1dbf93 req-7c680665-57a0-4d4c-8c8e-01b9a884ddf2 service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3191c1fe-f200-4d91-aa65-f09a9c1dbf93 req-7c680665-57a0-4d4c-8c8e-01b9a884ddf2 service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:52 user nova-compute[72809]: DEBUG nova.compute.manager [req-3191c1fe-f200-4d91-aa65-f09a9c1dbf93 req-7c680665-57a0-4d4c-8c8e-01b9a884ddf2 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] No waiting events found dispatching network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:48:52 user nova-compute[72809]: WARNING nova.compute.manager [req-3191c1fe-f200-4d91-aa65-f09a9c1dbf93 req-7c680665-57a0-4d4c-8c8e-01b9a884ddf2 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received unexpected event network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 for instance with vm_state building and task_state spawning.
Aug 09 06:48:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:53 user nova-compute[72809]: DEBUG nova.compute.manager [req-3a5a45e7-bfb2-44c2-8350-7b9798ce9279 req-055f77ee-15fb-4cac-b38a-e7eaca9b58b7 service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Received event network-vif-plugged-6efe1803-2ae3-490f-8791-c2ba35919f09 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:48:53 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3a5a45e7-bfb2-44c2-8350-7b9798ce9279 req-055f77ee-15fb-4cac-b38a-e7eaca9b58b7 service nova] Acquiring lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:53 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3a5a45e7-bfb2-44c2-8350-7b9798ce9279 req-055f77ee-15fb-4cac-b38a-e7eaca9b58b7 service nova] Lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:53 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3a5a45e7-bfb2-44c2-8350-7b9798ce9279 req-055f77ee-15fb-4cac-b38a-e7eaca9b58b7 service nova] Lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:53 user nova-compute[72809]: DEBUG nova.compute.manager [req-3a5a45e7-bfb2-44c2-8350-7b9798ce9279 req-055f77ee-15fb-4cac-b38a-e7eaca9b58b7 service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] No waiting events found dispatching network-vif-plugged-6efe1803-2ae3-490f-8791-c2ba35919f09 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:48:53 user nova-compute[72809]: WARNING nova.compute.manager [req-3a5a45e7-bfb2-44c2-8350-7b9798ce9279 req-055f77ee-15fb-4cac-b38a-e7eaca9b58b7 service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Received unexpected event network-vif-plugged-6efe1803-2ae3-490f-8791-c2ba35919f09 for instance with vm_state building and task_state spawning.
Aug 09 06:48:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:54 user nova-compute[72809]: DEBUG nova.compute.manager [req-76757ed5-f9db-43a4-a271-6bc8d8cde60c req-385f2c7a-c9e3-43a0-95ee-6d158a4d313f service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received event network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:48:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-76757ed5-f9db-43a4-a271-6bc8d8cde60c req-385f2c7a-c9e3-43a0-95ee-6d158a4d313f service nova] Acquiring lock "3640991e-8a5b-4674-af81-3117d4269a68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-76757ed5-f9db-43a4-a271-6bc8d8cde60c req-385f2c7a-c9e3-43a0-95ee-6d158a4d313f service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-76757ed5-f9db-43a4-a271-6bc8d8cde60c req-385f2c7a-c9e3-43a0-95ee-6d158a4d313f service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:54 user nova-compute[72809]: DEBUG nova.compute.manager [req-76757ed5-f9db-43a4-a271-6bc8d8cde60c req-385f2c7a-c9e3-43a0-95ee-6d158a4d313f service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] No waiting events found dispatching network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:48:54 user nova-compute[72809]: WARNING nova.compute.manager [req-76757ed5-f9db-43a4-a271-6bc8d8cde60c req-385f2c7a-c9e3-43a0-95ee-6d158a4d313f service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received unexpected event network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 for instance with vm_state building and task_state spawning.
Aug 09 06:48:54 user nova-compute[72809]: DEBUG nova.compute.manager [req-76757ed5-f9db-43a4-a271-6bc8d8cde60c req-385f2c7a-c9e3-43a0-95ee-6d158a4d313f service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Received event network-vif-plugged-f12bff80-425f-42ba-804d-540ad751f70c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:48:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-76757ed5-f9db-43a4-a271-6bc8d8cde60c req-385f2c7a-c9e3-43a0-95ee-6d158a4d313f service nova] Acquiring lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-76757ed5-f9db-43a4-a271-6bc8d8cde60c req-385f2c7a-c9e3-43a0-95ee-6d158a4d313f service nova] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-76757ed5-f9db-43a4-a271-6bc8d8cde60c req-385f2c7a-c9e3-43a0-95ee-6d158a4d313f service nova] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:54 user nova-compute[72809]: DEBUG nova.compute.manager [req-76757ed5-f9db-43a4-a271-6bc8d8cde60c req-385f2c7a-c9e3-43a0-95ee-6d158a4d313f service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] No waiting events found dispatching network-vif-plugged-f12bff80-425f-42ba-804d-540ad751f70c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:48:54 user nova-compute[72809]: WARNING nova.compute.manager [req-76757ed5-f9db-43a4-a271-6bc8d8cde60c req-385f2c7a-c9e3-43a0-95ee-6d158a4d313f service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Received unexpected event network-vif-plugged-f12bff80-425f-42ba-804d-540ad751f70c for instance with vm_state building and task_state spawning.
Aug 09 06:48:54 user nova-compute[72809]: DEBUG nova.compute.manager [req-76757ed5-f9db-43a4-a271-6bc8d8cde60c req-385f2c7a-c9e3-43a0-95ee-6d158a4d313f service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Received event network-vif-plugged-f12bff80-425f-42ba-804d-540ad751f70c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:48:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-76757ed5-f9db-43a4-a271-6bc8d8cde60c req-385f2c7a-c9e3-43a0-95ee-6d158a4d313f service nova] Acquiring lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-76757ed5-f9db-43a4-a271-6bc8d8cde60c req-385f2c7a-c9e3-43a0-95ee-6d158a4d313f service nova] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-76757ed5-f9db-43a4-a271-6bc8d8cde60c req-385f2c7a-c9e3-43a0-95ee-6d158a4d313f service nova] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:54 user nova-compute[72809]: DEBUG nova.compute.manager [req-76757ed5-f9db-43a4-a271-6bc8d8cde60c req-385f2c7a-c9e3-43a0-95ee-6d158a4d313f service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] No waiting events found dispatching network-vif-plugged-f12bff80-425f-42ba-804d-540ad751f70c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:48:54 user nova-compute[72809]: WARNING nova.compute.manager [req-76757ed5-f9db-43a4-a271-6bc8d8cde60c req-385f2c7a-c9e3-43a0-95ee-6d158a4d313f service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Received unexpected event network-vif-plugged-f12bff80-425f-42ba-804d-540ad751f70c for instance with vm_state building and task_state spawning.
Aug 09 06:48:54 user nova-compute[72809]: DEBUG nova.compute.manager [req-234b897b-94d0-4af3-b3d4-c18e9abf49fe req-97ceb3d0-1290-47f6-9e17-39591977ffcf service nova] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Received event network-vif-plugged-3554b93c-4cee-4835-980f-413908f76f98 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:48:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-234b897b-94d0-4af3-b3d4-c18e9abf49fe req-97ceb3d0-1290-47f6-9e17-39591977ffcf service nova] Acquiring lock "f647a50e-ee90-480a-ad5d-68f1782628d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-234b897b-94d0-4af3-b3d4-c18e9abf49fe req-97ceb3d0-1290-47f6-9e17-39591977ffcf service nova] Lock "f647a50e-ee90-480a-ad5d-68f1782628d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-234b897b-94d0-4af3-b3d4-c18e9abf49fe req-97ceb3d0-1290-47f6-9e17-39591977ffcf service nova] Lock "f647a50e-ee90-480a-ad5d-68f1782628d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:54 user nova-compute[72809]: DEBUG nova.compute.manager [req-234b897b-94d0-4af3-b3d4-c18e9abf49fe req-97ceb3d0-1290-47f6-9e17-39591977ffcf service nova] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] No waiting events found dispatching network-vif-plugged-3554b93c-4cee-4835-980f-413908f76f98 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:48:54 user nova-compute[72809]: WARNING nova.compute.manager [req-234b897b-94d0-4af3-b3d4-c18e9abf49fe req-97ceb3d0-1290-47f6-9e17-39591977ffcf service nova] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Received unexpected event network-vif-plugged-3554b93c-4cee-4835-980f-413908f76f98 for instance with vm_state building and task_state spawning.
Aug 09 06:48:55 user nova-compute[72809]: DEBUG nova.compute.manager [req-5438923d-35d0-44d6-9f8c-68d12376b879 req-5f6887ed-7b31-4c29-81b6-ce6616df5664 service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Received event network-vif-plugged-6efe1803-2ae3-490f-8791-c2ba35919f09 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:48:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5438923d-35d0-44d6-9f8c-68d12376b879 req-5f6887ed-7b31-4c29-81b6-ce6616df5664 service nova] Acquiring lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5438923d-35d0-44d6-9f8c-68d12376b879 req-5f6887ed-7b31-4c29-81b6-ce6616df5664 service nova] Lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5438923d-35d0-44d6-9f8c-68d12376b879 req-5f6887ed-7b31-4c29-81b6-ce6616df5664 service nova] Lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:55 user nova-compute[72809]: DEBUG nova.compute.manager [req-5438923d-35d0-44d6-9f8c-68d12376b879 req-5f6887ed-7b31-4c29-81b6-ce6616df5664 service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] No waiting events found dispatching network-vif-plugged-6efe1803-2ae3-490f-8791-c2ba35919f09 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:48:55 user nova-compute[72809]: WARNING nova.compute.manager [req-5438923d-35d0-44d6-9f8c-68d12376b879 req-5f6887ed-7b31-4c29-81b6-ce6616df5664 service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Received unexpected event network-vif-plugged-6efe1803-2ae3-490f-8791-c2ba35919f09 for instance with vm_state building and task_state spawning.
Aug 09 06:48:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Acquiring lock "b9b69c9e-f91d-4681-a53b-2f0fc4b13532" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Lock "b9b69c9e-f91d-4681-a53b-2f0fc4b13532" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:55 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 06:48:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:55 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 06:48:55 user nova-compute[72809]: INFO nova.compute.claims [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Claim successful on node user
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563736.4277034, 3640991e-8a5b-4674-af81-3117d4269a68 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:48:56 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] VM Resumed (Lifecycle Event)
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.compute.manager [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 06:48:56 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Instance spawned successfully.
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.631s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.compute.manager [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 06:48:56 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Instance spawned successfully.
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.compute.manager [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:48:56 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Instance spawned successfully.
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:48:56 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563736.4313233, 3640991e-8a5b-4674-af81-3117d4269a68 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:48:56 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] VM Started (Lifecycle Event)
Aug 09 06:48:56 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.compute.manager [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 06:48:56 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563736.4818466, 24ba9b41-d0bf-4a84-9f04-bfda9525b154 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:48:56 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] VM Resumed (Lifecycle Event)
Aug 09 06:48:56 user nova-compute[72809]: INFO nova.compute.manager [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Took 17.30 seconds to spawn the instance on the hypervisor.
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.compute.manager [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:48:56 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Instance spawned successfully.
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:48:56 user nova-compute[72809]: INFO nova.compute.manager [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Took 18.78 seconds to build instance.
Aug 09 06:48:56 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:48:57 user nova-compute[72809]: INFO nova.compute.manager [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Took 18.96 seconds to spawn the instance on the hypervisor.
Aug 09 06:48:57 user nova-compute[72809]: DEBUG nova.compute.manager [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:48:57 user nova-compute[72809]: INFO nova.compute.manager [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Took 19.96 seconds to spawn the instance on the hypervisor.
Aug 09 06:48:57 user nova-compute[72809]: DEBUG nova.compute.manager [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:48:57 user nova-compute[72809]: DEBUG nova.policy [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '692e6ee8bb5145359c5551c151451a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd7ca02c3254d4b8e5fb9ddf3ec82bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 06:48:57 user nova-compute[72809]: DEBUG nova.compute.manager [req-6dbc8d88-479e-4280-8cb4-07400c1143b0 req-1f8271d3-6657-43af-8ec4-8e651759e351 service nova] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Received event network-vif-plugged-3554b93c-4cee-4835-980f-413908f76f98 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:48:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6dbc8d88-479e-4280-8cb4-07400c1143b0 req-1f8271d3-6657-43af-8ec4-8e651759e351 service nova] Acquiring lock "f647a50e-ee90-480a-ad5d-68f1782628d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6dbc8d88-479e-4280-8cb4-07400c1143b0 req-1f8271d3-6657-43af-8ec4-8e651759e351 service nova] Lock "f647a50e-ee90-480a-ad5d-68f1782628d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6dbc8d88-479e-4280-8cb4-07400c1143b0 req-1f8271d3-6657-43af-8ec4-8e651759e351 service nova] Lock "f647a50e-ee90-480a-ad5d-68f1782628d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:57 user nova-compute[72809]: DEBUG nova.compute.manager [req-6dbc8d88-479e-4280-8cb4-07400c1143b0 req-1f8271d3-6657-43af-8ec4-8e651759e351 service nova] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] No waiting events found dispatching network-vif-plugged-3554b93c-4cee-4835-980f-413908f76f98 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:48:57 user nova-compute[72809]: WARNING nova.compute.manager [req-6dbc8d88-479e-4280-8cb4-07400c1143b0 req-1f8271d3-6657-43af-8ec4-8e651759e351 service nova] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Received unexpected event network-vif-plugged-3554b93c-4cee-4835-980f-413908f76f98 for instance with vm_state building and task_state spawning.
Aug 09 06:48:57 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 06:48:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 06:48:57 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Creating image(s)
Aug 09 06:48:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Lock "/opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Lock "/opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7ab3c54a-a85e-4681-b675-6dd10ce02f25 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "3640991e-8a5b-4674-af81-3117d4269a68" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.258s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:57 user nova-compute[72809]: INFO nova.compute.manager [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Took 18.30 seconds to spawn the instance on the hypervisor.
Aug 09 06:48:57 user nova-compute[72809]: DEBUG nova.compute.manager [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:48:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:48:57 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:48:57 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:48:57 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563736.4835615, 24ba9b41-d0bf-4a84-9f04-bfda9525b154 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:48:57 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] VM Started (Lifecycle Event)
Aug 09 06:48:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.273s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:48:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:48:57 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:48:57 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:48:57 user nova-compute[72809]: INFO nova.compute.manager [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Took 21.32 seconds to build instance.
Aug 09 06:48:57 user nova-compute[72809]: INFO nova.compute.manager [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Took 21.06 seconds to build instance.
Aug 09 06:48:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:57 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563736.5062912, 15dda080-3487-4316-ab7b-f7185f0a4519 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:48:57 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] VM Resumed (Lifecycle Event)
Aug 09 06:48:57 user nova-compute[72809]: INFO nova.compute.manager [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Took 19.89 seconds to build instance.
Aug 09 06:48:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a3c8f091-670d-40a8-8736-743d70938c42 tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Lock "f647a50e-ee90-480a-ad5d-68f1782628d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.752s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-281c49d2-5e05-40fe-be20-20e14f4edb1e tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.289s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.323s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:48:57 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:48:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:48:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4a636d9d-4d73-4a24-adf8-8bed820c0b84 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "15dda080-3487-4316-ab7b-f7185f0a4519" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.605s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:57 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:48:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532/disk 1073741824" returned: 0 in 0.118s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:48:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.452s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:48:58 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563736.5139513, 15dda080-3487-4316-ab7b-f7185f0a4519 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:48:58 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] VM Started (Lifecycle Event)
Aug 09 06:48:58 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:48:58 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:48:58 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563736.7021852, f647a50e-ee90-480a-ad5d-68f1782628d9 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:48:58 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] VM Resumed (Lifecycle Event)
Aug 09 06:48:58 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.266s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:48:58 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 06:48:58 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:48:58 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:48:58 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:48:58 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563736.7034209, f647a50e-ee90-480a-ad5d-68f1782628d9 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:48:58 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] VM Started (Lifecycle Event)
Aug 09 06:48:58 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:48:58 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:48:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:48:58 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532/disk --force-share --output=json" returned: 0 in 0.349s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:48:58 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Cannot resize image /opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 06:48:58 user nova-compute[72809]: DEBUG nova.objects.instance [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Lazy-loading 'migration_context' on Instance uuid b9b69c9e-f91d-4681-a53b-2f0fc4b13532 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:48:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 06:48:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Ensure instance console log exists: /opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 06:48:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Acquiring lock "b64e7169-044c-4d0a-9ee5-f2914f1f5529" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "b64e7169-044c-4d0a-9ee5-f2914f1f5529" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:59 user nova-compute[72809]: DEBUG nova.compute.manager [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 06:48:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:48:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:48:59 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 06:48:59 user nova-compute[72809]: INFO nova.compute.claims [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Claim successful on node user
Aug 09 06:48:59 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Successfully created port: 664d7e69-c8c7-4ee9-980f-f58f8c8871b8 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:48:59 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:48:59 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:48:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.715s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:48:59 user nova-compute[72809]: DEBUG nova.compute.manager [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 06:49:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:00 user nova-compute[72809]: DEBUG nova.compute.manager [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 06:49:00 user nova-compute[72809]: DEBUG nova.network.neutron [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 06:49:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:00 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 06:49:00 user nova-compute[72809]: DEBUG nova.compute.manager [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 06:49:00 user nova-compute[72809]: DEBUG nova.compute.manager [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 06:49:00 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 06:49:00 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Creating image(s)
Aug 09 06:49:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Acquiring lock "/opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:49:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "/opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:49:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "/opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:00 user nova-compute[72809]: DEBUG nova.policy [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6cd5e6af221a4c0d996b4da1cce17f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d061b94c6548d88d8c3cae6751d937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 06:49:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.249s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:49:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:49:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.178s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk 1073741824" returned: 0 in 0.080s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Acquiring lock "8a6a74bc-2e97-4248-8b82-abb54ff4cc83" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:49:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Lock "8a6a74bc-2e97-4248-8b82-abb54ff4cc83" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:49:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.219s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:01 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 06:49:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:01 user nova-compute[72809]: DEBUG nova.compute.manager [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 06:49:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:49:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:49:01 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 06:49:01 user nova-compute[72809]: INFO nova.compute.claims [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Claim successful on node user
Aug 09 06:49:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:01 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Cannot resize image /opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 06:49:01 user nova-compute[72809]: DEBUG nova.objects.instance [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lazy-loading 'migration_context' on Instance uuid b64e7169-044c-4d0a-9ee5-f2914f1f5529 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:49:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 06:49:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Ensure instance console log exists: /opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 06:49:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:49:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:49:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:02 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:49:02 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:49:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.954s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:02 user nova-compute[72809]: DEBUG nova.compute.manager [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 06:49:02 user nova-compute[72809]: DEBUG nova.compute.manager [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 06:49:02 user nova-compute[72809]: DEBUG nova.network.neutron [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 06:49:02 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 06:49:02 user nova-compute[72809]: DEBUG nova.policy [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c1d878cb40fa4997a1d4393549157227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc95b0bf255f49819b4b85a1a0b09212', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 06:49:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:02 user nova-compute[72809]: DEBUG nova.compute.manager [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 06:49:02 user nova-compute[72809]: DEBUG nova.compute.manager [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 06:49:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 06:49:02 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Creating image(s)
Aug 09 06:49:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a6a74bc-2e97-4248-8b82-abb54ff4cc83/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:49:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Lock "/opt/stack/data/nova/instances/8a6a74bc-2e97-4248-8b82-abb54ff4cc83/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:49:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Lock "/opt/stack/data/nova/instances/8a6a74bc-2e97-4248-8b82-abb54ff4cc83/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.216s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:49:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:49:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.261s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/8a6a74bc-2e97-4248-8b82-abb54ff4cc83/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/8a6a74bc-2e97-4248-8b82-abb54ff4cc83/disk 1073741824" returned: 0 in 0.113s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.382s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.165s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:03 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8a6a74bc-2e97-4248-8b82-abb54ff4cc83/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 06:49:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a6a74bc-2e97-4248-8b82-abb54ff4cc83/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:03 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Successfully updated port: 664d7e69-c8c7-4ee9-980f-f58f8c8871b8 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:49:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Acquiring lock "refresh_cache-b9b69c9e-f91d-4681-a53b-2f0fc4b13532" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:49:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Acquired lock "refresh_cache-b9b69c9e-f91d-4681-a53b-2f0fc4b13532" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:49:03 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:49:04 user nova-compute[72809]: DEBUG nova.compute.manager [req-8c125b5c-5f58-4338-b426-b2d20eab6355 req-2cb199aa-2fd4-44aa-bea8-1df6653ba3ce service nova] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Received event network-changed-664d7e69-c8c7-4ee9-980f-f58f8c8871b8 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:49:04 user nova-compute[72809]: DEBUG nova.compute.manager [req-8c125b5c-5f58-4338-b426-b2d20eab6355 req-2cb199aa-2fd4-44aa-bea8-1df6653ba3ce service nova] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Refreshing instance network info cache due to event network-changed-664d7e69-c8c7-4ee9-980f-f58f8c8871b8. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:49:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-8c125b5c-5f58-4338-b426-b2d20eab6355 req-2cb199aa-2fd4-44aa-bea8-1df6653ba3ce service nova] Acquiring lock "refresh_cache-b9b69c9e-f91d-4681-a53b-2f0fc4b13532" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:49:04 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a6a74bc-2e97-4248-8b82-abb54ff4cc83/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:04 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Cannot resize image /opt/stack/data/nova/instances/8a6a74bc-2e97-4248-8b82-abb54ff4cc83/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 06:49:04 user nova-compute[72809]: DEBUG nova.objects.instance [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Lazy-loading 'migration_context' on Instance uuid 8a6a74bc-2e97-4248-8b82-abb54ff4cc83 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:49:04 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 06:49:04 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Ensure instance console log exists: /opt/stack/data/nova/instances/8a6a74bc-2e97-4248-8b82-abb54ff4cc83/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 06:49:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:49:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:49:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:04 user nova-compute[72809]: DEBUG nova.network.neutron [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Successfully created port: 861ed195-01ae-4b1b-8a9f-3464eedeebdc {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:49:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:04 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:49:04 user nova-compute[72809]: DEBUG nova.network.neutron [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Successfully created port: d83214ef-f913-4ab9-b9b5-4bcd171b1656 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Acquiring lock "80f694fb-e406-4b66-badc-f3686f3f1dc9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lock "80f694fb-e406-4b66-badc-f3686f3f1dc9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Updating instance_info_cache with network_info: [{"id": "664d7e69-c8c7-4ee9-980f-f58f8c8871b8", "address": "fa:16:3e:90:04:36", "network": {"id": "aea61157-8f5e-461a-b77e-f5279119bc15", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1060654578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cd7ca02c3254d4b8e5fb9ddf3ec82bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664d7e69-c8", "ovs_interfaceid": "664d7e69-c8c7-4ee9-980f-f58f8c8871b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Releasing lock "refresh_cache-b9b69c9e-f91d-4681-a53b-2f0fc4b13532" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Instance network_info: |[{"id": "664d7e69-c8c7-4ee9-980f-f58f8c8871b8", "address": "fa:16:3e:90:04:36", "network": {"id": "aea61157-8f5e-461a-b77e-f5279119bc15", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1060654578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cd7ca02c3254d4b8e5fb9ddf3ec82bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664d7e69-c8", "ovs_interfaceid": "664d7e69-c8c7-4ee9-980f-f58f8c8871b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-8c125b5c-5f58-4338-b426-b2d20eab6355 req-2cb199aa-2fd4-44aa-bea8-1df6653ba3ce service nova] Acquired lock "refresh_cache-b9b69c9e-f91d-4681-a53b-2f0fc4b13532" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.network.neutron [req-8c125b5c-5f58-4338-b426-b2d20eab6355 req-2cb199aa-2fd4-44aa-bea8-1df6653ba3ce service nova] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Refreshing network info cache for port 664d7e69-c8c7-4ee9-980f-f58f8c8871b8 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Start _get_guest_xml network_info=[{"id": "664d7e69-c8c7-4ee9-980f-f58f8c8871b8", "address": "fa:16:3e:90:04:36", "network": {"id": "aea61157-8f5e-461a-b77e-f5279119bc15", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1060654578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cd7ca02c3254d4b8e5fb9ddf3ec82bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664d7e69-c8", "ovs_interfaceid": "664d7e69-c8c7-4ee9-980f-f58f8c8871b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:49:05 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:49:05 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.network.neutron [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Successfully updated port: 861ed195-01ae-4b1b-8a9f-3464eedeebdc {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Acquiring lock "refresh_cache-8a6a74bc-2e97-4248-8b82-abb54ff4cc83" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Acquired lock "refresh_cache-8a6a74bc-2e97-4248-8b82-abb54ff4cc83" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.network.neutron [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:48:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-230315055',display_name='tempest-TestVolumeSwap-server-230315055',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-230315055',id=5,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmYwQIbAr3CRq7lDsnCNpDpu83uialt34742XzRyT9KSqAwrc0NRrQ3OvANhiJRZ4qql9TKBemINexgMq3MjiQK3cki+GxvIe3IbWxNHXOLKvM2acO2IvD1gz3kf24F6g==',key_name='tempest-keypair-511862142',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cd7ca02c3254d4b8e5fb9ddf3ec82bd',ramdisk_id='',reservation_id='r-vhuq08lo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1821007764',owner_user_name='tempest-TestVolumeSwap-1821007764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:48:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='692e6ee8bb5145359c5551c151451a02',uuid=b9b69c9e-f91d-4681-a53b-2f0fc4b13532,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "664d7e69-c8c7-4ee9-980f-f58f8c8871b8", "address": "fa:16:3e:90:04:36", "network": {"id": "aea61157-8f5e-461a-b77e-f5279119bc15", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1060654578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cd7ca02c3254d4b8e5fb9ddf3ec82bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664d7e69-c8", "ovs_interfaceid": "664d7e69-c8c7-4ee9-980f-f58f8c8871b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Converting VIF {"id": "664d7e69-c8c7-4ee9-980f-f58f8c8871b8", "address": "fa:16:3e:90:04:36", "network": {"id": "aea61157-8f5e-461a-b77e-f5279119bc15", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1060654578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cd7ca02c3254d4b8e5fb9ddf3ec82bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664d7e69-c8", "ovs_interfaceid": "664d7e69-c8c7-4ee9-980f-f58f8c8871b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:04:36,bridge_name='br-int',has_traffic_filtering=True,id=664d7e69-c8c7-4ee9-980f-f58f8c8871b8,network=Network(aea61157-8f5e-461a-b77e-f5279119bc15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap664d7e69-c8') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.objects.instance [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Lazy-loading 'pci_devices' on Instance uuid b9b69c9e-f91d-4681-a53b-2f0fc4b13532 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.compute.manager [req-9c7a7162-aefa-4704-b9c1-f4d77c32eb86 req-def1779e-5748-4afd-a5a5-bedd78570c55 service nova] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Received event network-changed-861ed195-01ae-4b1b-8a9f-3464eedeebdc {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.compute.manager [req-9c7a7162-aefa-4704-b9c1-f4d77c32eb86 req-def1779e-5748-4afd-a5a5-bedd78570c55 service nova] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Refreshing instance network info cache due to event network-changed-861ed195-01ae-4b1b-8a9f-3464eedeebdc. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9c7a7162-aefa-4704-b9c1-f4d77c32eb86 req-def1779e-5748-4afd-a5a5-bedd78570c55 service nova] Acquiring lock "refresh_cache-8a6a74bc-2e97-4248-8b82-abb54ff4cc83" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:49:05 user nova-compute[72809]:   <uuid>b9b69c9e-f91d-4681-a53b-2f0fc4b13532</uuid>
Aug 09 06:49:05 user nova-compute[72809]:   <name>instance-00000005</name>
Aug 09 06:49:05 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:49:05 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:49:05 user nova-compute[72809]:   <metadata>
Aug 09 06:49:05 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:49:05 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:49:05 user nova-compute[72809]:       <nova:name>tempest-TestVolumeSwap-server-230315055</nova:name>
Aug 09 06:49:05 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:49:05</nova:creationTime>
Aug 09 06:49:05 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:49:05 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:49:05 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:49:05 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:49:05 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:49:05 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:49:05 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:49:05 user nova-compute[72809]:       <nova:owner>
Aug 09 06:49:05 user nova-compute[72809]:         <nova:user uuid="692e6ee8bb5145359c5551c151451a02">tempest-TestVolumeSwap-1821007764-project-member</nova:user>
Aug 09 06:49:05 user nova-compute[72809]:         <nova:project uuid="1cd7ca02c3254d4b8e5fb9ddf3ec82bd">tempest-TestVolumeSwap-1821007764</nova:project>
Aug 09 06:49:05 user nova-compute[72809]:       </nova:owner>
Aug 09 06:49:05 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:49:05 user nova-compute[72809]:       <nova:ports>
Aug 09 06:49:05 user nova-compute[72809]:         <nova:port uuid="664d7e69-c8c7-4ee9-980f-f58f8c8871b8">
Aug 09 06:49:05 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 06:49:05 user nova-compute[72809]:         </nova:port>
Aug 09 06:49:05 user nova-compute[72809]:       </nova:ports>
Aug 09 06:49:05 user nova-compute[72809]:     </nova:instance>
Aug 09 06:49:05 user nova-compute[72809]:   </metadata>
Aug 09 06:49:05 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:49:05 user nova-compute[72809]:     <system>
Aug 09 06:49:05 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:49:05 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:49:05 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:49:05 user nova-compute[72809]:       <entry name="serial">b9b69c9e-f91d-4681-a53b-2f0fc4b13532</entry>
Aug 09 06:49:05 user nova-compute[72809]:       <entry name="uuid">b9b69c9e-f91d-4681-a53b-2f0fc4b13532</entry>
Aug 09 06:49:05 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:49:05 user nova-compute[72809]:     </system>
Aug 09 06:49:05 user nova-compute[72809]:   </sysinfo>
Aug 09 06:49:05 user nova-compute[72809]:   <os>
Aug 09 06:49:05 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:49:05 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 06:49:05 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:49:05 user nova-compute[72809]:   </os>
Aug 09 06:49:05 user nova-compute[72809]:   <features>
Aug 09 06:49:05 user nova-compute[72809]:     <acpi/>
Aug 09 06:49:05 user nova-compute[72809]:     <apic/>
Aug 09 06:49:05 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:49:05 user nova-compute[72809]:   </features>
Aug 09 06:49:05 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:49:05 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:49:05 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:49:05 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:49:05 user nova-compute[72809]:   </clock>
Aug 09 06:49:05 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:49:05 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:49:05 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:49:05 user nova-compute[72809]:   </cpu>
Aug 09 06:49:05 user nova-compute[72809]:   <devices>
Aug 09 06:49:05 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:49:05 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:49:05 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532/disk"/>
Aug 09 06:49:05 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:49:05 user nova-compute[72809]:     </disk>
Aug 09 06:49:05 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:49:05 user nova-compute[72809]:       <mac address="fa:16:3e:90:04:36"/>
Aug 09 06:49:05 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:49:05 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:49:05 user nova-compute[72809]:       <target dev="tap664d7e69-c8"/>
Aug 09 06:49:05 user nova-compute[72809]:     </interface>
Aug 09 06:49:05 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:49:05 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532/console.log" append="off"/>
Aug 09 06:49:05 user nova-compute[72809]:     </serial>
Aug 09 06:49:05 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:49:05 user nova-compute[72809]:     <video>
Aug 09 06:49:05 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:49:05 user nova-compute[72809]:     </video>
Aug 09 06:49:05 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:49:05 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:49:05 user nova-compute[72809]:     </rng>
Aug 09 06:49:05 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:49:05 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:49:05 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:49:05 user nova-compute[72809]:     </memballoon>
Aug 09 06:49:05 user nova-compute[72809]:   </devices>
Aug 09 06:49:05 user nova-compute[72809]: </domain>
Aug 09 06:49:05 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:48:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-230315055',display_name='tempest-TestVolumeSwap-server-230315055',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-230315055',id=5,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmYwQIbAr3CRq7lDsnCNpDpu83uialt34742XzRyT9KSqAwrc0NRrQ3OvANhiJRZ4qql9TKBemINexgMq3MjiQK3cki+GxvIe3IbWxNHXOLKvM2acO2IvD1gz3kf24F6g==',key_name='tempest-keypair-511862142',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cd7ca02c3254d4b8e5fb9ddf3ec82bd',ramdisk_id='',reservation_id='r-vhuq08lo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1821007764',owner_user_name='tempest-TestVolumeSwap-1821007764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:48:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='692e6ee8bb5145359c5551c151451a02',uuid=b9b69c9e-f91d-4681-a53b-2f0fc4b13532,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "664d7e69-c8c7-4ee9-980f-f58f8c8871b8", "address": "fa:16:3e:90:04:36", "network": {"id": "aea61157-8f5e-461a-b77e-f5279119bc15", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1060654578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cd7ca02c3254d4b8e5fb9ddf3ec82bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664d7e69-c8", "ovs_interfaceid": "664d7e69-c8c7-4ee9-980f-f58f8c8871b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Converting VIF {"id": "664d7e69-c8c7-4ee9-980f-f58f8c8871b8", "address": "fa:16:3e:90:04:36", "network": {"id": "aea61157-8f5e-461a-b77e-f5279119bc15", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1060654578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cd7ca02c3254d4b8e5fb9ddf3ec82bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664d7e69-c8", "ovs_interfaceid": "664d7e69-c8c7-4ee9-980f-f58f8c8871b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:04:36,bridge_name='br-int',has_traffic_filtering=True,id=664d7e69-c8c7-4ee9-980f-f58f8c8871b8,network=Network(aea61157-8f5e-461a-b77e-f5279119bc15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap664d7e69-c8') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG os_vif [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:04:36,bridge_name='br-int',has_traffic_filtering=True,id=664d7e69-c8c7-4ee9-980f-f58f8c8871b8,network=Network(aea61157-8f5e-461a-b77e-f5279119bc15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap664d7e69-c8') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap664d7e69-c8, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap664d7e69-c8, col_values=(('external_ids', {'iface-id': '664d7e69-c8c7-4ee9-980f-f58f8c8871b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:04:36', 'vm-uuid': 'b9b69c9e-f91d-4681-a53b-2f0fc4b13532'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:05 user nova-compute[72809]: INFO os_vif [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:04:36,bridge_name='br-int',has_traffic_filtering=True,id=664d7e69-c8c7-4ee9-980f-f58f8c8871b8,network=Network(aea61157-8f5e-461a-b77e-f5279119bc15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap664d7e69-c8')
Aug 09 06:49:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 06:49:05 user nova-compute[72809]: INFO nova.compute.claims [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Claim successful on node user
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.network.neutron [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:49:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] No VIF found with MAC fa:16:3e:90:04:36, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.network.neutron [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Updating instance_info_cache with network_info: [{"id": "861ed195-01ae-4b1b-8a9f-3464eedeebdc", "address": "fa:16:3e:b9:13:a6", "network": {"id": "32870d8a-a604-4a02-9d22-cb926d69718f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-190435513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc95b0bf255f49819b4b85a1a0b09212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap861ed195-01", "ovs_interfaceid": "861ed195-01ae-4b1b-8a9f-3464eedeebdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Releasing lock "refresh_cache-8a6a74bc-2e97-4248-8b82-abb54ff4cc83" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.compute.manager [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Instance network_info: |[{"id": "861ed195-01ae-4b1b-8a9f-3464eedeebdc", "address": "fa:16:3e:b9:13:a6", "network": {"id": "32870d8a-a604-4a02-9d22-cb926d69718f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-190435513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc95b0bf255f49819b4b85a1a0b09212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap861ed195-01", "ovs_interfaceid": "861ed195-01ae-4b1b-8a9f-3464eedeebdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9c7a7162-aefa-4704-b9c1-f4d77c32eb86 req-def1779e-5748-4afd-a5a5-bedd78570c55 service nova] Acquired lock "refresh_cache-8a6a74bc-2e97-4248-8b82-abb54ff4cc83" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.network.neutron [req-9c7a7162-aefa-4704-b9c1-f4d77c32eb86 req-def1779e-5748-4afd-a5a5-bedd78570c55 service nova] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Refreshing network info cache for port 861ed195-01ae-4b1b-8a9f-3464eedeebdc {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Start _get_guest_xml network_info=[{"id": "861ed195-01ae-4b1b-8a9f-3464eedeebdc", "address": "fa:16:3e:b9:13:a6", "network": {"id": "32870d8a-a604-4a02-9d22-cb926d69718f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-190435513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc95b0bf255f49819b4b85a1a0b09212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap861ed195-01", "ovs_interfaceid": "861ed195-01ae-4b1b-8a9f-3464eedeebdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.716s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 06:49:06 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:49:06 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-99224691',display_name='tempest-VolumesAssistedSnapshotsTest-server-99224691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-99224691',id=7,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBITPUvg9PmOqFPQcU5B39uRQZj8MMHLuiXdNl4w3p9X5sbfYnnsqUEGWVWIaTfNvgbiCD7vXPNsCKlbYnb7vks44ObrX5Hg8sa6WYd4lSPWyZMI5AKf8MH6qobp4bjF6+A==',key_name='tempest-keypair-1282205847',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc95b0bf255f49819b4b85a1a0b09212',ramdisk_id='',reservation_id='r-f9hc8v8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-731789458',owner_user_name='tempest-VolumesAssistedSnapshotsTest-731789458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:49:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1d878cb40fa4997a1d4393549157227',uuid=8a6a74bc-2e97-4248-8b82-abb54ff4cc83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "861ed195-01ae-4b1b-8a9f-3464eedeebdc", "address": "fa:16:3e:b9:13:a6", "network": {"id": "32870d8a-a604-4a02-9d22-cb926d69718f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-190435513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc95b0bf255f49819b4b85a1a0b09212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap861ed195-01", "ovs_interfaceid": "861ed195-01ae-4b1b-8a9f-3464eedeebdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Converting VIF {"id": "861ed195-01ae-4b1b-8a9f-3464eedeebdc", "address": "fa:16:3e:b9:13:a6", "network": {"id": "32870d8a-a604-4a02-9d22-cb926d69718f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-190435513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc95b0bf255f49819b4b85a1a0b09212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap861ed195-01", "ovs_interfaceid": "861ed195-01ae-4b1b-8a9f-3464eedeebdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:13:a6,bridge_name='br-int',has_traffic_filtering=True,id=861ed195-01ae-4b1b-8a9f-3464eedeebdc,network=Network(32870d8a-a604-4a02-9d22-cb926d69718f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap861ed195-01') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.objects.instance [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a6a74bc-2e97-4248-8b82-abb54ff4cc83 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.network.neutron [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:49:06 user nova-compute[72809]:   <uuid>8a6a74bc-2e97-4248-8b82-abb54ff4cc83</uuid>
Aug 09 06:49:06 user nova-compute[72809]:   <name>instance-00000007</name>
Aug 09 06:49:06 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:49:06 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:49:06 user nova-compute[72809]:   <metadata>
Aug 09 06:49:06 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:49:06 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:49:06 user nova-compute[72809]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-99224691</nova:name>
Aug 09 06:49:06 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:49:06</nova:creationTime>
Aug 09 06:49:06 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:49:06 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:49:06 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:49:06 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:49:06 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:49:06 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:49:06 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:49:06 user nova-compute[72809]:       <nova:owner>
Aug 09 06:49:06 user nova-compute[72809]:         <nova:user uuid="c1d878cb40fa4997a1d4393549157227">tempest-VolumesAssistedSnapshotsTest-731789458-project-member</nova:user>
Aug 09 06:49:06 user nova-compute[72809]:         <nova:project uuid="cc95b0bf255f49819b4b85a1a0b09212">tempest-VolumesAssistedSnapshotsTest-731789458</nova:project>
Aug 09 06:49:06 user nova-compute[72809]:       </nova:owner>
Aug 09 06:49:06 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:49:06 user nova-compute[72809]:       <nova:ports>
Aug 09 06:49:06 user nova-compute[72809]:         <nova:port uuid="861ed195-01ae-4b1b-8a9f-3464eedeebdc">
Aug 09 06:49:06 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 06:49:06 user nova-compute[72809]:         </nova:port>
Aug 09 06:49:06 user nova-compute[72809]:       </nova:ports>
Aug 09 06:49:06 user nova-compute[72809]:     </nova:instance>
Aug 09 06:49:06 user nova-compute[72809]:   </metadata>
Aug 09 06:49:06 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:49:06 user nova-compute[72809]:     <system>
Aug 09 06:49:06 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:49:06 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:49:06 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:49:06 user nova-compute[72809]:       <entry name="serial">8a6a74bc-2e97-4248-8b82-abb54ff4cc83</entry>
Aug 09 06:49:06 user nova-compute[72809]:       <entry name="uuid">8a6a74bc-2e97-4248-8b82-abb54ff4cc83</entry>
Aug 09 06:49:06 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:49:06 user nova-compute[72809]:     </system>
Aug 09 06:49:06 user nova-compute[72809]:   </sysinfo>
Aug 09 06:49:06 user nova-compute[72809]:   <os>
Aug 09 06:49:06 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:49:06 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 06:49:06 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:49:06 user nova-compute[72809]:   </os>
Aug 09 06:49:06 user nova-compute[72809]:   <features>
Aug 09 06:49:06 user nova-compute[72809]:     <acpi/>
Aug 09 06:49:06 user nova-compute[72809]:     <apic/>
Aug 09 06:49:06 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:49:06 user nova-compute[72809]:   </features>
Aug 09 06:49:06 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:49:06 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:49:06 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:49:06 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:49:06 user nova-compute[72809]:   </clock>
Aug 09 06:49:06 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:49:06 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:49:06 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:49:06 user nova-compute[72809]:   </cpu>
Aug 09 06:49:06 user nova-compute[72809]:   <devices>
Aug 09 06:49:06 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:49:06 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:49:06 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/8a6a74bc-2e97-4248-8b82-abb54ff4cc83/disk"/>
Aug 09 06:49:06 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:49:06 user nova-compute[72809]:     </disk>
Aug 09 06:49:06 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:49:06 user nova-compute[72809]:       <mac address="fa:16:3e:b9:13:a6"/>
Aug 09 06:49:06 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:49:06 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:49:06 user nova-compute[72809]:       <target dev="tap861ed195-01"/>
Aug 09 06:49:06 user nova-compute[72809]:     </interface>
Aug 09 06:49:06 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:49:06 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/8a6a74bc-2e97-4248-8b82-abb54ff4cc83/console.log" append="off"/>
Aug 09 06:49:06 user nova-compute[72809]:     </serial>
Aug 09 06:49:06 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:49:06 user nova-compute[72809]:     <video>
Aug 09 06:49:06 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:49:06 user nova-compute[72809]:     </video>
Aug 09 06:49:06 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:49:06 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:49:06 user nova-compute[72809]:     </rng>
Aug 09 06:49:06 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:49:06 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:49:06 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:49:06 user nova-compute[72809]:     </memballoon>
Aug 09 06:49:06 user nova-compute[72809]:   </devices>
Aug 09 06:49:06 user nova-compute[72809]: </domain>
Aug 09 06:49:06 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-99224691',display_name='tempest-VolumesAssistedSnapshotsTest-server-99224691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-99224691',id=7,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBITPUvg9PmOqFPQcU5B39uRQZj8MMHLuiXdNl4w3p9X5sbfYnnsqUEGWVWIaTfNvgbiCD7vXPNsCKlbYnb7vks44ObrX5Hg8sa6WYd4lSPWyZMI5AKf8MH6qobp4bjF6+A==',key_name='tempest-keypair-1282205847',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc95b0bf255f49819b4b85a1a0b09212',ramdisk_id='',reservation_id='r-f9hc8v8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-731789458',owner_user_name='tempest-VolumesAssistedSnapshotsTest-731789458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:49:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1d878cb40fa4997a1d4393549157227',uuid=8a6a74bc-2e97-4248-8b82-abb54ff4cc83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "861ed195-01ae-4b1b-8a9f-3464eedeebdc", "address": "fa:16:3e:b9:13:a6", "network": {"id": "32870d8a-a604-4a02-9d22-cb926d69718f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-190435513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc95b0bf255f49819b4b85a1a0b09212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap861ed195-01", "ovs_interfaceid": "861ed195-01ae-4b1b-8a9f-3464eedeebdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Converting VIF {"id": "861ed195-01ae-4b1b-8a9f-3464eedeebdc", "address": "fa:16:3e:b9:13:a6", "network": {"id": "32870d8a-a604-4a02-9d22-cb926d69718f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-190435513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc95b0bf255f49819b4b85a1a0b09212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap861ed195-01", "ovs_interfaceid": "861ed195-01ae-4b1b-8a9f-3464eedeebdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:13:a6,bridge_name='br-int',has_traffic_filtering=True,id=861ed195-01ae-4b1b-8a9f-3464eedeebdc,network=Network(32870d8a-a604-4a02-9d22-cb926d69718f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap861ed195-01') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG os_vif [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:13:a6,bridge_name='br-int',has_traffic_filtering=True,id=861ed195-01ae-4b1b-8a9f-3464eedeebdc,network=Network(32870d8a-a604-4a02-9d22-cb926d69718f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap861ed195-01') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap861ed195-01, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap861ed195-01, col_values=(('external_ids', {'iface-id': '861ed195-01ae-4b1b-8a9f-3464eedeebdc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:13:a6', 'vm-uuid': '8a6a74bc-2e97-4248-8b82-abb54ff4cc83'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:06 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 09 06:49:06 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:06 user nova-compute[72809]: INFO os_vif [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:13:a6,bridge_name='br-int',has_traffic_filtering=True,id=861ed195-01ae-4b1b-8a9f-3464eedeebdc,network=Network(32870d8a-a604-4a02-9d22-cb926d69718f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap861ed195-01')
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.policy [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1ae3672f60e49b199c926dc559cd1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41de34302b6242b98f400b4f8e0cdb42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] No VIF found with MAC fa:16:3e:b9:13:a6, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 06:49:06 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Creating image(s)
Aug 09 06:49:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Acquiring lock "/opt/stack/data/nova/instances/80f694fb-e406-4b66-badc-f3686f3f1dc9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lock "/opt/stack/data/nova/instances/80f694fb-e406-4b66-badc-f3686f3f1dc9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lock "/opt/stack/data/nova/instances/80f694fb-e406-4b66-badc-f3686f3f1dc9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Acquiring lock "588ee97cfd082e8ce7584708f4df30d0a75a1d24" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lock "588ee97cfd082e8ce7584708f4df30d0a75a1d24" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.network.neutron [req-8c125b5c-5f58-4338-b426-b2d20eab6355 req-2cb199aa-2fd4-44aa-bea8-1df6653ba3ce service nova] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Updated VIF entry in instance network info cache for port 664d7e69-c8c7-4ee9-980f-f58f8c8871b8. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG nova.network.neutron [req-8c125b5c-5f58-4338-b426-b2d20eab6355 req-2cb199aa-2fd4-44aa-bea8-1df6653ba3ce service nova] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Updating instance_info_cache with network_info: [{"id": "664d7e69-c8c7-4ee9-980f-f58f8c8871b8", "address": "fa:16:3e:90:04:36", "network": {"id": "aea61157-8f5e-461a-b77e-f5279119bc15", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1060654578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cd7ca02c3254d4b8e5fb9ddf3ec82bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664d7e69-c8", "ovs_interfaceid": "664d7e69-c8c7-4ee9-980f-f58f8c8871b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:49:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-8c125b5c-5f58-4338-b426-b2d20eab6355 req-2cb199aa-2fd4-44aa-bea8-1df6653ba3ce service nova] Releasing lock "refresh_cache-b9b69c9e-f91d-4681-a53b-2f0fc4b13532" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:49:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/588ee97cfd082e8ce7584708f4df30d0a75a1d24.part --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:07 user nova-compute[72809]: DEBUG nova.network.neutron [req-9c7a7162-aefa-4704-b9c1-f4d77c32eb86 req-def1779e-5748-4afd-a5a5-bedd78570c55 service nova] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Updated VIF entry in instance network info cache for port 861ed195-01ae-4b1b-8a9f-3464eedeebdc. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:49:07 user nova-compute[72809]: DEBUG nova.network.neutron [req-9c7a7162-aefa-4704-b9c1-f4d77c32eb86 req-def1779e-5748-4afd-a5a5-bedd78570c55 service nova] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Updating instance_info_cache with network_info: [{"id": "861ed195-01ae-4b1b-8a9f-3464eedeebdc", "address": "fa:16:3e:b9:13:a6", "network": {"id": "32870d8a-a604-4a02-9d22-cb926d69718f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-190435513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc95b0bf255f49819b4b85a1a0b09212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap861ed195-01", "ovs_interfaceid": "861ed195-01ae-4b1b-8a9f-3464eedeebdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:49:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:07 user nova-compute[72809]: DEBUG nova.network.neutron [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Successfully updated port: d83214ef-f913-4ab9-b9b5-4bcd171b1656 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:49:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-5107edcd-cd4b-4813-8f90-9013e79250ba req-506f1b59-cdee-4aa5-a32c-4c5df1d41eba service nova] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Received event network-changed-d83214ef-f913-4ab9-b9b5-4bcd171b1656 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:49:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-5107edcd-cd4b-4813-8f90-9013e79250ba req-506f1b59-cdee-4aa5-a32c-4c5df1d41eba service nova] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Refreshing instance network info cache due to event network-changed-d83214ef-f913-4ab9-b9b5-4bcd171b1656. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:49:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5107edcd-cd4b-4813-8f90-9013e79250ba req-506f1b59-cdee-4aa5-a32c-4c5df1d41eba service nova] Acquiring lock "refresh_cache-b64e7169-044c-4d0a-9ee5-f2914f1f5529" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:49:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5107edcd-cd4b-4813-8f90-9013e79250ba req-506f1b59-cdee-4aa5-a32c-4c5df1d41eba service nova] Acquired lock "refresh_cache-b64e7169-044c-4d0a-9ee5-f2914f1f5529" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:49:07 user nova-compute[72809]: DEBUG nova.network.neutron [req-5107edcd-cd4b-4813-8f90-9013e79250ba req-506f1b59-cdee-4aa5-a32c-4c5df1d41eba service nova] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Refreshing network info cache for port d83214ef-f913-4ab9-b9b5-4bcd171b1656 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:49:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Acquiring lock "refresh_cache-b64e7169-044c-4d0a-9ee5-f2914f1f5529" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:49:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9c7a7162-aefa-4704-b9c1-f4d77c32eb86 req-def1779e-5748-4afd-a5a5-bedd78570c55 service nova] Releasing lock "refresh_cache-8a6a74bc-2e97-4248-8b82-abb54ff4cc83" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:49:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/588ee97cfd082e8ce7584708f4df30d0a75a1d24.part --force-share --output=json" returned: 0 in 0.284s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:07 user nova-compute[72809]: DEBUG nova.virt.images [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] c8b380c1-a7f5-4edf-a8d1-9eb9c9d55d99 was qcow2, converting to raw {{(pid=72809) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 06:49:07 user nova-compute[72809]: DEBUG nova.privsep.utils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72809) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 06:49:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/588ee97cfd082e8ce7584708f4df30d0a75a1d24.part /opt/stack/data/nova/instances/_base/588ee97cfd082e8ce7584708f4df30d0a75a1d24.converted {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:08 user nova-compute[72809]: DEBUG nova.network.neutron [req-5107edcd-cd4b-4813-8f90-9013e79250ba req-506f1b59-cdee-4aa5-a32c-4c5df1d41eba service nova] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:49:08 user nova-compute[72809]: DEBUG nova.network.neutron [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Successfully created port: 277509bc-7638-47e1-b28d-85a59fc5aa01 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:49:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/588ee97cfd082e8ce7584708f4df30d0a75a1d24.part /opt/stack/data/nova/instances/_base/588ee97cfd082e8ce7584708f4df30d0a75a1d24.converted" returned: 0 in 0.343s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/588ee97cfd082e8ce7584708f4df30d0a75a1d24.converted --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/588ee97cfd082e8ce7584708f4df30d0a75a1d24.converted --force-share --output=json" returned: 0 in 0.259s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lock "588ee97cfd082e8ce7584708f4df30d0a75a1d24" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.738s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/588ee97cfd082e8ce7584708f4df30d0a75a1d24 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/588ee97cfd082e8ce7584708f4df30d0a75a1d24 --force-share --output=json" returned: 0 in 0.182s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Acquiring lock "588ee97cfd082e8ce7584708f4df30d0a75a1d24" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:49:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lock "588ee97cfd082e8ce7584708f4df30d0a75a1d24" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:49:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/588ee97cfd082e8ce7584708f4df30d0a75a1d24 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/588ee97cfd082e8ce7584708f4df30d0a75a1d24 --force-share --output=json" returned: 0 in 0.222s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/588ee97cfd082e8ce7584708f4df30d0a75a1d24,backing_fmt=raw /opt/stack/data/nova/instances/80f694fb-e406-4b66-badc-f3686f3f1dc9/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/588ee97cfd082e8ce7584708f4df30d0a75a1d24,backing_fmt=raw /opt/stack/data/nova/instances/80f694fb-e406-4b66-badc-f3686f3f1dc9/disk 1073741824" returned: 0 in 0.086s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lock "588ee97cfd082e8ce7584708f4df30d0a75a1d24" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/588ee97cfd082e8ce7584708f4df30d0a75a1d24 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG nova.network.neutron [req-5107edcd-cd4b-4813-8f90-9013e79250ba req-506f1b59-cdee-4aa5-a32c-4c5df1d41eba service nova] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5107edcd-cd4b-4813-8f90-9013e79250ba req-506f1b59-cdee-4aa5-a32c-4c5df1d41eba service nova] Releasing lock "refresh_cache-b64e7169-044c-4d0a-9ee5-f2914f1f5529" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Acquired lock "refresh_cache-b64e7169-044c-4d0a-9ee5-f2914f1f5529" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG nova.network.neutron [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/588ee97cfd082e8ce7584708f4df30d0a75a1d24 --force-share --output=json" returned: 0 in 0.171s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80f694fb-e406-4b66-badc-f3686f3f1dc9/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f694fb-e406-4b66-badc-f3686f3f1dc9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG nova.network.neutron [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG nova.network.neutron [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Successfully updated port: 277509bc-7638-47e1-b28d-85a59fc5aa01 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f694fb-e406-4b66-badc-f3686f3f1dc9/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Cannot resize image /opt/stack/data/nova/instances/80f694fb-e406-4b66-badc-f3686f3f1dc9/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG nova.objects.instance [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lazy-loading 'migration_context' on Instance uuid 80f694fb-e406-4b66-badc-f3686f3f1dc9 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Acquiring lock "refresh_cache-80f694fb-e406-4b66-badc-f3686f3f1dc9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Acquired lock "refresh_cache-80f694fb-e406-4b66-badc-f3686f3f1dc9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG nova.network.neutron [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Ensure instance console log exists: /opt/stack/data/nova/instances/80f694fb-e406-4b66-badc-f3686f3f1dc9/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG nova.compute.manager [req-f5fbe652-f9b5-4c30-8f68-9217265abf60 req-3f83fd41-37b2-4085-bbb0-ed1b4cef8d50 service nova] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Received event network-changed-277509bc-7638-47e1-b28d-85a59fc5aa01 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG nova.compute.manager [req-f5fbe652-f9b5-4c30-8f68-9217265abf60 req-3f83fd41-37b2-4085-bbb0-ed1b4cef8d50 service nova] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Refreshing instance network info cache due to event network-changed-277509bc-7638-47e1-b28d-85a59fc5aa01. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f5fbe652-f9b5-4c30-8f68-9217265abf60 req-3f83fd41-37b2-4085-bbb0-ed1b4cef8d50 service nova] Acquiring lock "refresh_cache-80f694fb-e406-4b66-badc-f3686f3f1dc9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG nova.network.neutron [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG nova.compute.manager [req-e3aa642a-c933-46b3-b381-4728c2b8d448 req-d2a56614-736f-4d81-8ce2-772ddb98dd66 service nova] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Received event network-vif-plugged-664d7e69-c8c7-4ee9-980f-f58f8c8871b8 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e3aa642a-c933-46b3-b381-4728c2b8d448 req-d2a56614-736f-4d81-8ce2-772ddb98dd66 service nova] Acquiring lock "b9b69c9e-f91d-4681-a53b-2f0fc4b13532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e3aa642a-c933-46b3-b381-4728c2b8d448 req-d2a56614-736f-4d81-8ce2-772ddb98dd66 service nova] Lock "b9b69c9e-f91d-4681-a53b-2f0fc4b13532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e3aa642a-c933-46b3-b381-4728c2b8d448 req-d2a56614-736f-4d81-8ce2-772ddb98dd66 service nova] Lock "b9b69c9e-f91d-4681-a53b-2f0fc4b13532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:09 user nova-compute[72809]: DEBUG nova.compute.manager [req-e3aa642a-c933-46b3-b381-4728c2b8d448 req-d2a56614-736f-4d81-8ce2-772ddb98dd66 service nova] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] No waiting events found dispatching network-vif-plugged-664d7e69-c8c7-4ee9-980f-f58f8c8871b8 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:49:09 user nova-compute[72809]: WARNING nova.compute.manager [req-e3aa642a-c933-46b3-b381-4728c2b8d448 req-d2a56614-736f-4d81-8ce2-772ddb98dd66 service nova] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Received unexpected event network-vif-plugged-664d7e69-c8c7-4ee9-980f-f58f8c8871b8 for instance with vm_state building and task_state spawning.
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.network.neutron [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Updating instance_info_cache with network_info: [{"id": "277509bc-7638-47e1-b28d-85a59fc5aa01", "address": "fa:16:3e:a4:5c:0f", "network": {"id": "bf108dce-d080-4820-bad9-7f930b8fb364", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1121464630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41de34302b6242b98f400b4f8e0cdb42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277509bc-76", "ovs_interfaceid": "277509bc-7638-47e1-b28d-85a59fc5aa01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Releasing lock "refresh_cache-80f694fb-e406-4b66-badc-f3686f3f1dc9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Instance network_info: |[{"id": "277509bc-7638-47e1-b28d-85a59fc5aa01", "address": "fa:16:3e:a4:5c:0f", "network": {"id": "bf108dce-d080-4820-bad9-7f930b8fb364", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1121464630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41de34302b6242b98f400b4f8e0cdb42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277509bc-76", "ovs_interfaceid": "277509bc-7638-47e1-b28d-85a59fc5aa01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f5fbe652-f9b5-4c30-8f68-9217265abf60 req-3f83fd41-37b2-4085-bbb0-ed1b4cef8d50 service nova] Acquired lock "refresh_cache-80f694fb-e406-4b66-badc-f3686f3f1dc9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.network.neutron [req-f5fbe652-f9b5-4c30-8f68-9217265abf60 req-3f83fd41-37b2-4085-bbb0-ed1b4cef8d50 service nova] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Refreshing network info cache for port 277509bc-7638-47e1-b28d-85a59fc5aa01 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Start _get_guest_xml network_info=[{"id": "277509bc-7638-47e1-b28d-85a59fc5aa01", "address": "fa:16:3e:a4:5c:0f", "network": {"id": "bf108dce-d080-4820-bad9-7f930b8fb364", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1121464630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41de34302b6242b98f400b4f8e0cdb42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277509bc-76", "ovs_interfaceid": "277509bc-7638-47e1-b28d-85a59fc5aa01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:48:54Z,direct_url=<?>,disk_format='qcow2',id=c8b380c1-a7f5-4edf-a8d1-9eb9c9d55d99,min_disk=0,min_ram=0,name='',owner='6a5e84837b0045489a70d6aecbd442c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:48:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'disk_bus': 'scsi', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/sda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'c8b380c1-a7f5-4edf-a8d1-9eb9c9d55d99'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:49:10 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:49:10 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:48:54Z,direct_url=<?>,disk_format='qcow2',id=c8b380c1-a7f5-4edf-a8d1-9eb9c9d55d99,min_disk=0,min_ram=0,name='',owner='6a5e84837b0045489a70d6aecbd442c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:48:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:49:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-493992988',display_name='tempest-AttachSCSIVolumeTestJSON-server-493992988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-493992988',id=8,image_ref='c8b380c1-a7f5-4edf-a8d1-9eb9c9d55d99',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrE53HHXO0BB9cGQQmYWr57bzydYK17tmKu/Ekiw43aOTdY6jytzp81sNcDlxfQsmahYFgfHg+B8Ei8R2HNS98nYNTK8swfvSms1Kv7NeUe+0LRsVu7/WMeNqUNdPrfGw==',key_name='tempest-keypair-1889486654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41de34302b6242b98f400b4f8e0cdb42',ramdisk_id='',reservation_id='r-j0fad72y',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c8b380c1-a7f5-4edf-a8d1-9eb9c9d55d99',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-551348959',owner_user_name='tempest-AttachSCSIVolumeTestJSON-551348959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:49:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1ae3672f60e49b199c926dc559cd1ce',uuid=80f694fb-e406-4b66-badc-f3686f3f1dc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "277509bc-7638-47e1-b28d-85a59fc5aa01", "address": "fa:16:3e:a4:5c:0f", "network": {"id": "bf108dce-d080-4820-bad9-7f930b8fb364", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1121464630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41de34302b6242b98f400b4f8e0cdb42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277509bc-76", "ovs_interfaceid": "277509bc-7638-47e1-b28d-85a59fc5aa01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Converting VIF {"id": "277509bc-7638-47e1-b28d-85a59fc5aa01", "address": "fa:16:3e:a4:5c:0f", "network": {"id": "bf108dce-d080-4820-bad9-7f930b8fb364", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1121464630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41de34302b6242b98f400b4f8e0cdb42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277509bc-76", "ovs_interfaceid": "277509bc-7638-47e1-b28d-85a59fc5aa01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:5c:0f,bridge_name='br-int',has_traffic_filtering=True,id=277509bc-7638-47e1-b28d-85a59fc5aa01,network=Network(bf108dce-d080-4820-bad9-7f930b8fb364),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap277509bc-76') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.objects.instance [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lazy-loading 'pci_devices' on Instance uuid 80f694fb-e406-4b66-badc-f3686f3f1dc9 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:49:10 user nova-compute[72809]:   <uuid>80f694fb-e406-4b66-badc-f3686f3f1dc9</uuid>
Aug 09 06:49:10 user nova-compute[72809]:   <name>instance-00000008</name>
Aug 09 06:49:10 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:49:10 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:49:10 user nova-compute[72809]:   <metadata>
Aug 09 06:49:10 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:49:10 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:49:10 user nova-compute[72809]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-493992988</nova:name>
Aug 09 06:49:10 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:49:10</nova:creationTime>
Aug 09 06:49:10 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:49:10 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:49:10 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:49:10 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:49:10 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:49:10 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:49:10 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:49:10 user nova-compute[72809]:       <nova:owner>
Aug 09 06:49:10 user nova-compute[72809]:         <nova:user uuid="a1ae3672f60e49b199c926dc559cd1ce">tempest-AttachSCSIVolumeTestJSON-551348959-project-member</nova:user>
Aug 09 06:49:10 user nova-compute[72809]:         <nova:project uuid="41de34302b6242b98f400b4f8e0cdb42">tempest-AttachSCSIVolumeTestJSON-551348959</nova:project>
Aug 09 06:49:10 user nova-compute[72809]:       </nova:owner>
Aug 09 06:49:10 user nova-compute[72809]:       <nova:root type="image" uuid="c8b380c1-a7f5-4edf-a8d1-9eb9c9d55d99"/>
Aug 09 06:49:10 user nova-compute[72809]:       <nova:ports>
Aug 09 06:49:10 user nova-compute[72809]:         <nova:port uuid="277509bc-7638-47e1-b28d-85a59fc5aa01">
Aug 09 06:49:10 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 06:49:10 user nova-compute[72809]:         </nova:port>
Aug 09 06:49:10 user nova-compute[72809]:       </nova:ports>
Aug 09 06:49:10 user nova-compute[72809]:     </nova:instance>
Aug 09 06:49:10 user nova-compute[72809]:   </metadata>
Aug 09 06:49:10 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:49:10 user nova-compute[72809]:     <system>
Aug 09 06:49:10 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:49:10 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:49:10 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:49:10 user nova-compute[72809]:       <entry name="serial">80f694fb-e406-4b66-badc-f3686f3f1dc9</entry>
Aug 09 06:49:10 user nova-compute[72809]:       <entry name="uuid">80f694fb-e406-4b66-badc-f3686f3f1dc9</entry>
Aug 09 06:49:10 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:49:10 user nova-compute[72809]:     </system>
Aug 09 06:49:10 user nova-compute[72809]:   </sysinfo>
Aug 09 06:49:10 user nova-compute[72809]:   <os>
Aug 09 06:49:10 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:49:10 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 06:49:10 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:49:10 user nova-compute[72809]:   </os>
Aug 09 06:49:10 user nova-compute[72809]:   <features>
Aug 09 06:49:10 user nova-compute[72809]:     <acpi/>
Aug 09 06:49:10 user nova-compute[72809]:     <apic/>
Aug 09 06:49:10 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:49:10 user nova-compute[72809]:   </features>
Aug 09 06:49:10 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:49:10 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:49:10 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:49:10 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:49:10 user nova-compute[72809]:   </clock>
Aug 09 06:49:10 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:49:10 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:49:10 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:49:10 user nova-compute[72809]:   </cpu>
Aug 09 06:49:10 user nova-compute[72809]:   <devices>
Aug 09 06:49:10 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:49:10 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:49:10 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/80f694fb-e406-4b66-badc-f3686f3f1dc9/disk"/>
Aug 09 06:49:10 user nova-compute[72809]:       <target dev="sda" bus="scsi"/>
Aug 09 06:49:10 user nova-compute[72809]:       <address type="drive" controller="0" unit="0"/>
Aug 09 06:49:10 user nova-compute[72809]:     </disk>
Aug 09 06:49:10 user nova-compute[72809]:     <disk type="file" device="cdrom">
Aug 09 06:49:10 user nova-compute[72809]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 06:49:10 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/80f694fb-e406-4b66-badc-f3686f3f1dc9/disk.config"/>
Aug 09 06:49:10 user nova-compute[72809]:       <target dev="sdb" bus="scsi"/>
Aug 09 06:49:10 user nova-compute[72809]:       <address type="drive" controller="0" unit="1"/>
Aug 09 06:49:10 user nova-compute[72809]:     </disk>
Aug 09 06:49:10 user nova-compute[72809]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 09 06:49:10 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:49:10 user nova-compute[72809]:       <mac address="fa:16:3e:a4:5c:0f"/>
Aug 09 06:49:10 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:49:10 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:49:10 user nova-compute[72809]:       <target dev="tap277509bc-76"/>
Aug 09 06:49:10 user nova-compute[72809]:     </interface>
Aug 09 06:49:10 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:49:10 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/80f694fb-e406-4b66-badc-f3686f3f1dc9/console.log" append="off"/>
Aug 09 06:49:10 user nova-compute[72809]:     </serial>
Aug 09 06:49:10 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:49:10 user nova-compute[72809]:     <video>
Aug 09 06:49:10 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:49:10 user nova-compute[72809]:     </video>
Aug 09 06:49:10 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:49:10 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:49:10 user nova-compute[72809]:     </rng>
Aug 09 06:49:10 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:49:10 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:49:10 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:49:10 user nova-compute[72809]:     </memballoon>
Aug 09 06:49:10 user nova-compute[72809]:   </devices>
Aug 09 06:49:10 user nova-compute[72809]: </domain>
Aug 09 06:49:10 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:49:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-493992988',display_name='tempest-AttachSCSIVolumeTestJSON-server-493992988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-493992988',id=8,image_ref='c8b380c1-a7f5-4edf-a8d1-9eb9c9d55d99',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrE53HHXO0BB9cGQQmYWr57bzydYK17tmKu/Ekiw43aOTdY6jytzp81sNcDlxfQsmahYFgfHg+B8Ei8R2HNS98nYNTK8swfvSms1Kv7NeUe+0LRsVu7/WMeNqUNdPrfGw==',key_name='tempest-keypair-1889486654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41de34302b6242b98f400b4f8e0cdb42',ramdisk_id='',reservation_id='r-j0fad72y',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c8b380c1-a7f5-4edf-a8d1-9eb9c9d55d99',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-551348959',owner_user_name='tempest-AttachSCSIVolumeTestJSON-551348959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:49:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1ae3672f60e49b199c926dc559cd1ce',uuid=80f694fb-e406-4b66-badc-f3686f3f1dc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "277509bc-7638-47e1-b28d-85a59fc5aa01", "address": "fa:16:3e:a4:5c:0f", "network": {"id": "bf108dce-d080-4820-bad9-7f930b8fb364", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1121464630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41de34302b6242b98f400b4f8e0cdb42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277509bc-76", "ovs_interfaceid": "277509bc-7638-47e1-b28d-85a59fc5aa01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Converting VIF {"id": "277509bc-7638-47e1-b28d-85a59fc5aa01", "address": "fa:16:3e:a4:5c:0f", "network": {"id": "bf108dce-d080-4820-bad9-7f930b8fb364", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1121464630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41de34302b6242b98f400b4f8e0cdb42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277509bc-76", "ovs_interfaceid": "277509bc-7638-47e1-b28d-85a59fc5aa01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:5c:0f,bridge_name='br-int',has_traffic_filtering=True,id=277509bc-7638-47e1-b28d-85a59fc5aa01,network=Network(bf108dce-d080-4820-bad9-7f930b8fb364),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap277509bc-76') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG os_vif [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:5c:0f,bridge_name='br-int',has_traffic_filtering=True,id=277509bc-7638-47e1-b28d-85a59fc5aa01,network=Network(bf108dce-d080-4820-bad9-7f930b8fb364),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap277509bc-76') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap277509bc-76, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap277509bc-76, col_values=(('external_ids', {'iface-id': '277509bc-7638-47e1-b28d-85a59fc5aa01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:5c:0f', 'vm-uuid': '80f694fb-e406-4b66-badc-f3686f3f1dc9'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:10 user nova-compute[72809]: INFO os_vif [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:5c:0f,bridge_name='br-int',has_traffic_filtering=True,id=277509bc-7638-47e1-b28d-85a59fc5aa01,network=Network(bf108dce-d080-4820-bad9-7f930b8fb364),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap277509bc-76')
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] No BDM found with device name sda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] No VIF found with MAC fa:16:3e:a4:5c:0f, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:49:10 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Using config drive
Aug 09 06:49:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.network.neutron [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Updating instance_info_cache with network_info: [{"id": "d83214ef-f913-4ab9-b9b5-4bcd171b1656", "address": "fa:16:3e:7b:70:28", "network": {"id": "9d98057f-37e6-42f0-9a94-2240979d38f4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-490582380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06d061b94c6548d88d8c3cae6751d937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd83214ef-f9", "ovs_interfaceid": "d83214ef-f913-4ab9-b9b5-4bcd171b1656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Releasing lock "refresh_cache-b64e7169-044c-4d0a-9ee5-f2914f1f5529" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.compute.manager [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Instance network_info: |[{"id": "d83214ef-f913-4ab9-b9b5-4bcd171b1656", "address": "fa:16:3e:7b:70:28", "network": {"id": "9d98057f-37e6-42f0-9a94-2240979d38f4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-490582380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06d061b94c6548d88d8c3cae6751d937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd83214ef-f9", "ovs_interfaceid": "d83214ef-f913-4ab9-b9b5-4bcd171b1656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Start _get_guest_xml network_info=[{"id": "d83214ef-f913-4ab9-b9b5-4bcd171b1656", "address": "fa:16:3e:7b:70:28", "network": {"id": "9d98057f-37e6-42f0-9a94-2240979d38f4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-490582380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06d061b94c6548d88d8c3cae6751d937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd83214ef-f9", "ovs_interfaceid": "d83214ef-f913-4ab9-b9b5-4bcd171b1656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:49:10 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:49:10 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-560642077',display_name='tempest-VolumesAdminNegativeTest-server-560642077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-560642077',id=6,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLkSAG5AK/BoN6SJjuI6pyRB/CdhDINWb1oNRFuASCnzT1E1AdotJc6Wp7P+GVE46MuMaQ+y16AC5HUbGTLCt93nj+QHFbC4+0wVe6tnKkOGZ8B7kxVVAd+dRL3ZNmhnA==',key_name='tempest-keypair-228576492',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06d061b94c6548d88d8c3cae6751d937',ramdisk_id='',reservation_id='r-2vyg439q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2043800207',owner_user_name='tempest-VolumesAdminNegativeTest-2043800207-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:49:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6cd5e6af221a4c0d996b4da1cce17f55',uuid=b64e7169-044c-4d0a-9ee5-f2914f1f5529,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d83214ef-f913-4ab9-b9b5-4bcd171b1656", "address": "fa:16:3e:7b:70:28", "network": {"id": "9d98057f-37e6-42f0-9a94-2240979d38f4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-490582380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06d061b94c6548d88d8c3cae6751d937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd83214ef-f9", "ovs_interfaceid": "d83214ef-f913-4ab9-b9b5-4bcd171b1656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Converting VIF {"id": "d83214ef-f913-4ab9-b9b5-4bcd171b1656", "address": "fa:16:3e:7b:70:28", "network": {"id": "9d98057f-37e6-42f0-9a94-2240979d38f4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-490582380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06d061b94c6548d88d8c3cae6751d937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd83214ef-f9", "ovs_interfaceid": "d83214ef-f913-4ab9-b9b5-4bcd171b1656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:70:28,bridge_name='br-int',has_traffic_filtering=True,id=d83214ef-f913-4ab9-b9b5-4bcd171b1656,network=Network(9d98057f-37e6-42f0-9a94-2240979d38f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd83214ef-f9') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.objects.instance [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lazy-loading 'pci_devices' on Instance uuid b64e7169-044c-4d0a-9ee5-f2914f1f5529 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:49:10 user nova-compute[72809]:   <uuid>b64e7169-044c-4d0a-9ee5-f2914f1f5529</uuid>
Aug 09 06:49:10 user nova-compute[72809]:   <name>instance-00000006</name>
Aug 09 06:49:10 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:49:10 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:49:10 user nova-compute[72809]:   <metadata>
Aug 09 06:49:10 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:49:10 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:49:10 user nova-compute[72809]:       <nova:name>tempest-VolumesAdminNegativeTest-server-560642077</nova:name>
Aug 09 06:49:10 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:49:10</nova:creationTime>
Aug 09 06:49:10 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:49:10 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:49:10 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:49:10 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:49:10 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:49:10 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:49:10 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:49:10 user nova-compute[72809]:       <nova:owner>
Aug 09 06:49:10 user nova-compute[72809]:         <nova:user uuid="6cd5e6af221a4c0d996b4da1cce17f55">tempest-VolumesAdminNegativeTest-2043800207-project-member</nova:user>
Aug 09 06:49:10 user nova-compute[72809]:         <nova:project uuid="06d061b94c6548d88d8c3cae6751d937">tempest-VolumesAdminNegativeTest-2043800207</nova:project>
Aug 09 06:49:10 user nova-compute[72809]:       </nova:owner>
Aug 09 06:49:10 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:49:10 user nova-compute[72809]:       <nova:ports>
Aug 09 06:49:10 user nova-compute[72809]:         <nova:port uuid="d83214ef-f913-4ab9-b9b5-4bcd171b1656">
Aug 09 06:49:10 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 06:49:10 user nova-compute[72809]:         </nova:port>
Aug 09 06:49:10 user nova-compute[72809]:       </nova:ports>
Aug 09 06:49:10 user nova-compute[72809]:     </nova:instance>
Aug 09 06:49:10 user nova-compute[72809]:   </metadata>
Aug 09 06:49:10 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:49:10 user nova-compute[72809]:     <system>
Aug 09 06:49:10 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:49:10 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:49:10 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:49:10 user nova-compute[72809]:       <entry name="serial">b64e7169-044c-4d0a-9ee5-f2914f1f5529</entry>
Aug 09 06:49:10 user nova-compute[72809]:       <entry name="uuid">b64e7169-044c-4d0a-9ee5-f2914f1f5529</entry>
Aug 09 06:49:10 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:49:10 user nova-compute[72809]:     </system>
Aug 09 06:49:10 user nova-compute[72809]:   </sysinfo>
Aug 09 06:49:10 user nova-compute[72809]:   <os>
Aug 09 06:49:10 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:49:10 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 06:49:10 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:49:10 user nova-compute[72809]:   </os>
Aug 09 06:49:10 user nova-compute[72809]:   <features>
Aug 09 06:49:10 user nova-compute[72809]:     <acpi/>
Aug 09 06:49:10 user nova-compute[72809]:     <apic/>
Aug 09 06:49:10 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:49:10 user nova-compute[72809]:   </features>
Aug 09 06:49:10 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:49:10 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:49:10 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:49:10 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:49:10 user nova-compute[72809]:   </clock>
Aug 09 06:49:10 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:49:10 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:49:10 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:49:10 user nova-compute[72809]:   </cpu>
Aug 09 06:49:10 user nova-compute[72809]:   <devices>
Aug 09 06:49:10 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:49:10 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:49:10 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk"/>
Aug 09 06:49:10 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:49:10 user nova-compute[72809]:     </disk>
Aug 09 06:49:10 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:49:10 user nova-compute[72809]:       <mac address="fa:16:3e:7b:70:28"/>
Aug 09 06:49:10 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:49:10 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:49:10 user nova-compute[72809]:       <target dev="tapd83214ef-f9"/>
Aug 09 06:49:10 user nova-compute[72809]:     </interface>
Aug 09 06:49:10 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:49:10 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/console.log" append="off"/>
Aug 09 06:49:10 user nova-compute[72809]:     </serial>
Aug 09 06:49:10 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:49:10 user nova-compute[72809]:     <video>
Aug 09 06:49:10 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:49:10 user nova-compute[72809]:     </video>
Aug 09 06:49:10 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:49:10 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:49:10 user nova-compute[72809]:     </rng>
Aug 09 06:49:10 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:49:10 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:49:10 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:49:10 user nova-compute[72809]:     </memballoon>
Aug 09 06:49:10 user nova-compute[72809]:   </devices>
Aug 09 06:49:10 user nova-compute[72809]: </domain>
Aug 09 06:49:10 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-560642077',display_name='tempest-VolumesAdminNegativeTest-server-560642077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-560642077',id=6,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLkSAG5AK/BoN6SJjuI6pyRB/CdhDINWb1oNRFuASCnzT1E1AdotJc6Wp7P+GVE46MuMaQ+y16AC5HUbGTLCt93nj+QHFbC4+0wVe6tnKkOGZ8B7kxVVAd+dRL3ZNmhnA==',key_name='tempest-keypair-228576492',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06d061b94c6548d88d8c3cae6751d937',ramdisk_id='',reservation_id='r-2vyg439q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2043800207',owner_user_name='tempest-VolumesAdminNegativeTest-2043800207-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:49:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6cd5e6af221a4c0d996b4da1cce17f55',uuid=b64e7169-044c-4d0a-9ee5-f2914f1f5529,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d83214ef-f913-4ab9-b9b5-4bcd171b1656", "address": "fa:16:3e:7b:70:28", "network": {"id": "9d98057f-37e6-42f0-9a94-2240979d38f4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-490582380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06d061b94c6548d88d8c3cae6751d937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd83214ef-f9", "ovs_interfaceid": "d83214ef-f913-4ab9-b9b5-4bcd171b1656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Converting VIF {"id": "d83214ef-f913-4ab9-b9b5-4bcd171b1656", "address": "fa:16:3e:7b:70:28", "network": {"id": "9d98057f-37e6-42f0-9a94-2240979d38f4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-490582380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06d061b94c6548d88d8c3cae6751d937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd83214ef-f9", "ovs_interfaceid": "d83214ef-f913-4ab9-b9b5-4bcd171b1656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:70:28,bridge_name='br-int',has_traffic_filtering=True,id=d83214ef-f913-4ab9-b9b5-4bcd171b1656,network=Network(9d98057f-37e6-42f0-9a94-2240979d38f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd83214ef-f9') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG os_vif [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:70:28,bridge_name='br-int',has_traffic_filtering=True,id=d83214ef-f913-4ab9-b9b5-4bcd171b1656,network=Network(9d98057f-37e6-42f0-9a94-2240979d38f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd83214ef-f9') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd83214ef-f9, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd83214ef-f9, col_values=(('external_ids', {'iface-id': 'd83214ef-f913-4ab9-b9b5-4bcd171b1656', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:70:28', 'vm-uuid': 'b64e7169-044c-4d0a-9ee5-f2914f1f5529'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:10 user nova-compute[72809]: INFO os_vif [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:70:28,bridge_name='br-int',has_traffic_filtering=True,id=d83214ef-f913-4ab9-b9b5-4bcd171b1656,network=Network(9d98057f-37e6-42f0-9a94-2240979d38f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd83214ef-f9')
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.network.neutron [req-f5fbe652-f9b5-4c30-8f68-9217265abf60 req-3f83fd41-37b2-4085-bbb0-ed1b4cef8d50 service nova] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Updated VIF entry in instance network info cache for port 277509bc-7638-47e1-b28d-85a59fc5aa01. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:49:10 user nova-compute[72809]: DEBUG nova.network.neutron [req-f5fbe652-f9b5-4c30-8f68-9217265abf60 req-3f83fd41-37b2-4085-bbb0-ed1b4cef8d50 service nova] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Updating instance_info_cache with network_info: [{"id": "277509bc-7638-47e1-b28d-85a59fc5aa01", "address": "fa:16:3e:a4:5c:0f", "network": {"id": "bf108dce-d080-4820-bad9-7f930b8fb364", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1121464630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41de34302b6242b98f400b4f8e0cdb42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277509bc-76", "ovs_interfaceid": "277509bc-7638-47e1-b28d-85a59fc5aa01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:49:11 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Creating config drive at /opt/stack/data/nova/instances/80f694fb-e406-4b66-badc-f3686f3f1dc9/disk.config
Aug 09 06:49:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/80f694fb-e406-4b66-badc-f3686f3f1dc9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmphvw9up_p {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f5fbe652-f9b5-4c30-8f68-9217265abf60 req-3f83fd41-37b2-4085-bbb0-ed1b4cef8d50 service nova] Releasing lock "refresh_cache-80f694fb-e406-4b66-badc-f3686f3f1dc9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:49:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/80f694fb-e406-4b66-badc-f3686f3f1dc9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmphvw9up_p" returned: 0 in 0.105s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:11 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:49:11 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] No VIF found with MAC fa:16:3e:7b:70:28, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:49:11 user nova-compute[72809]: DEBUG nova.compute.manager [req-3207c61d-130e-4477-81ce-1ea8906ff355 req-09a9e5a5-0b12-4ae2-baa6-f4312071b99c service nova] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Received event network-vif-plugged-664d7e69-c8c7-4ee9-980f-f58f8c8871b8 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:49:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3207c61d-130e-4477-81ce-1ea8906ff355 req-09a9e5a5-0b12-4ae2-baa6-f4312071b99c service nova] Acquiring lock "b9b69c9e-f91d-4681-a53b-2f0fc4b13532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:49:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3207c61d-130e-4477-81ce-1ea8906ff355 req-09a9e5a5-0b12-4ae2-baa6-f4312071b99c service nova] Lock "b9b69c9e-f91d-4681-a53b-2f0fc4b13532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:49:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3207c61d-130e-4477-81ce-1ea8906ff355 req-09a9e5a5-0b12-4ae2-baa6-f4312071b99c service nova] Lock "b9b69c9e-f91d-4681-a53b-2f0fc4b13532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:11 user nova-compute[72809]: DEBUG nova.compute.manager [req-3207c61d-130e-4477-81ce-1ea8906ff355 req-09a9e5a5-0b12-4ae2-baa6-f4312071b99c service nova] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] No waiting events found dispatching network-vif-plugged-664d7e69-c8c7-4ee9-980f-f58f8c8871b8 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:49:11 user nova-compute[72809]: WARNING nova.compute.manager [req-3207c61d-130e-4477-81ce-1ea8906ff355 req-09a9e5a5-0b12-4ae2-baa6-f4312071b99c service nova] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Received unexpected event network-vif-plugged-664d7e69-c8c7-4ee9-980f-f58f8c8871b8 for instance with vm_state building and task_state spawning.
Aug 09 06:49:11 user nova-compute[72809]: DEBUG nova.compute.manager [req-3207c61d-130e-4477-81ce-1ea8906ff355 req-09a9e5a5-0b12-4ae2-baa6-f4312071b99c service nova] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Received event network-vif-plugged-861ed195-01ae-4b1b-8a9f-3464eedeebdc {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:49:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3207c61d-130e-4477-81ce-1ea8906ff355 req-09a9e5a5-0b12-4ae2-baa6-f4312071b99c service nova] Acquiring lock "8a6a74bc-2e97-4248-8b82-abb54ff4cc83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:49:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3207c61d-130e-4477-81ce-1ea8906ff355 req-09a9e5a5-0b12-4ae2-baa6-f4312071b99c service nova] Lock "8a6a74bc-2e97-4248-8b82-abb54ff4cc83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:49:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3207c61d-130e-4477-81ce-1ea8906ff355 req-09a9e5a5-0b12-4ae2-baa6-f4312071b99c service nova] Lock "8a6a74bc-2e97-4248-8b82-abb54ff4cc83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:11 user nova-compute[72809]: DEBUG nova.compute.manager [req-3207c61d-130e-4477-81ce-1ea8906ff355 req-09a9e5a5-0b12-4ae2-baa6-f4312071b99c service nova] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] No waiting events found dispatching network-vif-plugged-861ed195-01ae-4b1b-8a9f-3464eedeebdc {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:49:11 user nova-compute[72809]: WARNING nova.compute.manager [req-3207c61d-130e-4477-81ce-1ea8906ff355 req-09a9e5a5-0b12-4ae2-baa6-f4312071b99c service nova] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Received unexpected event network-vif-plugged-861ed195-01ae-4b1b-8a9f-3464eedeebdc for instance with vm_state building and task_state spawning.
Aug 09 06:49:11 user nova-compute[72809]: DEBUG nova.compute.manager [req-3207c61d-130e-4477-81ce-1ea8906ff355 req-09a9e5a5-0b12-4ae2-baa6-f4312071b99c service nova] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Received event network-vif-plugged-861ed195-01ae-4b1b-8a9f-3464eedeebdc {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:49:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3207c61d-130e-4477-81ce-1ea8906ff355 req-09a9e5a5-0b12-4ae2-baa6-f4312071b99c service nova] Acquiring lock "8a6a74bc-2e97-4248-8b82-abb54ff4cc83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:49:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3207c61d-130e-4477-81ce-1ea8906ff355 req-09a9e5a5-0b12-4ae2-baa6-f4312071b99c service nova] Lock "8a6a74bc-2e97-4248-8b82-abb54ff4cc83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:49:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3207c61d-130e-4477-81ce-1ea8906ff355 req-09a9e5a5-0b12-4ae2-baa6-f4312071b99c service nova] Lock "8a6a74bc-2e97-4248-8b82-abb54ff4cc83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:12 user nova-compute[72809]: DEBUG nova.compute.manager [req-3207c61d-130e-4477-81ce-1ea8906ff355 req-09a9e5a5-0b12-4ae2-baa6-f4312071b99c service nova] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] No waiting events found dispatching network-vif-plugged-861ed195-01ae-4b1b-8a9f-3464eedeebdc {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:49:12 user nova-compute[72809]: WARNING nova.compute.manager [req-3207c61d-130e-4477-81ce-1ea8906ff355 req-09a9e5a5-0b12-4ae2-baa6-f4312071b99c service nova] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Received unexpected event network-vif-plugged-861ed195-01ae-4b1b-8a9f-3464eedeebdc for instance with vm_state building and task_state spawning.
Aug 09 06:49:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:12 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563752.6676214, b9b69c9e-f91d-4681-a53b-2f0fc4b13532 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:49:12 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] VM Resumed (Lifecycle Event)
Aug 09 06:49:12 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:49:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 06:49:12 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:49:12 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Instance spawned successfully.
Aug 09 06:49:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 06:49:12 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:49:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:49:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:49:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:49:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:49:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:49:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:49:12 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:49:12 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563752.668284, b9b69c9e-f91d-4681-a53b-2f0fc4b13532 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:49:12 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] VM Started (Lifecycle Event)
Aug 09 06:49:12 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:49:12 user nova-compute[72809]: DEBUG nova.compute.manager [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:49:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 06:49:12 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:49:12 user nova-compute[72809]: INFO nova.compute.manager [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Took 15.78 seconds to spawn the instance on the hypervisor.
Aug 09 06:49:12 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:49:12 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Instance spawned successfully.
Aug 09 06:49:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 06:49:12 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:49:12 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563752.854889, 8a6a74bc-2e97-4248-8b82-abb54ff4cc83 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:49:12 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] VM Resumed (Lifecycle Event)
Aug 09 06:49:12 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:49:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:49:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:49:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:49:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:49:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:49:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:49:13 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:49:13 user nova-compute[72809]: INFO nova.compute.manager [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Took 17.25 seconds to build instance.
Aug 09 06:49:13 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:49:13 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563752.8597987, 8a6a74bc-2e97-4248-8b82-abb54ff4cc83 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:49:13 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] VM Started (Lifecycle Event)
Aug 09 06:49:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ea41cd43-4e5a-42ca-a866-c81f6553f9e5 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Lock "b9b69c9e-f91d-4681-a53b-2f0fc4b13532" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.393s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:13 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:49:13 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:49:13 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:49:13 user nova-compute[72809]: INFO nova.compute.manager [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Took 10.22 seconds to spawn the instance on the hypervisor.
Aug 09 06:49:13 user nova-compute[72809]: DEBUG nova.compute.manager [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:49:13 user nova-compute[72809]: INFO nova.compute.manager [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Took 12.09 seconds to build instance.
Aug 09 06:49:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-71518832-1732-494a-98a5-f1f51be19fdc tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Lock "8a6a74bc-2e97-4248-8b82-abb54ff4cc83" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.333s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:14 user nova-compute[72809]: DEBUG nova.compute.manager [req-55ec4cd0-f44c-4bec-b761-435877b725cc req-1f84b304-f182-4c91-a923-48d3c656b92d service nova] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Received event network-vif-plugged-277509bc-7638-47e1-b28d-85a59fc5aa01 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:49:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-55ec4cd0-f44c-4bec-b761-435877b725cc req-1f84b304-f182-4c91-a923-48d3c656b92d service nova] Acquiring lock "80f694fb-e406-4b66-badc-f3686f3f1dc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:49:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-55ec4cd0-f44c-4bec-b761-435877b725cc req-1f84b304-f182-4c91-a923-48d3c656b92d service nova] Lock "80f694fb-e406-4b66-badc-f3686f3f1dc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:49:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-55ec4cd0-f44c-4bec-b761-435877b725cc req-1f84b304-f182-4c91-a923-48d3c656b92d service nova] Lock "80f694fb-e406-4b66-badc-f3686f3f1dc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:14 user nova-compute[72809]: DEBUG nova.compute.manager [req-55ec4cd0-f44c-4bec-b761-435877b725cc req-1f84b304-f182-4c91-a923-48d3c656b92d service nova] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] No waiting events found dispatching network-vif-plugged-277509bc-7638-47e1-b28d-85a59fc5aa01 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:49:14 user nova-compute[72809]: WARNING nova.compute.manager [req-55ec4cd0-f44c-4bec-b761-435877b725cc req-1f84b304-f182-4c91-a923-48d3c656b92d service nova] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Received unexpected event network-vif-plugged-277509bc-7638-47e1-b28d-85a59fc5aa01 for instance with vm_state building and task_state spawning.
Aug 09 06:49:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:16 user nova-compute[72809]: DEBUG nova.compute.manager [req-09f0a2c1-4489-47e1-8488-977f1d395b6d req-27545a86-1e4e-4892-b6ed-9acaf20f7f72 service nova] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Received event network-vif-plugged-277509bc-7638-47e1-b28d-85a59fc5aa01 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:49:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-09f0a2c1-4489-47e1-8488-977f1d395b6d req-27545a86-1e4e-4892-b6ed-9acaf20f7f72 service nova] Acquiring lock "80f694fb-e406-4b66-badc-f3686f3f1dc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:49:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-09f0a2c1-4489-47e1-8488-977f1d395b6d req-27545a86-1e4e-4892-b6ed-9acaf20f7f72 service nova] Lock "80f694fb-e406-4b66-badc-f3686f3f1dc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:49:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-09f0a2c1-4489-47e1-8488-977f1d395b6d req-27545a86-1e4e-4892-b6ed-9acaf20f7f72 service nova] Lock "80f694fb-e406-4b66-badc-f3686f3f1dc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:16 user nova-compute[72809]: DEBUG nova.compute.manager [req-09f0a2c1-4489-47e1-8488-977f1d395b6d req-27545a86-1e4e-4892-b6ed-9acaf20f7f72 service nova] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] No waiting events found dispatching network-vif-plugged-277509bc-7638-47e1-b28d-85a59fc5aa01 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:49:16 user nova-compute[72809]: WARNING nova.compute.manager [req-09f0a2c1-4489-47e1-8488-977f1d395b6d req-27545a86-1e4e-4892-b6ed-9acaf20f7f72 service nova] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Received unexpected event network-vif-plugged-277509bc-7638-47e1-b28d-85a59fc5aa01 for instance with vm_state building and task_state spawning.
Aug 09 06:49:16 user nova-compute[72809]: DEBUG nova.compute.manager [req-09f0a2c1-4489-47e1-8488-977f1d395b6d req-27545a86-1e4e-4892-b6ed-9acaf20f7f72 service nova] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Received event network-vif-plugged-d83214ef-f913-4ab9-b9b5-4bcd171b1656 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:49:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-09f0a2c1-4489-47e1-8488-977f1d395b6d req-27545a86-1e4e-4892-b6ed-9acaf20f7f72 service nova] Acquiring lock "b64e7169-044c-4d0a-9ee5-f2914f1f5529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:49:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-09f0a2c1-4489-47e1-8488-977f1d395b6d req-27545a86-1e4e-4892-b6ed-9acaf20f7f72 service nova] Lock "b64e7169-044c-4d0a-9ee5-f2914f1f5529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:49:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-09f0a2c1-4489-47e1-8488-977f1d395b6d req-27545a86-1e4e-4892-b6ed-9acaf20f7f72 service nova] Lock "b64e7169-044c-4d0a-9ee5-f2914f1f5529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:16 user nova-compute[72809]: DEBUG nova.compute.manager [req-09f0a2c1-4489-47e1-8488-977f1d395b6d req-27545a86-1e4e-4892-b6ed-9acaf20f7f72 service nova] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] No waiting events found dispatching network-vif-plugged-d83214ef-f913-4ab9-b9b5-4bcd171b1656 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:49:16 user nova-compute[72809]: WARNING nova.compute.manager [req-09f0a2c1-4489-47e1-8488-977f1d395b6d req-27545a86-1e4e-4892-b6ed-9acaf20f7f72 service nova] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Received unexpected event network-vif-plugged-d83214ef-f913-4ab9-b9b5-4bcd171b1656 for instance with vm_state building and task_state spawning.
Aug 09 06:49:16 user nova-compute[72809]: DEBUG nova.compute.manager [req-09f0a2c1-4489-47e1-8488-977f1d395b6d req-27545a86-1e4e-4892-b6ed-9acaf20f7f72 service nova] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Received event network-vif-plugged-d83214ef-f913-4ab9-b9b5-4bcd171b1656 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:49:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-09f0a2c1-4489-47e1-8488-977f1d395b6d req-27545a86-1e4e-4892-b6ed-9acaf20f7f72 service nova] Acquiring lock "b64e7169-044c-4d0a-9ee5-f2914f1f5529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:49:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-09f0a2c1-4489-47e1-8488-977f1d395b6d req-27545a86-1e4e-4892-b6ed-9acaf20f7f72 service nova] Lock "b64e7169-044c-4d0a-9ee5-f2914f1f5529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:49:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-09f0a2c1-4489-47e1-8488-977f1d395b6d req-27545a86-1e4e-4892-b6ed-9acaf20f7f72 service nova] Lock "b64e7169-044c-4d0a-9ee5-f2914f1f5529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:16 user nova-compute[72809]: DEBUG nova.compute.manager [req-09f0a2c1-4489-47e1-8488-977f1d395b6d req-27545a86-1e4e-4892-b6ed-9acaf20f7f72 service nova] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] No waiting events found dispatching network-vif-plugged-d83214ef-f913-4ab9-b9b5-4bcd171b1656 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:49:16 user nova-compute[72809]: WARNING nova.compute.manager [req-09f0a2c1-4489-47e1-8488-977f1d395b6d req-27545a86-1e4e-4892-b6ed-9acaf20f7f72 service nova] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Received unexpected event network-vif-plugged-d83214ef-f913-4ab9-b9b5-4bcd171b1656 for instance with vm_state building and task_state spawning.
Aug 09 06:49:17 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563757.6091774, 80f694fb-e406-4b66-badc-f3686f3f1dc9 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:49:17 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] VM Resumed (Lifecycle Event)
Aug 09 06:49:17 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:49:17 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 06:49:17 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Instance spawned successfully.
Aug 09 06:49:17 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 06:49:17 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:49:17 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:49:17 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:49:17 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:49:17 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:49:17 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:49:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:17 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:49:17 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563757.610603, 80f694fb-e406-4b66-badc-f3686f3f1dc9 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:49:17 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] VM Started (Lifecycle Event)
Aug 09 06:49:17 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:49:17 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:49:17 user nova-compute[72809]: DEBUG nova.compute.manager [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:49:17 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 06:49:17 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Instance spawned successfully.
Aug 09 06:49:17 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 06:49:17 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:49:17 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563757.7464368, b64e7169-044c-4d0a-9ee5-f2914f1f5529 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:49:17 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] VM Resumed (Lifecycle Event)
Aug 09 06:49:17 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:49:17 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:49:17 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:49:17 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:49:17 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:49:17 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:49:17 user nova-compute[72809]: INFO nova.compute.manager [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Took 10.95 seconds to spawn the instance on the hypervisor.
Aug 09 06:49:17 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:49:17 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:49:17 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:49:17 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:49:17 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563757.747709, b64e7169-044c-4d0a-9ee5-f2914f1f5529 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:49:17 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] VM Started (Lifecycle Event)
Aug 09 06:49:17 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:49:17 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:49:17 user nova-compute[72809]: INFO nova.compute.manager [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Took 17.57 seconds to spawn the instance on the hypervisor.
Aug 09 06:49:17 user nova-compute[72809]: DEBUG nova.compute.manager [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:49:17 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:49:18 user nova-compute[72809]: INFO nova.compute.manager [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Took 12.41 seconds to build instance.
Aug 09 06:49:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bedaa306-6ecc-4bd6-beb9-61be63096ea8 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lock "80f694fb-e406-4b66-badc-f3686f3f1dc9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.781s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:18 user nova-compute[72809]: INFO nova.compute.manager [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Took 18.90 seconds to build instance.
Aug 09 06:49:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cd28e880-c7f8-4f0d-bffa-c2e56d8ae28f tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "b64e7169-044c-4d0a-9ee5-f2914f1f5529" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.081s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:20 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:21 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:49:21 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Cleaning up deleted instances {{(pid=72809) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 06:49:21 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] There are 0 instances to clean {{(pid=72809) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 06:49:21 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:49:21 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72809) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 06:49:21 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:49:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:22 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:49:24 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:49:24 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 06:49:24 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Rebuilding the list of instances to heal {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 06:49:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-f647a50e-ee90-480a-ad5d-68f1782628d9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:49:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-f647a50e-ee90-480a-ad5d-68f1782628d9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:49:24 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 06:49:24 user nova-compute[72809]: DEBUG nova.objects.instance [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lazy-loading 'info_cache' on Instance uuid f647a50e-ee90-480a-ad5d-68f1782628d9 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:49:25 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Updating instance_info_cache with network_info: [{"id": "3554b93c-4cee-4835-980f-413908f76f98", "address": "fa:16:3e:d2:c2:42", "network": {"id": "c3574890-d7f0-44ba-8d4c-eb378ab1c691", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-307148854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3636086472e14f9099379775a9321b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3554b93c-4c", "ovs_interfaceid": "3554b93c-4cee-4835-980f-413908f76f98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:49:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-f647a50e-ee90-480a-ad5d-68f1782628d9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:49:25 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 06:49:25 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:49:25 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:49:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:49:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:49:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:25 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 06:49:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f647a50e-ee90-480a-ad5d-68f1782628d9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f647a50e-ee90-480a-ad5d-68f1782628d9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f647a50e-ee90-480a-ad5d-68f1782628d9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f647a50e-ee90-480a-ad5d-68f1782628d9/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f694fb-e406-4b66-badc-f3686f3f1dc9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f694fb-e406-4b66-badc-f3686f3f1dc9/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f694fb-e406-4b66-badc-f3686f3f1dc9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f694fb-e406-4b66-badc-f3686f3f1dc9/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a6a74bc-2e97-4248-8b82-abb54ff4cc83/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a6a74bc-2e97-4248-8b82-abb54ff4cc83/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a6a74bc-2e97-4248-8b82-abb54ff4cc83/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Acquiring lock "d16ad749-f432-43e8-a5f9-96158a4308cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:49:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Lock "d16ad749-f432-43e8-a5f9-96158a4308cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:49:28 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 06:49:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a6a74bc-2e97-4248-8b82-abb54ff4cc83/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:49:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:49:29 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 06:49:29 user nova-compute[72809]: INFO nova.compute.claims [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Claim successful on node user
Aug 09 06:49:29 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:49:29 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:49:29 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=7449MB free_disk=25.76837158203125GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 06:49:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:49:29 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:49:29 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.464s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 06:49:30 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 06:49:30 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance f647a50e-ee90-480a-ad5d-68f1782628d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 24ba9b41-d0bf-4a84-9f04-bfda9525b154 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 3640991e-8a5b-4674-af81-3117d4269a68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 15dda080-3487-4316-ab7b-f7185f0a4519 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance b9b69c9e-f91d-4681-a53b-2f0fc4b13532 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance b64e7169-044c-4d0a-9ee5-f2914f1f5529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 8a6a74bc-2e97-4248-8b82-abb54ff4cc83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 80f694fb-e406-4b66-badc-f3686f3f1dc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance d16ad749-f432-43e8-a5f9-96158a4308cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 06:49:30 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Creating image(s)
Aug 09 06:49:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Acquiring lock "/opt/stack/data/nova/instances/d16ad749-f432-43e8-a5f9-96158a4308cf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Lock "/opt/stack/data/nova/instances/d16ad749-f432-43e8-a5f9-96158a4308cf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Lock "/opt/stack/data/nova/instances/d16ad749-f432-43e8-a5f9-96158a4308cf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.139s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG nova.policy [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a8e71430bacd407ea07e7d7e36e5c748', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6ea5a7ad1f4383b077e151035a073a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.158s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/d16ad749-f432-43e8-a5f9-96158a4308cf/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/d16ad749-f432-43e8-a5f9-96158a4308cf/disk 1073741824" returned: 0 in 0.052s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.149s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d16ad749-f432-43e8-a5f9-96158a4308cf/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16ad749-f432-43e8-a5f9-96158a4308cf/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.892s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 06:49:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16ad749-f432-43e8-a5f9-96158a4308cf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:31 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Cannot resize image /opt/stack/data/nova/instances/d16ad749-f432-43e8-a5f9-96158a4308cf/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 06:49:31 user nova-compute[72809]: DEBUG nova.objects.instance [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Lazy-loading 'migration_context' on Instance uuid d16ad749-f432-43e8-a5f9-96158a4308cf {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:49:31 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 06:49:31 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Ensure instance console log exists: /opt/stack/data/nova/instances/d16ad749-f432-43e8-a5f9-96158a4308cf/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 06:49:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:49:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:49:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:31 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Successfully created port: d551bda7-293c-42a4-b9b6-1d615735311a {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Successfully updated port: d551bda7-293c-42a4-b9b6-1d615735311a {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Acquiring lock "refresh_cache-d16ad749-f432-43e8-a5f9-96158a4308cf" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Acquired lock "refresh_cache-d16ad749-f432-43e8-a5f9-96158a4308cf" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.compute.manager [req-81fd6bf3-78f9-4685-85bf-55f5a883f6a0 req-4ac55160-b94c-4b09-8577-c626fcf93adb service nova] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Received event network-changed-d551bda7-293c-42a4-b9b6-1d615735311a {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.compute.manager [req-81fd6bf3-78f9-4685-85bf-55f5a883f6a0 req-4ac55160-b94c-4b09-8577-c626fcf93adb service nova] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Refreshing instance network info cache due to event network-changed-d551bda7-293c-42a4-b9b6-1d615735311a. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-81fd6bf3-78f9-4685-85bf-55f5a883f6a0 req-4ac55160-b94c-4b09-8577-c626fcf93adb service nova] Acquiring lock "refresh_cache-d16ad749-f432-43e8-a5f9-96158a4308cf" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Updating instance_info_cache with network_info: [{"id": "d551bda7-293c-42a4-b9b6-1d615735311a", "address": "fa:16:3e:33:c7:2c", "network": {"id": "80829c7c-8ba2-4c90-8504-425cf4b5ac8a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1295da1a81a44fec9e3e3e20732a553c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd551bda7-29", "ovs_interfaceid": "d551bda7-293c-42a4-b9b6-1d615735311a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Releasing lock "refresh_cache-d16ad749-f432-43e8-a5f9-96158a4308cf" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Instance network_info: |[{"id": "d551bda7-293c-42a4-b9b6-1d615735311a", "address": "fa:16:3e:33:c7:2c", "network": {"id": "80829c7c-8ba2-4c90-8504-425cf4b5ac8a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1295da1a81a44fec9e3e3e20732a553c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd551bda7-29", "ovs_interfaceid": "d551bda7-293c-42a4-b9b6-1d615735311a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-81fd6bf3-78f9-4685-85bf-55f5a883f6a0 req-4ac55160-b94c-4b09-8577-c626fcf93adb service nova] Acquired lock "refresh_cache-d16ad749-f432-43e8-a5f9-96158a4308cf" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.network.neutron [req-81fd6bf3-78f9-4685-85bf-55f5a883f6a0 req-4ac55160-b94c-4b09-8577-c626fcf93adb service nova] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Refreshing network info cache for port d551bda7-293c-42a4-b9b6-1d615735311a {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Start _get_guest_xml network_info=[{"id": "d551bda7-293c-42a4-b9b6-1d615735311a", "address": "fa:16:3e:33:c7:2c", "network": {"id": "80829c7c-8ba2-4c90-8504-425cf4b5ac8a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1295da1a81a44fec9e3e3e20732a553c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd551bda7-29", "ovs_interfaceid": "d551bda7-293c-42a4-b9b6-1d615735311a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:49:32 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:49:32 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:49:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-691523299',display_name='tempest-VolumesNegativeTest-instance-691523299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-691523299',id=9,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af6ea5a7ad1f4383b077e151035a073a',ramdisk_id='',reservation_id='r-b3s4z73d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1069937085',owner_user_name='tempest-VolumesNegativeTest-1069937085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:49:30Z,user_data=None,user_id='a8e71430bacd407ea07e7d7e36e5c748',uuid=d16ad749-f432-43e8-a5f9-96158a4308cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d551bda7-293c-42a4-b9b6-1d615735311a", "address": "fa:16:3e:33:c7:2c", "network": {"id": "80829c7c-8ba2-4c90-8504-425cf4b5ac8a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1295da1a81a44fec9e3e3e20732a553c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd551bda7-29", "ovs_interfaceid": "d551bda7-293c-42a4-b9b6-1d615735311a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Converting VIF {"id": "d551bda7-293c-42a4-b9b6-1d615735311a", "address": "fa:16:3e:33:c7:2c", "network": {"id": "80829c7c-8ba2-4c90-8504-425cf4b5ac8a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1295da1a81a44fec9e3e3e20732a553c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd551bda7-29", "ovs_interfaceid": "d551bda7-293c-42a4-b9b6-1d615735311a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:c7:2c,bridge_name='br-int',has_traffic_filtering=True,id=d551bda7-293c-42a4-b9b6-1d615735311a,network=Network(80829c7c-8ba2-4c90-8504-425cf4b5ac8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd551bda7-29') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.objects.instance [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Lazy-loading 'pci_devices' on Instance uuid d16ad749-f432-43e8-a5f9-96158a4308cf {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:49:32 user nova-compute[72809]:   <uuid>d16ad749-f432-43e8-a5f9-96158a4308cf</uuid>
Aug 09 06:49:32 user nova-compute[72809]:   <name>instance-00000009</name>
Aug 09 06:49:32 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:49:32 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:49:32 user nova-compute[72809]:   <metadata>
Aug 09 06:49:32 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:49:32 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:49:32 user nova-compute[72809]:       <nova:name>tempest-VolumesNegativeTest-instance-691523299</nova:name>
Aug 09 06:49:32 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:49:32</nova:creationTime>
Aug 09 06:49:32 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:49:32 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:49:32 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:49:32 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:49:32 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:49:32 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:49:32 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:49:32 user nova-compute[72809]:       <nova:owner>
Aug 09 06:49:32 user nova-compute[72809]:         <nova:user uuid="a8e71430bacd407ea07e7d7e36e5c748">tempest-VolumesNegativeTest-1069937085-project-member</nova:user>
Aug 09 06:49:32 user nova-compute[72809]:         <nova:project uuid="af6ea5a7ad1f4383b077e151035a073a">tempest-VolumesNegativeTest-1069937085</nova:project>
Aug 09 06:49:32 user nova-compute[72809]:       </nova:owner>
Aug 09 06:49:32 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:49:32 user nova-compute[72809]:       <nova:ports>
Aug 09 06:49:32 user nova-compute[72809]:         <nova:port uuid="d551bda7-293c-42a4-b9b6-1d615735311a">
Aug 09 06:49:32 user nova-compute[72809]:           <nova:ip type="fixed" address="192.168.233.24" ipVersion="4"/>
Aug 09 06:49:32 user nova-compute[72809]:         </nova:port>
Aug 09 06:49:32 user nova-compute[72809]:       </nova:ports>
Aug 09 06:49:32 user nova-compute[72809]:     </nova:instance>
Aug 09 06:49:32 user nova-compute[72809]:   </metadata>
Aug 09 06:49:32 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:49:32 user nova-compute[72809]:     <system>
Aug 09 06:49:32 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:49:32 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:49:32 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:49:32 user nova-compute[72809]:       <entry name="serial">d16ad749-f432-43e8-a5f9-96158a4308cf</entry>
Aug 09 06:49:32 user nova-compute[72809]:       <entry name="uuid">d16ad749-f432-43e8-a5f9-96158a4308cf</entry>
Aug 09 06:49:32 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:49:32 user nova-compute[72809]:     </system>
Aug 09 06:49:32 user nova-compute[72809]:   </sysinfo>
Aug 09 06:49:32 user nova-compute[72809]:   <os>
Aug 09 06:49:32 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:49:32 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 06:49:32 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:49:32 user nova-compute[72809]:   </os>
Aug 09 06:49:32 user nova-compute[72809]:   <features>
Aug 09 06:49:32 user nova-compute[72809]:     <acpi/>
Aug 09 06:49:32 user nova-compute[72809]:     <apic/>
Aug 09 06:49:32 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:49:32 user nova-compute[72809]:   </features>
Aug 09 06:49:32 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:49:32 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:49:32 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:49:32 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:49:32 user nova-compute[72809]:   </clock>
Aug 09 06:49:32 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:49:32 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:49:32 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:49:32 user nova-compute[72809]:   </cpu>
Aug 09 06:49:32 user nova-compute[72809]:   <devices>
Aug 09 06:49:32 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:49:32 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:49:32 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/d16ad749-f432-43e8-a5f9-96158a4308cf/disk"/>
Aug 09 06:49:32 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:49:32 user nova-compute[72809]:     </disk>
Aug 09 06:49:32 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:49:32 user nova-compute[72809]:       <mac address="fa:16:3e:33:c7:2c"/>
Aug 09 06:49:32 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:49:32 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:49:32 user nova-compute[72809]:       <target dev="tapd551bda7-29"/>
Aug 09 06:49:32 user nova-compute[72809]:     </interface>
Aug 09 06:49:32 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:49:32 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/d16ad749-f432-43e8-a5f9-96158a4308cf/console.log" append="off"/>
Aug 09 06:49:32 user nova-compute[72809]:     </serial>
Aug 09 06:49:32 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:49:32 user nova-compute[72809]:     <video>
Aug 09 06:49:32 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:49:32 user nova-compute[72809]:     </video>
Aug 09 06:49:32 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:49:32 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:49:32 user nova-compute[72809]:     </rng>
Aug 09 06:49:32 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:49:32 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:49:32 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:49:32 user nova-compute[72809]:     </memballoon>
Aug 09 06:49:32 user nova-compute[72809]:   </devices>
Aug 09 06:49:32 user nova-compute[72809]: </domain>
Aug 09 06:49:32 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:49:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-691523299',display_name='tempest-VolumesNegativeTest-instance-691523299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-691523299',id=9,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af6ea5a7ad1f4383b077e151035a073a',ramdisk_id='',reservation_id='r-b3s4z73d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1069937085',owner_user_name='tempest-VolumesNegativeTest-1069937085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:49:30Z,user_data=None,user_id='a8e71430bacd407ea07e7d7e36e5c748',uuid=d16ad749-f432-43e8-a5f9-96158a4308cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d551bda7-293c-42a4-b9b6-1d615735311a", "address": "fa:16:3e:33:c7:2c", "network": {"id": "80829c7c-8ba2-4c90-8504-425cf4b5ac8a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1295da1a81a44fec9e3e3e20732a553c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd551bda7-29", "ovs_interfaceid": "d551bda7-293c-42a4-b9b6-1d615735311a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Converting VIF {"id": "d551bda7-293c-42a4-b9b6-1d615735311a", "address": "fa:16:3e:33:c7:2c", "network": {"id": "80829c7c-8ba2-4c90-8504-425cf4b5ac8a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1295da1a81a44fec9e3e3e20732a553c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd551bda7-29", "ovs_interfaceid": "d551bda7-293c-42a4-b9b6-1d615735311a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:c7:2c,bridge_name='br-int',has_traffic_filtering=True,id=d551bda7-293c-42a4-b9b6-1d615735311a,network=Network(80829c7c-8ba2-4c90-8504-425cf4b5ac8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd551bda7-29') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG os_vif [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:c7:2c,bridge_name='br-int',has_traffic_filtering=True,id=d551bda7-293c-42a4-b9b6-1d615735311a,network=Network(80829c7c-8ba2-4c90-8504-425cf4b5ac8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd551bda7-29') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd551bda7-29, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd551bda7-29, col_values=(('external_ids', {'iface-id': 'd551bda7-293c-42a4-b9b6-1d615735311a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:c7:2c', 'vm-uuid': 'd16ad749-f432-43e8-a5f9-96158a4308cf'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:32 user nova-compute[72809]: INFO os_vif [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:c7:2c,bridge_name='br-int',has_traffic_filtering=True,id=d551bda7-293c-42a4-b9b6-1d615735311a,network=Network(80829c7c-8ba2-4c90-8504-425cf4b5ac8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd551bda7-29')
Aug 09 06:49:32 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:49:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] No VIF found with MAC fa:16:3e:33:c7:2c, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:49:33 user nova-compute[72809]: DEBUG nova.network.neutron [req-81fd6bf3-78f9-4685-85bf-55f5a883f6a0 req-4ac55160-b94c-4b09-8577-c626fcf93adb service nova] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Updated VIF entry in instance network info cache for port d551bda7-293c-42a4-b9b6-1d615735311a. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:49:33 user nova-compute[72809]: DEBUG nova.network.neutron [req-81fd6bf3-78f9-4685-85bf-55f5a883f6a0 req-4ac55160-b94c-4b09-8577-c626fcf93adb service nova] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Updating instance_info_cache with network_info: [{"id": "d551bda7-293c-42a4-b9b6-1d615735311a", "address": "fa:16:3e:33:c7:2c", "network": {"id": "80829c7c-8ba2-4c90-8504-425cf4b5ac8a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1295da1a81a44fec9e3e3e20732a553c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd551bda7-29", "ovs_interfaceid": "d551bda7-293c-42a4-b9b6-1d615735311a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:49:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-81fd6bf3-78f9-4685-85bf-55f5a883f6a0 req-4ac55160-b94c-4b09-8577-c626fcf93adb service nova] Releasing lock "refresh_cache-d16ad749-f432-43e8-a5f9-96158a4308cf" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:49:34 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:34 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:34 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:34 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:34 user nova-compute[72809]: DEBUG nova.compute.manager [req-f1894e36-5326-47c6-8bda-6d629939cda3 req-43f7b078-fba4-4f3a-a956-fdb6ebf94ccc service nova] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Received event network-vif-plugged-d551bda7-293c-42a4-b9b6-1d615735311a {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:49:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f1894e36-5326-47c6-8bda-6d629939cda3 req-43f7b078-fba4-4f3a-a956-fdb6ebf94ccc service nova] Acquiring lock "d16ad749-f432-43e8-a5f9-96158a4308cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:49:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f1894e36-5326-47c6-8bda-6d629939cda3 req-43f7b078-fba4-4f3a-a956-fdb6ebf94ccc service nova] Lock "d16ad749-f432-43e8-a5f9-96158a4308cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:49:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f1894e36-5326-47c6-8bda-6d629939cda3 req-43f7b078-fba4-4f3a-a956-fdb6ebf94ccc service nova] Lock "d16ad749-f432-43e8-a5f9-96158a4308cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:34 user nova-compute[72809]: DEBUG nova.compute.manager [req-f1894e36-5326-47c6-8bda-6d629939cda3 req-43f7b078-fba4-4f3a-a956-fdb6ebf94ccc service nova] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] No waiting events found dispatching network-vif-plugged-d551bda7-293c-42a4-b9b6-1d615735311a {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:49:34 user nova-compute[72809]: WARNING nova.compute.manager [req-f1894e36-5326-47c6-8bda-6d629939cda3 req-43f7b078-fba4-4f3a-a956-fdb6ebf94ccc service nova] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Received unexpected event network-vif-plugged-d551bda7-293c-42a4-b9b6-1d615735311a for instance with vm_state building and task_state spawning.
Aug 09 06:49:35 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:35 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:35 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:36 user nova-compute[72809]: DEBUG nova.compute.manager [req-e5cb1e34-3573-4985-8dd9-2946612579e6 req-da6a521d-b393-464e-8d5e-08d9b6b12f3a service nova] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Received event network-vif-plugged-d551bda7-293c-42a4-b9b6-1d615735311a {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:49:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e5cb1e34-3573-4985-8dd9-2946612579e6 req-da6a521d-b393-464e-8d5e-08d9b6b12f3a service nova] Acquiring lock "d16ad749-f432-43e8-a5f9-96158a4308cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:49:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e5cb1e34-3573-4985-8dd9-2946612579e6 req-da6a521d-b393-464e-8d5e-08d9b6b12f3a service nova] Lock "d16ad749-f432-43e8-a5f9-96158a4308cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:49:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e5cb1e34-3573-4985-8dd9-2946612579e6 req-da6a521d-b393-464e-8d5e-08d9b6b12f3a service nova] Lock "d16ad749-f432-43e8-a5f9-96158a4308cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:36 user nova-compute[72809]: DEBUG nova.compute.manager [req-e5cb1e34-3573-4985-8dd9-2946612579e6 req-da6a521d-b393-464e-8d5e-08d9b6b12f3a service nova] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] No waiting events found dispatching network-vif-plugged-d551bda7-293c-42a4-b9b6-1d615735311a {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:49:36 user nova-compute[72809]: WARNING nova.compute.manager [req-e5cb1e34-3573-4985-8dd9-2946612579e6 req-da6a521d-b393-464e-8d5e-08d9b6b12f3a service nova] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Received unexpected event network-vif-plugged-d551bda7-293c-42a4-b9b6-1d615735311a for instance with vm_state building and task_state spawning.
Aug 09 06:49:37 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563777.0143766, d16ad749-f432-43e8-a5f9-96158a4308cf => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:49:37 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] VM Resumed (Lifecycle Event)
Aug 09 06:49:37 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:49:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 06:49:37 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Instance spawned successfully.
Aug 09 06:49:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 06:49:37 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:49:37 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:49:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:49:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:49:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:49:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:49:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:49:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:49:37 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:49:37 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563777.0160146, d16ad749-f432-43e8-a5f9-96158a4308cf => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:49:37 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] VM Started (Lifecycle Event)
Aug 09 06:49:37 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:49:37 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:49:37 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:49:37 user nova-compute[72809]: INFO nova.compute.manager [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Took 6.84 seconds to spawn the instance on the hypervisor.
Aug 09 06:49:37 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:49:37 user nova-compute[72809]: INFO nova.compute.manager [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Took 8.26 seconds to build instance.
Aug 09 06:49:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ba582416-a867-4a8e-80a7-279fb88a6e8d tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Lock "d16ad749-f432-43e8-a5f9-96158a4308cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.400s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Acquiring lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:49:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:49:52 user nova-compute[72809]: DEBUG nova.compute.manager [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 06:49:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:49:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:49:52 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 06:49:52 user nova-compute[72809]: INFO nova.compute.claims [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Claim successful on node user
Aug 09 06:49:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:52 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Refreshing inventories for resource provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 06:49:52 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Updating ProviderTree inventory for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 06:49:52 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Updating inventory in ProviderTree for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 06:49:52 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Refreshing aggregate associations for resource provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3, aggregates: None {{(pid=72809) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 06:49:52 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Refreshing trait associations for resource provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI {{(pid=72809) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 06:49:53 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:49:53 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:49:53 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.677s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:49:53 user nova-compute[72809]: DEBUG nova.compute.manager [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 06:49:53 user nova-compute[72809]: DEBUG nova.compute.manager [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 06:49:53 user nova-compute[72809]: DEBUG nova.network.neutron [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 06:49:53 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 06:49:53 user nova-compute[72809]: DEBUG nova.compute.manager [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 06:49:53 user nova-compute[72809]: INFO nova.virt.block_device [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Booting with volume c55bd25a-5fe0-4c5e-9e36-d0a73de24719 at /dev/vda
Aug 09 06:49:53 user nova-compute[72809]: DEBUG os_brick.utils [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:49:53 user nova-compute[72809]: INFO oslo.privsep.daemon [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpa24r4k1f/privsep.sock']
Aug 09 06:49:53 user nova-compute[72809]: DEBUG nova.policy [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e07bd13d284f4b289ce805dd71d24919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77aa113e6ca4baea8cb26d9abbb1d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 06:49:53 user sudo[83897]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpa24r4k1f/privsep.sock
Aug 09 06:49:53 user sudo[83897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 09 06:49:54 user nova-compute[72809]: DEBUG nova.network.neutron [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Successfully created port: 6581cf5a-ea10-419c-bd09-1f803299c311 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:49:54 user nova-compute[72809]: DEBUG nova.network.neutron [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Successfully created port: d7994fbc-d242-4b35-aad4-88bf2f3bc7a3 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:49:55 user nova-compute[72809]: DEBUG nova.network.neutron [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Successfully created port: 9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:49:55 user sudo[83897]: pam_unix(sudo:session): session closed for user root
Aug 09 06:49:55 user nova-compute[72809]: INFO oslo.privsep.daemon [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Spawned new privsep daemon via rootwrap
Aug 09 06:49:55 user nova-compute[72809]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 09 06:49:55 user nova-compute[72809]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 09 06:49:55 user nova-compute[72809]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 09 06:49:55 user nova-compute[72809]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83900
Aug 09 06:49:55 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad4008a-cd75-4317-b638-a46f5805b3ca]: (2,) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:49:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:55 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[42708720-c698-4395-806d-c950aff2b210]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:49:55 user nova-compute[72809]: WARNING os_brick.initiator.connectors.nvmeof [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 09 06:49:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:55 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d29387a-4ce3-46f6-a1e2-3caec7523658]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:49:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:49:55 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0db7bc-d308-48f6-ad42-f4a385ec357a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:49:55 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c401ad83-c835-475a-b3b0-c7fc61dde1b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:49:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:49:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 06:49:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:49:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:49:55 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 06:49:55 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53c9b23-ac00-48fb-9ca5-460d288e52eb]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:49:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 06:49:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 06:49:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 06:49:55 user nova-compute[72809]: DEBUG os_brick.utils [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] <== get_connector_properties: return (2404ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:49:55 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Updating existing volume attachment record: 900fad9f-43b8-4955-86c1-82e6cbc06342 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 06:49:56 user nova-compute[72809]: DEBUG nova.network.neutron [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Successfully created port: 4e76b5e9-78c1-405c-a866-be6f997ae4c7 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:49:56 user nova-compute[72809]: DEBUG nova.network.neutron [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Successfully created port: 23fba0ea-7bd6-4b7e-81a7-055a92b53590 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:49:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:57 user nova-compute[72809]: DEBUG nova.network.neutron [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Successfully updated port: 6581cf5a-ea10-419c-bd09-1f803299c311 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:49:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:49:57 user nova-compute[72809]: DEBUG nova.compute.manager [req-28165fe1-c37e-441e-b77e-e1d3321379ce req-ae79efaf-4482-485e-aec6-e750c0f0dcb8 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-changed-6581cf5a-ea10-419c-bd09-1f803299c311 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:49:57 user nova-compute[72809]: DEBUG nova.compute.manager [req-28165fe1-c37e-441e-b77e-e1d3321379ce req-ae79efaf-4482-485e-aec6-e750c0f0dcb8 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Refreshing instance network info cache due to event network-changed-6581cf5a-ea10-419c-bd09-1f803299c311. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:49:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-28165fe1-c37e-441e-b77e-e1d3321379ce req-ae79efaf-4482-485e-aec6-e750c0f0dcb8 service nova] Acquiring lock "refresh_cache-f7c9bbfa-b588-4ea7-ada4-d7f806ab2381" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:49:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-28165fe1-c37e-441e-b77e-e1d3321379ce req-ae79efaf-4482-485e-aec6-e750c0f0dcb8 service nova] Acquired lock "refresh_cache-f7c9bbfa-b588-4ea7-ada4-d7f806ab2381" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:49:57 user nova-compute[72809]: DEBUG nova.network.neutron [req-28165fe1-c37e-441e-b77e-e1d3321379ce req-ae79efaf-4482-485e-aec6-e750c0f0dcb8 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Refreshing network info cache for port 6581cf5a-ea10-419c-bd09-1f803299c311 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:49:57 user nova-compute[72809]: DEBUG nova.network.neutron [req-28165fe1-c37e-441e-b77e-e1d3321379ce req-ae79efaf-4482-485e-aec6-e750c0f0dcb8 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:49:58 user nova-compute[72809]: DEBUG nova.network.neutron [req-28165fe1-c37e-441e-b77e-e1d3321379ce req-ae79efaf-4482-485e-aec6-e750c0f0dcb8 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:49:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-28165fe1-c37e-441e-b77e-e1d3321379ce req-ae79efaf-4482-485e-aec6-e750c0f0dcb8 service nova] Releasing lock "refresh_cache-f7c9bbfa-b588-4ea7-ada4-d7f806ab2381" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:49:58 user nova-compute[72809]: DEBUG nova.network.neutron [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Successfully updated port: 530fb6cf-4b83-44a2-9792-7d844987f6e8 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:49:59 user nova-compute[72809]: DEBUG nova.network.neutron [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Successfully updated port: e3b8369b-0287-4dc7-8465-325f8eb9e413 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:49:59 user nova-compute[72809]: DEBUG nova.compute.manager [req-5238c9ac-f09d-4518-b62f-dba69e6eab5e req-f41243de-f40c-46c7-b99c-867534eb3937 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-changed-530fb6cf-4b83-44a2-9792-7d844987f6e8 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:49:59 user nova-compute[72809]: DEBUG nova.compute.manager [req-5238c9ac-f09d-4518-b62f-dba69e6eab5e req-f41243de-f40c-46c7-b99c-867534eb3937 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Refreshing instance network info cache due to event network-changed-530fb6cf-4b83-44a2-9792-7d844987f6e8. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:49:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5238c9ac-f09d-4518-b62f-dba69e6eab5e req-f41243de-f40c-46c7-b99c-867534eb3937 service nova] Acquiring lock "refresh_cache-f7c9bbfa-b588-4ea7-ada4-d7f806ab2381" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:49:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5238c9ac-f09d-4518-b62f-dba69e6eab5e req-f41243de-f40c-46c7-b99c-867534eb3937 service nova] Acquired lock "refresh_cache-f7c9bbfa-b588-4ea7-ada4-d7f806ab2381" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:49:59 user nova-compute[72809]: DEBUG nova.network.neutron [req-5238c9ac-f09d-4518-b62f-dba69e6eab5e req-f41243de-f40c-46c7-b99c-867534eb3937 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Refreshing network info cache for port 530fb6cf-4b83-44a2-9792-7d844987f6e8 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:49:59 user nova-compute[72809]: DEBUG nova.network.neutron [req-5238c9ac-f09d-4518-b62f-dba69e6eab5e req-f41243de-f40c-46c7-b99c-867534eb3937 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:50:00 user nova-compute[72809]: DEBUG nova.network.neutron [req-5238c9ac-f09d-4518-b62f-dba69e6eab5e req-f41243de-f40c-46c7-b99c-867534eb3937 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:50:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5238c9ac-f09d-4518-b62f-dba69e6eab5e req-f41243de-f40c-46c7-b99c-867534eb3937 service nova] Releasing lock "refresh_cache-f7c9bbfa-b588-4ea7-ada4-d7f806ab2381" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:50:00 user nova-compute[72809]: DEBUG nova.compute.manager [req-5238c9ac-f09d-4518-b62f-dba69e6eab5e req-f41243de-f40c-46c7-b99c-867534eb3937 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-changed-e3b8369b-0287-4dc7-8465-325f8eb9e413 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:00 user nova-compute[72809]: DEBUG nova.compute.manager [req-5238c9ac-f09d-4518-b62f-dba69e6eab5e req-f41243de-f40c-46c7-b99c-867534eb3937 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Refreshing instance network info cache due to event network-changed-e3b8369b-0287-4dc7-8465-325f8eb9e413. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:50:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5238c9ac-f09d-4518-b62f-dba69e6eab5e req-f41243de-f40c-46c7-b99c-867534eb3937 service nova] Acquiring lock "refresh_cache-f7c9bbfa-b588-4ea7-ada4-d7f806ab2381" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:50:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5238c9ac-f09d-4518-b62f-dba69e6eab5e req-f41243de-f40c-46c7-b99c-867534eb3937 service nova] Acquired lock "refresh_cache-f7c9bbfa-b588-4ea7-ada4-d7f806ab2381" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:50:00 user nova-compute[72809]: DEBUG nova.network.neutron [req-5238c9ac-f09d-4518-b62f-dba69e6eab5e req-f41243de-f40c-46c7-b99c-867534eb3937 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Refreshing network info cache for port e3b8369b-0287-4dc7-8465-325f8eb9e413 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:50:00 user nova-compute[72809]: DEBUG nova.network.neutron [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Successfully updated port: d7994fbc-d242-4b35-aad4-88bf2f3bc7a3 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:50:00 user nova-compute[72809]: DEBUG nova.network.neutron [req-5238c9ac-f09d-4518-b62f-dba69e6eab5e req-f41243de-f40c-46c7-b99c-867534eb3937 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:50:00 user nova-compute[72809]: DEBUG nova.network.neutron [req-5238c9ac-f09d-4518-b62f-dba69e6eab5e req-f41243de-f40c-46c7-b99c-867534eb3937 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:50:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5238c9ac-f09d-4518-b62f-dba69e6eab5e req-f41243de-f40c-46c7-b99c-867534eb3937 service nova] Releasing lock "refresh_cache-f7c9bbfa-b588-4ea7-ada4-d7f806ab2381" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:50:00 user nova-compute[72809]: DEBUG nova.network.neutron [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Successfully updated port: 9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:50:01 user nova-compute[72809]: DEBUG nova.compute.manager [req-4182cb84-b8b0-4cc0-a66f-6d87eea9d53b req-86025df7-7056-4ca0-b523-0c83f153289b service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-changed-d7994fbc-d242-4b35-aad4-88bf2f3bc7a3 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:01 user nova-compute[72809]: DEBUG nova.compute.manager [req-4182cb84-b8b0-4cc0-a66f-6d87eea9d53b req-86025df7-7056-4ca0-b523-0c83f153289b service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Refreshing instance network info cache due to event network-changed-d7994fbc-d242-4b35-aad4-88bf2f3bc7a3. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:50:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-4182cb84-b8b0-4cc0-a66f-6d87eea9d53b req-86025df7-7056-4ca0-b523-0c83f153289b service nova] Acquiring lock "refresh_cache-f7c9bbfa-b588-4ea7-ada4-d7f806ab2381" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:50:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-4182cb84-b8b0-4cc0-a66f-6d87eea9d53b req-86025df7-7056-4ca0-b523-0c83f153289b service nova] Acquired lock "refresh_cache-f7c9bbfa-b588-4ea7-ada4-d7f806ab2381" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:50:01 user nova-compute[72809]: DEBUG nova.network.neutron [req-4182cb84-b8b0-4cc0-a66f-6d87eea9d53b req-86025df7-7056-4ca0-b523-0c83f153289b service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Refreshing network info cache for port d7994fbc-d242-4b35-aad4-88bf2f3bc7a3 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:50:01 user nova-compute[72809]: DEBUG nova.network.neutron [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Successfully updated port: 4e76b5e9-78c1-405c-a866-be6f997ae4c7 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:50:01 user nova-compute[72809]: DEBUG nova.network.neutron [req-4182cb84-b8b0-4cc0-a66f-6d87eea9d53b req-86025df7-7056-4ca0-b523-0c83f153289b service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:50:02 user nova-compute[72809]: DEBUG nova.network.neutron [req-4182cb84-b8b0-4cc0-a66f-6d87eea9d53b req-86025df7-7056-4ca0-b523-0c83f153289b service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:50:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-4182cb84-b8b0-4cc0-a66f-6d87eea9d53b req-86025df7-7056-4ca0-b523-0c83f153289b service nova] Releasing lock "refresh_cache-f7c9bbfa-b588-4ea7-ada4-d7f806ab2381" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:50:02 user nova-compute[72809]: DEBUG nova.compute.manager [req-4182cb84-b8b0-4cc0-a66f-6d87eea9d53b req-86025df7-7056-4ca0-b523-0c83f153289b service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-changed-9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:02 user nova-compute[72809]: DEBUG nova.compute.manager [req-4182cb84-b8b0-4cc0-a66f-6d87eea9d53b req-86025df7-7056-4ca0-b523-0c83f153289b service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Refreshing instance network info cache due to event network-changed-9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:50:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-4182cb84-b8b0-4cc0-a66f-6d87eea9d53b req-86025df7-7056-4ca0-b523-0c83f153289b service nova] Acquiring lock "refresh_cache-f7c9bbfa-b588-4ea7-ada4-d7f806ab2381" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:50:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-4182cb84-b8b0-4cc0-a66f-6d87eea9d53b req-86025df7-7056-4ca0-b523-0c83f153289b service nova] Acquired lock "refresh_cache-f7c9bbfa-b588-4ea7-ada4-d7f806ab2381" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:50:02 user nova-compute[72809]: DEBUG nova.network.neutron [req-4182cb84-b8b0-4cc0-a66f-6d87eea9d53b req-86025df7-7056-4ca0-b523-0c83f153289b service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Refreshing network info cache for port 9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:50:02 user nova-compute[72809]: DEBUG nova.network.neutron [req-4182cb84-b8b0-4cc0-a66f-6d87eea9d53b req-86025df7-7056-4ca0-b523-0c83f153289b service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:50:02 user nova-compute[72809]: DEBUG nova.network.neutron [req-4182cb84-b8b0-4cc0-a66f-6d87eea9d53b req-86025df7-7056-4ca0-b523-0c83f153289b service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:50:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-4182cb84-b8b0-4cc0-a66f-6d87eea9d53b req-86025df7-7056-4ca0-b523-0c83f153289b service nova] Releasing lock "refresh_cache-f7c9bbfa-b588-4ea7-ada4-d7f806ab2381" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:50:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:02 user nova-compute[72809]: DEBUG nova.network.neutron [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Successfully updated port: 23fba0ea-7bd6-4b7e-81a7-055a92b53590 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:50:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Acquiring lock "refresh_cache-f7c9bbfa-b588-4ea7-ada4-d7f806ab2381" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:50:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Acquired lock "refresh_cache-f7c9bbfa-b588-4ea7-ada4-d7f806ab2381" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:50:02 user nova-compute[72809]: DEBUG nova.network.neutron [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:50:02 user nova-compute[72809]: DEBUG nova.network.neutron [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:50:03 user nova-compute[72809]: DEBUG nova.compute.manager [req-351afaa7-3eca-472f-9f27-5c617619a154 req-5abc7b5b-3eda-4b9f-9c07-e93a0cfb9258 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-changed-4e76b5e9-78c1-405c-a866-be6f997ae4c7 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:03 user nova-compute[72809]: DEBUG nova.compute.manager [req-351afaa7-3eca-472f-9f27-5c617619a154 req-5abc7b5b-3eda-4b9f-9c07-e93a0cfb9258 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Refreshing instance network info cache due to event network-changed-4e76b5e9-78c1-405c-a866-be6f997ae4c7. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:50:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-351afaa7-3eca-472f-9f27-5c617619a154 req-5abc7b5b-3eda-4b9f-9c07-e93a0cfb9258 service nova] Acquiring lock "refresh_cache-f7c9bbfa-b588-4ea7-ada4-d7f806ab2381" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:50:04 user nova-compute[72809]: DEBUG nova.network.neutron [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Updating instance_info_cache with network_info: [{"id": "6581cf5a-ea10-419c-bd09-1f803299c311", "address": "fa:16:3e:fd:67:27", "network": {"id": "1f3ccbb7-90ef-4b31-8fe7-319423a4c195", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1335319963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6581cf5a-ea", "ovs_interfaceid": "6581cf5a-ea10-419c-bd09-1f803299c311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "address": "fa:16:3e:cc:aa:3b", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap530fb6cf-4b", "ovs_interfaceid": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "address": "fa:16:3e:f7:75:6f", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b8369b-02", "ovs_interfaceid": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d7994fbc-d242-4b35-aad4-88bf2f3bc7a3", "address": "fa:16:3e:d1:3f:09", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7994fbc-d2", "ovs_interfaceid": "d7994fbc-d242-4b35-aad4-88bf2f3bc7a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923", "address": "fa:16:3e:f1:35:4f", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fc4dcc0-2a", "ovs_interfaceid": "9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e76b5e9-78c1-405c-a866-be6f997ae4c7", "address": "fa:16:3e:8a:53:47", "network": {"id": "3c0698b4-4d41-4ad0-a954-b112d7796107", "bridge": "br-int", "label": "tempest-device-tagging-net2-1070297502", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e76b5e9-78", "ovs_interfaceid": "4e76b5e9-78c1-405c-a866-be6f997ae4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23fba0ea-7bd6-4b7e-81a7-055a92b53590", "address": "fa:16:3e:ff:56:8a", "network": {"id": "3c0698b4-4d41-4ad0-a954-b112d7796107", "bridge": "br-int", "label": "tempest-device-tagging-net2-1070297502", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23fba0ea-7b", "ovs_interfaceid": "23fba0ea-7bd6-4b7e-81a7-055a92b53590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:50:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Releasing lock "refresh_cache-f7c9bbfa-b588-4ea7-ada4-d7f806ab2381" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:50:04 user nova-compute[72809]: DEBUG nova.compute.manager [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Instance network_info: |[{"id": "6581cf5a-ea10-419c-bd09-1f803299c311", "address": "fa:16:3e:fd:67:27", "network": {"id": "1f3ccbb7-90ef-4b31-8fe7-319423a4c195", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1335319963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6581cf5a-ea", "ovs_interfaceid": "6581cf5a-ea10-419c-bd09-1f803299c311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "address": "fa:16:3e:cc:aa:3b", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap530fb6cf-4b", "ovs_interfaceid": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "address": "fa:16:3e:f7:75:6f", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b8369b-02", "ovs_interfaceid": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d7994fbc-d242-4b35-aad4-88bf2f3bc7a3", "address": "fa:16:3e:d1:3f:09", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7994fbc-d2", "ovs_interfaceid": "d7994fbc-d242-4b35-aad4-88bf2f3bc7a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923", "address": "fa:16:3e:f1:35:4f", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fc4dcc0-2a", "ovs_interfaceid": "9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e76b5e9-78c1-405c-a866-be6f997ae4c7", "address": "fa:16:3e:8a:53:47", "network": {"id": "3c0698b4-4d41-4ad0-a954-b112d7796107", "bridge": "br-int", "label": "tempest-device-tagging-net2-1070297502", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e76b5e9-78", "ovs_interfaceid": "4e76b5e9-78c1-405c-a866-be6f997ae4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23fba0ea-7bd6-4b7e-81a7-055a92b53590", "address": "fa:16:3e:ff:56:8a", "network": {"id": "3c0698b4-4d41-4ad0-a954-b112d7796107", "bridge": "br-int", "label": "tempest-device-tagging-net2-1070297502", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23fba0ea-7b", "ovs_interfaceid": "23fba0ea-7bd6-4b7e-81a7-055a92b53590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 06:50:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-351afaa7-3eca-472f-9f27-5c617619a154 req-5abc7b5b-3eda-4b9f-9c07-e93a0cfb9258 service nova] Acquired lock "refresh_cache-f7c9bbfa-b588-4ea7-ada4-d7f806ab2381" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:50:04 user nova-compute[72809]: DEBUG nova.network.neutron [req-351afaa7-3eca-472f-9f27-5c617619a154 req-5abc7b5b-3eda-4b9f-9c07-e93a0cfb9258 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Refreshing network info cache for port 4e76b5e9-78c1-405c-a866-be6f997ae4c7 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:50:04 user nova-compute[72809]: INFO nova.virt.block_device [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Booting with volume b1599d24-eefb-4811-b6d9-3a9bd82b8587 at /dev/vdb
Aug 09 06:50:05 user nova-compute[72809]: DEBUG os_brick.utils [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:50:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:05 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b316f89-cd1c-4aff-82ff-c44ffa2b46ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:05 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2ac79a-c5ff-49b8-85c6-d2f7fd52c2ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:05 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84a46ad-c5c9-419f-b51e-1a57cdd8bab5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:05 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7f9c42-b7e6-4c41-9243-560733a1466d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:50:05 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 06:50:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:50:05 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 06:50:05 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6900824-64ff-4f2f-80e4-18d79611ed4d]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:05 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 06:50:05 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 06:50:05 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 06:50:05 user nova-compute[72809]: DEBUG os_brick.utils [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:50:05 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Updating existing volume attachment record: 41ebb9a3-142e-4e22-8e46-dbf34a8a1624 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 06:50:05 user nova-compute[72809]: DEBUG nova.network.neutron [req-351afaa7-3eca-472f-9f27-5c617619a154 req-5abc7b5b-3eda-4b9f-9c07-e93a0cfb9258 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Updated VIF entry in instance network info cache for port 4e76b5e9-78c1-405c-a866-be6f997ae4c7. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:50:05 user nova-compute[72809]: DEBUG nova.network.neutron [req-351afaa7-3eca-472f-9f27-5c617619a154 req-5abc7b5b-3eda-4b9f-9c07-e93a0cfb9258 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Updating instance_info_cache with network_info: [{"id": "6581cf5a-ea10-419c-bd09-1f803299c311", "address": "fa:16:3e:fd:67:27", "network": {"id": "1f3ccbb7-90ef-4b31-8fe7-319423a4c195", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1335319963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6581cf5a-ea", "ovs_interfaceid": "6581cf5a-ea10-419c-bd09-1f803299c311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "address": "fa:16:3e:cc:aa:3b", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap530fb6cf-4b", "ovs_interfaceid": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "address": "fa:16:3e:f7:75:6f", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b8369b-02", "ovs_interfaceid": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d7994fbc-d242-4b35-aad4-88bf2f3bc7a3", "address": "fa:16:3e:d1:3f:09", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7994fbc-d2", "ovs_interfaceid": "d7994fbc-d242-4b35-aad4-88bf2f3bc7a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923", "address": "fa:16:3e:f1:35:4f", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fc4dcc0-2a", "ovs_interfaceid": "9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e76b5e9-78c1-405c-a866-be6f997ae4c7", "address": "fa:16:3e:8a:53:47", "network": {"id": "3c0698b4-4d41-4ad0-a954-b112d7796107", "bridge": "br-int", "label": "tempest-device-tagging-net2-1070297502", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e76b5e9-78", "ovs_interfaceid": "4e76b5e9-78c1-405c-a866-be6f997ae4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23fba0ea-7bd6-4b7e-81a7-055a92b53590", "address": "fa:16:3e:ff:56:8a", "network": {"id": "3c0698b4-4d41-4ad0-a954-b112d7796107", "bridge": "br-int", "label": "tempest-device-tagging-net2-1070297502", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23fba0ea-7b", "ovs_interfaceid": "23fba0ea-7bd6-4b7e-81a7-055a92b53590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:50:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-351afaa7-3eca-472f-9f27-5c617619a154 req-5abc7b5b-3eda-4b9f-9c07-e93a0cfb9258 service nova] Releasing lock "refresh_cache-f7c9bbfa-b588-4ea7-ada4-d7f806ab2381" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:50:05 user nova-compute[72809]: DEBUG nova.compute.manager [req-351afaa7-3eca-472f-9f27-5c617619a154 req-5abc7b5b-3eda-4b9f-9c07-e93a0cfb9258 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-changed-23fba0ea-7bd6-4b7e-81a7-055a92b53590 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:05 user nova-compute[72809]: DEBUG nova.compute.manager [req-351afaa7-3eca-472f-9f27-5c617619a154 req-5abc7b5b-3eda-4b9f-9c07-e93a0cfb9258 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Refreshing instance network info cache due to event network-changed-23fba0ea-7bd6-4b7e-81a7-055a92b53590. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:50:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-351afaa7-3eca-472f-9f27-5c617619a154 req-5abc7b5b-3eda-4b9f-9c07-e93a0cfb9258 service nova] Acquiring lock "refresh_cache-f7c9bbfa-b588-4ea7-ada4-d7f806ab2381" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:50:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-351afaa7-3eca-472f-9f27-5c617619a154 req-5abc7b5b-3eda-4b9f-9c07-e93a0cfb9258 service nova] Acquired lock "refresh_cache-f7c9bbfa-b588-4ea7-ada4-d7f806ab2381" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:50:05 user nova-compute[72809]: DEBUG nova.network.neutron [req-351afaa7-3eca-472f-9f27-5c617619a154 req-5abc7b5b-3eda-4b9f-9c07-e93a0cfb9258 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Refreshing network info cache for port 23fba0ea-7bd6-4b7e-81a7-055a92b53590 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:50:06 user nova-compute[72809]: DEBUG nova.network.neutron [req-351afaa7-3eca-472f-9f27-5c617619a154 req-5abc7b5b-3eda-4b9f-9c07-e93a0cfb9258 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Updated VIF entry in instance network info cache for port 23fba0ea-7bd6-4b7e-81a7-055a92b53590. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:50:06 user nova-compute[72809]: DEBUG nova.network.neutron [req-351afaa7-3eca-472f-9f27-5c617619a154 req-5abc7b5b-3eda-4b9f-9c07-e93a0cfb9258 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Updating instance_info_cache with network_info: [{"id": "6581cf5a-ea10-419c-bd09-1f803299c311", "address": "fa:16:3e:fd:67:27", "network": {"id": "1f3ccbb7-90ef-4b31-8fe7-319423a4c195", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1335319963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6581cf5a-ea", "ovs_interfaceid": "6581cf5a-ea10-419c-bd09-1f803299c311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "address": "fa:16:3e:cc:aa:3b", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap530fb6cf-4b", "ovs_interfaceid": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "address": "fa:16:3e:f7:75:6f", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b8369b-02", "ovs_interfaceid": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d7994fbc-d242-4b35-aad4-88bf2f3bc7a3", "address": "fa:16:3e:d1:3f:09", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7994fbc-d2", "ovs_interfaceid": "d7994fbc-d242-4b35-aad4-88bf2f3bc7a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923", "address": "fa:16:3e:f1:35:4f", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fc4dcc0-2a", "ovs_interfaceid": "9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e76b5e9-78c1-405c-a866-be6f997ae4c7", "address": "fa:16:3e:8a:53:47", "network": {"id": "3c0698b4-4d41-4ad0-a954-b112d7796107", "bridge": "br-int", "label": "tempest-device-tagging-net2-1070297502", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e76b5e9-78", "ovs_interfaceid": "4e76b5e9-78c1-405c-a866-be6f997ae4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23fba0ea-7bd6-4b7e-81a7-055a92b53590", "address": "fa:16:3e:ff:56:8a", "network": {"id": "3c0698b4-4d41-4ad0-a954-b112d7796107", "bridge": "br-int", "label": "tempest-device-tagging-net2-1070297502", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23fba0ea-7b", "ovs_interfaceid": "23fba0ea-7bd6-4b7e-81a7-055a92b53590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:50:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-351afaa7-3eca-472f-9f27-5c617619a154 req-5abc7b5b-3eda-4b9f-9c07-e93a0cfb9258 service nova] Releasing lock "refresh_cache-f7c9bbfa-b588-4ea7-ada4-d7f806ab2381" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:50:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:13 user nova-compute[72809]: INFO nova.virt.block_device [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Booting with volume 326cadef-34a9-4a12-9cea-77eecb2c95d0 at /dev/vdc
Aug 09 06:50:13 user nova-compute[72809]: DEBUG os_brick.utils [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:50:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:13 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb2e376-efe1-41df-8494-93b028db7406]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:13 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0056cf5a-7a6c-4f2b-88e0-3c91a5c0688f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:13 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c6d7f0-5809-44cd-971f-7ef17002dc6e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:13 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23e67a2-c0a9-4b8f-88ba-bd4fe98e0008]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:50:13 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 06:50:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:50:13 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 06:50:13 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfeed65-fb80-4ef9-a52d-f158903785a8]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:13 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 06:50:13 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 06:50:13 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 06:50:13 user nova-compute[72809]: DEBUG os_brick.utils [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:50:13 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Updating existing volume attachment record: e0c9ffc9-f8d9-449e-a853-34d42cfa3c23 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 06:50:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Acquiring lock "b1d6a12a-ecb9-4008-bf1b-28b2165dca99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lock "b1d6a12a-ecb9-4008-bf1b-28b2165dca99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:21 user nova-compute[72809]: DEBUG nova.compute.manager [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 06:50:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:21 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 06:50:21 user nova-compute[72809]: INFO nova.compute.claims [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Claim successful on node user
Aug 09 06:50:21 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:50:21 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:50:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:21 user nova-compute[72809]: DEBUG nova.compute.manager [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.compute.manager [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.network.neutron [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 06:50:22 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.compute.manager [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.policy [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f0a431477454b8aa0006b5d06cd53b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7448d7b10a924d5cbd60f6276224a8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.compute.manager [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 06:50:22 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Creating image(s)
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1d6a12a-ecb9-4008-bf1b-28b2165dca99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lock "/opt/stack/data/nova/instances/b1d6a12a-ecb9-4008-bf1b-28b2165dca99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lock "/opt/stack/data/nova/instances/b1d6a12a-ecb9-4008-bf1b-28b2165dca99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.138s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.150s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/b1d6a12a-ecb9-4008-bf1b-28b2165dca99/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/b1d6a12a-ecb9-4008-bf1b-28b2165dca99/disk 1073741824" returned: 0 in 0.049s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.compute.manager [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 06:50:22 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Creating image(s)
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Did not create local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Ensure instance console log exists: /opt/stack/data/nova/instances/f7c9bbfa-b588-4ea7-ada4-d7f806ab2381/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Start _get_guest_xml network_info=[{"id": "6581cf5a-ea10-419c-bd09-1f803299c311", "address": "fa:16:3e:fd:67:27", "network": {"id": "1f3ccbb7-90ef-4b31-8fe7-319423a4c195", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1335319963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6581cf5a-ea", "ovs_interfaceid": "6581cf5a-ea10-419c-bd09-1f803299c311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "address": "fa:16:3e:cc:aa:3b", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap530fb6cf-4b", "ovs_interfaceid": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "address": "fa:16:3e:f7:75:6f", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b8369b-02", "ovs_interfaceid": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d7994fbc-d242-4b35-aad4-88bf2f3bc7a3", "address": "fa:16:3e:d1:3f:09", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7994fbc-d2", "ovs_interfaceid": "d7994fbc-d242-4b35-aad4-88bf2f3bc7a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923", "address": "fa:16:3e:f1:35:4f", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fc4dcc0-2a", "ovs_interfaceid": "9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e76b5e9-78c1-405c-a866-be6f997ae4c7", "address": "fa:16:3e:8a:53:47", "network": {"id": "3c0698b4-4d41-4ad0-a954-b112d7796107", "bridge": "br-int", "label": "tempest-device-tagging-net2-1070297502", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e76b5e9-78", "ovs_interfaceid": "4e76b5e9-78c1-405c-a866-be6f997ae4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23fba0ea-7bd6-4b7e-81a7-055a92b53590", "address": "fa:16:3e:ff:56:8a", "network": {"id": "3c0698b4-4d41-4ad0-a954-b112d7796107", "bridge": "br-int", "label": "tempest-device-tagging-net2-1070297502", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23fba0ea-7b", "ovs_interfaceid": "23fba0ea-7bd6-4b7e-81a7-055a92b53590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zsRvMqwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f7c9bbfa-b588-4ea7-ada4-d7f806ab2381', 'attached_at': '', 'detached_at': '', 'volume_id': 'c55bd25a-5fe0-4c5e-9e36-d0a73de24719', 'serial': 'c55bd25a-5fe0-4c5e-9e36-d0a73de24719'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': 0, 'attachment_id': '900fad9f-43b8-4955-86c1-82e6cbc06342', 'volume_type': None}, {'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGeIJEUT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f7c9bbfa-b588-4ea7-ada4-d7f806ab2381', 'attached_at': '', 'detached_at': '', 'volume_id': 'b1599d24-eefb-4811-b6d9-3a9bd82b8587', 'serial': 'b1599d24-eefb-4811-b6d9-3a9bd82b8587'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': 1, 'attachment_id': '41ebb9a3-142e-4e22-8e46-dbf34a8a1624', 'volume_type': None}, {'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kevyfSjE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f7c9bbfa-b588-4ea7-ada4-d7f806ab2381', 'attached_at': '', 'detached_at': '', 'volume_id': '326cadef-34a9-4a12-9cea-77eecb2c95d0', 'serial': '326cadef-34a9-4a12-9cea-77eecb2c95d0'}, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': 2, 'attachment_id': 'e0c9ffc9-f8d9-449e-a853-34d42cfa3c23', 'volume_type': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:22 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:50:22 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG os_brick.initiator.connector [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Factory for ISCSI on None {{(pid=72809) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zsRvMqwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:50:22 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:50:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:50:22 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:50:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:50:22 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 06:50:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5a4bf1-e27d-46f1-9f77-b82dbdb0fdf0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.155s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 06:50:22 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b1d6a12a-ecb9-4008-bf1b-28b2165dca99/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6a12a-ecb9-4008-bf1b-28b2165dca99/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0471f98-9753-4838-ac74-2f5b779ddfca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719] added
Aug 09 06:50:22 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.network.neutron [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Successfully created port: 1f55eca0-6fea-4eed-a90a-1cd7e9769d68 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[46049a14-3108-4bdf-b4c4-db7e048c3062]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d00d5f1-f499-4e43-a1e4-77cfdbbe6aac]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zsRvMqwm {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zsRvMqwm" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[21566c33-eb97-4ec6-8bc5-945016266183]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zsRvMqwm'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c66012b-c739-4949-b12f-0e291a5cd354]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6a12a-ecb9-4008-bf1b-28b2165dca99/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Cannot resize image /opt/stack/data/nova/instances/b1d6a12a-ecb9-4008-bf1b-28b2165dca99/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.objects.instance [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lazy-loading 'migration_context' on Instance uuid b1d6a12a-ecb9-4008-bf1b-28b2165dca99 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ab69ee-e7cd-43c1-a7a6-8a5d4cb23a5d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 06:50:22 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 06:50:22 user nova-compute[72809]:  {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:50:22 user nova-compute[72809]: WARNING os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 06:50:22 user nova-compute[72809]: 
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Ensure instance console log exists: /opt/stack/data/nova/instances/b1d6a12a-ecb9-4008-bf1b-28b2165dca99/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[07edf4da-6f5c-45ee-b6d1-dc3cdf799465]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719, portal: 172.16.0.220,3260]
Aug 09 06:50:22 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719, portal: 172.16.0.220,3260] successful.
Aug 09 06:50:22 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45e8444-17bb-47ea-b693-5136ebf036de]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[533dd4e2-857c-4e9c-a559-02679b9a02ac]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:50:23 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:50:23 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e67cec6-e261-44c6-89c5-5f8156b8eade]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zsRvMqwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG nova.network.neutron [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Successfully updated port: 1f55eca0-6fea-4eed-a90a-1cd7e9769d68 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Acquiring lock "refresh_cache-b1d6a12a-ecb9-4008-bf1b-28b2165dca99" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Acquired lock "refresh_cache-b1d6a12a-ecb9-4008-bf1b-28b2165dca99" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG nova.network.neutron [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG nova.compute.manager [req-3f474cd9-f3c3-4292-9ae4-9b50b4d25059 req-f36a4a91-97d8-4bc3-9de7-1b809d76a32c service nova] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Received event network-changed-1f55eca0-6fea-4eed-a90a-1cd7e9769d68 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG nova.compute.manager [req-3f474cd9-f3c3-4292-9ae4-9b50b4d25059 req-f36a4a91-97d8-4bc3-9de7-1b809d76a32c service nova] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Refreshing instance network info cache due to event network-changed-1f55eca0-6fea-4eed-a90a-1cd7e9769d68. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3f474cd9-f3c3-4292-9ae4-9b50b4d25059 req-f36a4a91-97d8-4bc3-9de7-1b809d76a32c service nova] Acquiring lock "refresh_cache-b1d6a12a-ecb9-4008-bf1b-28b2165dca99" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG nova.network.neutron [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG nova.network.neutron [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Updating instance_info_cache with network_info: [{"id": "1f55eca0-6fea-4eed-a90a-1cd7e9769d68", "address": "fa:16:3e:b1:e7:6f", "network": {"id": "66bd3e40-f19b-4145-baaf-8eab9760324a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1038504284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7448d7b10a924d5cbd60f6276224a8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f55eca0-6f", "ovs_interfaceid": "1f55eca0-6fea-4eed-a90a-1cd7e9769d68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Releasing lock "refresh_cache-b1d6a12a-ecb9-4008-bf1b-28b2165dca99" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG nova.compute.manager [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Instance network_info: |[{"id": "1f55eca0-6fea-4eed-a90a-1cd7e9769d68", "address": "fa:16:3e:b1:e7:6f", "network": {"id": "66bd3e40-f19b-4145-baaf-8eab9760324a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1038504284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7448d7b10a924d5cbd60f6276224a8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f55eca0-6f", "ovs_interfaceid": "1f55eca0-6fea-4eed-a90a-1cd7e9769d68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3f474cd9-f3c3-4292-9ae4-9b50b4d25059 req-f36a4a91-97d8-4bc3-9de7-1b809d76a32c service nova] Acquired lock "refresh_cache-b1d6a12a-ecb9-4008-bf1b-28b2165dca99" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG nova.network.neutron [req-3f474cd9-f3c3-4292-9ae4-9b50b4d25059 req-f36a4a91-97d8-4bc3-9de7-1b809d76a32c service nova] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Refreshing network info cache for port 1f55eca0-6fea-4eed-a90a-1cd7e9769d68 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Start _get_guest_xml network_info=[{"id": "1f55eca0-6fea-4eed-a90a-1cd7e9769d68", "address": "fa:16:3e:b1:e7:6f", "network": {"id": "66bd3e40-f19b-4145-baaf-8eab9760324a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1038504284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7448d7b10a924d5cbd60f6276224a8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f55eca0-6f", "ovs_interfaceid": "1f55eca0-6fea-4eed-a90a-1cd7e9769d68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:50:23 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:50:23 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:50:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:50:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:50:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1074572864',display_name='tempest-VolumesActionsTest-instance-1074572864',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1074572864',id=11,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7448d7b10a924d5cbd60f6276224a8cc',ramdisk_id='',reservation_id='r-1ptvt11l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-812095692',owner_user_name='tempest-VolumesActionsTest-812095692-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:50:22Z,user_data=None,user_id='4f0a431477454b8aa0006b5d06cd53b2',uuid=b1d6a12a-ecb9-4008-bf1b-28b2165dca99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f55eca0-6fea-4eed-a90a-1cd7e9769d68", "address": "fa:16:3e:b1:e7:6f", "network": {"id": "66bd3e40-f19b-4145-baaf-8eab9760324a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1038504284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7448d7b10a924d5cbd60f6276224a8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f55eca0-6f", "ovs_interfaceid": "1f55eca0-6fea-4eed-a90a-1cd7e9769d68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Converting VIF {"id": "1f55eca0-6fea-4eed-a90a-1cd7e9769d68", "address": "fa:16:3e:b1:e7:6f", "network": {"id": "66bd3e40-f19b-4145-baaf-8eab9760324a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1038504284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7448d7b10a924d5cbd60f6276224a8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f55eca0-6f", "ovs_interfaceid": "1f55eca0-6fea-4eed-a90a-1cd7e9769d68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:e7:6f,bridge_name='br-int',has_traffic_filtering=True,id=1f55eca0-6fea-4eed-a90a-1cd7e9769d68,network=Network(66bd3e40-f19b-4145-baaf-8eab9760324a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f55eca0-6f') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG nova.objects.instance [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lazy-loading 'pci_devices' on Instance uuid b1d6a12a-ecb9-4008-bf1b-28b2165dca99 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:50:24 user nova-compute[72809]:   <uuid>b1d6a12a-ecb9-4008-bf1b-28b2165dca99</uuid>
Aug 09 06:50:24 user nova-compute[72809]:   <name>instance-0000000b</name>
Aug 09 06:50:24 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:50:24 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:50:24 user nova-compute[72809]:   <metadata>
Aug 09 06:50:24 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:50:24 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:50:24 user nova-compute[72809]:       <nova:name>tempest-VolumesActionsTest-instance-1074572864</nova:name>
Aug 09 06:50:24 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:50:23</nova:creationTime>
Aug 09 06:50:24 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:50:24 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:50:24 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:50:24 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:50:24 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:50:24 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:50:24 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:50:24 user nova-compute[72809]:       <nova:owner>
Aug 09 06:50:24 user nova-compute[72809]:         <nova:user uuid="4f0a431477454b8aa0006b5d06cd53b2">tempest-VolumesActionsTest-812095692-project-member</nova:user>
Aug 09 06:50:24 user nova-compute[72809]:         <nova:project uuid="7448d7b10a924d5cbd60f6276224a8cc">tempest-VolumesActionsTest-812095692</nova:project>
Aug 09 06:50:24 user nova-compute[72809]:       </nova:owner>
Aug 09 06:50:24 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:50:24 user nova-compute[72809]:       <nova:ports>
Aug 09 06:50:24 user nova-compute[72809]:         <nova:port uuid="1f55eca0-6fea-4eed-a90a-1cd7e9769d68">
Aug 09 06:50:24 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 06:50:24 user nova-compute[72809]:         </nova:port>
Aug 09 06:50:24 user nova-compute[72809]:       </nova:ports>
Aug 09 06:50:24 user nova-compute[72809]:     </nova:instance>
Aug 09 06:50:24 user nova-compute[72809]:   </metadata>
Aug 09 06:50:24 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:50:24 user nova-compute[72809]:     <system>
Aug 09 06:50:24 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:50:24 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:50:24 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:50:24 user nova-compute[72809]:       <entry name="serial">b1d6a12a-ecb9-4008-bf1b-28b2165dca99</entry>
Aug 09 06:50:24 user nova-compute[72809]:       <entry name="uuid">b1d6a12a-ecb9-4008-bf1b-28b2165dca99</entry>
Aug 09 06:50:24 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:50:24 user nova-compute[72809]:     </system>
Aug 09 06:50:24 user nova-compute[72809]:   </sysinfo>
Aug 09 06:50:24 user nova-compute[72809]:   <os>
Aug 09 06:50:24 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:50:24 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 06:50:24 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:50:24 user nova-compute[72809]:   </os>
Aug 09 06:50:24 user nova-compute[72809]:   <features>
Aug 09 06:50:24 user nova-compute[72809]:     <acpi/>
Aug 09 06:50:24 user nova-compute[72809]:     <apic/>
Aug 09 06:50:24 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:50:24 user nova-compute[72809]:   </features>
Aug 09 06:50:24 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:50:24 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:50:24 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:50:24 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:50:24 user nova-compute[72809]:   </clock>
Aug 09 06:50:24 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:50:24 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:50:24 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:50:24 user nova-compute[72809]:   </cpu>
Aug 09 06:50:24 user nova-compute[72809]:   <devices>
Aug 09 06:50:24 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:50:24 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:50:24 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/b1d6a12a-ecb9-4008-bf1b-28b2165dca99/disk"/>
Aug 09 06:50:24 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:50:24 user nova-compute[72809]:     </disk>
Aug 09 06:50:24 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:50:24 user nova-compute[72809]:       <mac address="fa:16:3e:b1:e7:6f"/>
Aug 09 06:50:24 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:50:24 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:50:24 user nova-compute[72809]:       <target dev="tap1f55eca0-6f"/>
Aug 09 06:50:24 user nova-compute[72809]:     </interface>
Aug 09 06:50:24 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:50:24 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/b1d6a12a-ecb9-4008-bf1b-28b2165dca99/console.log" append="off"/>
Aug 09 06:50:24 user nova-compute[72809]:     </serial>
Aug 09 06:50:24 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:50:24 user nova-compute[72809]:     <video>
Aug 09 06:50:24 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:50:24 user nova-compute[72809]:     </video>
Aug 09 06:50:24 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:50:24 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:50:24 user nova-compute[72809]:     </rng>
Aug 09 06:50:24 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:50:24 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:50:24 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:50:24 user nova-compute[72809]:     </memballoon>
Aug 09 06:50:24 user nova-compute[72809]:   </devices>
Aug 09 06:50:24 user nova-compute[72809]: </domain>
Aug 09 06:50:24 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:50:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1074572864',display_name='tempest-VolumesActionsTest-instance-1074572864',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1074572864',id=11,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7448d7b10a924d5cbd60f6276224a8cc',ramdisk_id='',reservation_id='r-1ptvt11l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-812095692',owner_user_name='tempest-VolumesActionsTest-812095692-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:50:22Z,user_data=None,user_id='4f0a431477454b8aa0006b5d06cd53b2',uuid=b1d6a12a-ecb9-4008-bf1b-28b2165dca99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f55eca0-6fea-4eed-a90a-1cd7e9769d68", "address": "fa:16:3e:b1:e7:6f", "network": {"id": "66bd3e40-f19b-4145-baaf-8eab9760324a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1038504284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7448d7b10a924d5cbd60f6276224a8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f55eca0-6f", "ovs_interfaceid": "1f55eca0-6fea-4eed-a90a-1cd7e9769d68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Converting VIF {"id": "1f55eca0-6fea-4eed-a90a-1cd7e9769d68", "address": "fa:16:3e:b1:e7:6f", "network": {"id": "66bd3e40-f19b-4145-baaf-8eab9760324a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1038504284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7448d7b10a924d5cbd60f6276224a8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f55eca0-6f", "ovs_interfaceid": "1f55eca0-6fea-4eed-a90a-1cd7e9769d68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:e7:6f,bridge_name='br-int',has_traffic_filtering=True,id=1f55eca0-6fea-4eed-a90a-1cd7e9769d68,network=Network(66bd3e40-f19b-4145-baaf-8eab9760324a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f55eca0-6f') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG os_vif [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:e7:6f,bridge_name='br-int',has_traffic_filtering=True,id=1f55eca0-6fea-4eed-a90a-1cd7e9769d68,network=Network(66bd3e40-f19b-4145-baaf-8eab9760324a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f55eca0-6f') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f55eca0-6f, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1f55eca0-6f, col_values=(('external_ids', {'iface-id': '1f55eca0-6fea-4eed-a90a-1cd7e9769d68', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:e7:6f', 'vm-uuid': 'b1d6a12a-ecb9-4008-bf1b-28b2165dca99'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26234616165346264', 'path': '/dev/sdb'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234616165346264', 'path': '/dev/sdb'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:24 user nova-compute[72809]: INFO os_vif [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:e7:6f,bridge_name='br-int',has_traffic_filtering=True,id=1f55eca0-6fea-4eed-a90a-1cd7e9769d68,network=Network(66bd3e40-f19b-4145-baaf-8eab9760324a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f55eca0-6f')
Aug 09 06:50:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGeIJEUT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:50:24 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:50:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:50:24 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:50:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:50:24 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6218719b-37b4-48b6-b9fd-9b81d46d46fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 06:50:24 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] No VIF found with MAC fa:16:3e:b1:e7:6f, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3419b62-ef8d-42ee-a2db-4c49b0ece9f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587] added
Aug 09 06:50:24 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[668ade34-0518-4461-ab1a-6b1d705f9d8d]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9afcc92-3883-4c9a-88b1-d354cd329a1e]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NGeIJEUT {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NGeIJEUT" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c19de53-157a-4d17-953a-3a55207e956a]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NGeIJEUT'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac7b62b-24ef-4749-acd5-e68fc6a0ffc7]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebf8496-e8bb-470b-81a4-2bd76f6a7fe7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:50:24 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:50:24 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b3e0c1-c052-4175-a973-3c1d47ecfd40]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587, portal: 172.16.0.220,3260]
Aug 09 06:50:24 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587, portal: 172.16.0.220,3260] successful.
Aug 09 06:50:24 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4353c1-6938-46a8-bc1a-9e92fc180d6f]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b755cf28-990f-4275-a06e-2aa84936a82c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:50:24 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:50:24 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:50:24 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:50:24 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[64856a6f-77a1-4d80-9921-f9beec80b9a4]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGeIJEUT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG nova.network.neutron [req-3f474cd9-f3c3-4292-9ae4-9b50b4d25059 req-f36a4a91-97d8-4bc3-9de7-1b809d76a32c service nova] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Updated VIF entry in instance network info cache for port 1f55eca0-6fea-4eed-a90a-1cd7e9769d68. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG nova.network.neutron [req-3f474cd9-f3c3-4292-9ae4-9b50b4d25059 req-f36a4a91-97d8-4bc3-9de7-1b809d76a32c service nova] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Updating instance_info_cache with network_info: [{"id": "1f55eca0-6fea-4eed-a90a-1cd7e9769d68", "address": "fa:16:3e:b1:e7:6f", "network": {"id": "66bd3e40-f19b-4145-baaf-8eab9760324a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1038504284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7448d7b10a924d5cbd60f6276224a8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f55eca0-6f", "ovs_interfaceid": "1f55eca0-6fea-4eed-a90a-1cd7e9769d68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3f474cd9-f3c3-4292-9ae4-9b50b4d25059 req-f36a4a91-97d8-4bc3-9de7-1b809d76a32c service nova] Releasing lock "refresh_cache-b1d6a12a-ecb9-4008-bf1b-28b2165dca99" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:50:24 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26164313436333530', 'path': '/dev/sdc'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164313436333530', 'path': '/dev/sdc'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kevyfSjE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:50:25 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:50:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:50:25 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:50:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:50:25 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[759ce1b9-dd1d-4b0b-82c6-aab40bc59372]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 06:50:25 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[648f4eec-7858-417d-b37d-e2574a796d72]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0] added
Aug 09 06:50:25 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[19980d31-c1c3-43e5-95c3-8ca12a10e2ba]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3f9d8a-fc9a-494f-af21-851dbbb702f3]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kevyfSjE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kevyfSjE" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c91987f-b09b-488a-a50a-5f74505203c9]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kevyfSjE'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca3baf0-602d-436e-80ba-f8fdc4c9de28]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43e4c4f-d16c-40fe-bf08-b8e6bba8dc2c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:50:25 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:50:25 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:50:25 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:50:25 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e85fd3d-5aa8-4607-8e59-ba9bc214d353]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0, portal: 172.16.0.220,3260]
Aug 09 06:50:25 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0, portal: 172.16.0.220,3260] successful.
Aug 09 06:50:25 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[10603cd5-8231-4224-96d6-511f4743ab1b]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG nova.compute.manager [req-237e6516-6e11-4736-b352-65094033677f req-78b203b1-1580-4c38-a92f-a8107025972d service nova] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Received event network-vif-plugged-1f55eca0-6fea-4eed-a90a-1cd7e9769d68 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-237e6516-6e11-4736-b352-65094033677f req-78b203b1-1580-4c38-a92f-a8107025972d service nova] Acquiring lock "b1d6a12a-ecb9-4008-bf1b-28b2165dca99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-237e6516-6e11-4736-b352-65094033677f req-78b203b1-1580-4c38-a92f-a8107025972d service nova] Lock "b1d6a12a-ecb9-4008-bf1b-28b2165dca99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-237e6516-6e11-4736-b352-65094033677f req-78b203b1-1580-4c38-a92f-a8107025972d service nova] Lock "b1d6a12a-ecb9-4008-bf1b-28b2165dca99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG nova.compute.manager [req-237e6516-6e11-4736-b352-65094033677f req-78b203b1-1580-4c38-a92f-a8107025972d service nova] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] No waiting events found dispatching network-vif-plugged-1f55eca0-6fea-4eed-a90a-1cd7e9769d68 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:50:25 user nova-compute[72809]: WARNING nova.compute.manager [req-237e6516-6e11-4736-b352-65094033677f req-78b203b1-1580-4c38-a92f-a8107025972d service nova] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Received unexpected event network-vif-plugged-1f55eca0-6fea-4eed-a90a-1cd7e9769d68 for instance with vm_state building and task_state spawning.
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc1d20c-3cf0-4c33-a75f-d0afe5d1904a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:50:25 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:50:25 user nova-compute[72809]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)
Aug 09 06:50:25 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:50:25 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:50:25 user nova-compute[72809]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)
Aug 09 06:50:25 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd598a26-b275-49d0-b772-f06008c60f1b]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-24ba9b41-d0bf-4a84-9f04-bfda9525b154" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-24ba9b41-d0bf-4a84-9f04-bfda9525b154" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:50:25 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Updating instance_info_cache with network_info: [{"id": "f12bff80-425f-42ba-804d-540ad751f70c", "address": "fa:16:3e:36:6c:27", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12bff80-42", "ovs_interfaceid": "f12bff80-425f-42ba-804d-540ad751f70c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-24ba9b41-d0bf-4a84-9f04-bfda9525b154" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kevyfSjE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23638633265626532', 'path': '/dev/sdd'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638633265626532', 'path': '/dev/sdd'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:49:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1253190687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1253190687',id=10,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiZtuCjlnJJm/mGv7lthMY8BbpPUcXlvL0RQRVvPI13aTpJkIFenaeN59k9LZ4ZTFgt75ah3g634KMsDG2jlpFiZ66QrhHmscfpQ7RXE3e53ltT178RwMVQrMM4ijik8w==',key_name='tempest-keypair-304464645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d77aa113e6ca4baea8cb26d9abbb1d89',ramdisk_id='',reservation_id='r-ag679rbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-899801422',owner_user_name='tempest-TaggedBootDevicesTest_v242-899801422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:49:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e07bd13d284f4b289ce805dd71d24919',uuid=f7c9bbfa-b588-4ea7-ada4-d7f806ab2381,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6581cf5a-ea10-419c-bd09-1f803299c311", "address": "fa:16:3e:fd:67:27", "network": {"id": "1f3ccbb7-90ef-4b31-8fe7-319423a4c195", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1335319963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6581cf5a-ea", "ovs_interfaceid": "6581cf5a-ea10-419c-bd09-1f803299c311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converting VIF {"id": "6581cf5a-ea10-419c-bd09-1f803299c311", "address": "fa:16:3e:fd:67:27", "network": {"id": "1f3ccbb7-90ef-4b31-8fe7-319423a4c195", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1335319963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6581cf5a-ea", "ovs_interfaceid": "6581cf5a-ea10-419c-bd09-1f803299c311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:67:27,bridge_name='br-int',has_traffic_filtering=True,id=6581cf5a-ea10-419c-bd09-1f803299c311,network=Network(1f3ccbb7-90ef-4b31-8fe7-319423a4c195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6581cf5a-ea') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:49:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1253190687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1253190687',id=10,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiZtuCjlnJJm/mGv7lthMY8BbpPUcXlvL0RQRVvPI13aTpJkIFenaeN59k9LZ4ZTFgt75ah3g634KMsDG2jlpFiZ66QrhHmscfpQ7RXE3e53ltT178RwMVQrMM4ijik8w==',key_name='tempest-keypair-304464645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d77aa113e6ca4baea8cb26d9abbb1d89',ramdisk_id='',reservation_id='r-ag679rbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-899801422',owner_user_name='tempest-TaggedBootDevicesTest_v242-899801422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:49:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e07bd13d284f4b289ce805dd71d24919',uuid=f7c9bbfa-b588-4ea7-ada4-d7f806ab2381,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "address": "fa:16:3e:cc:aa:3b", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap530fb6cf-4b", "ovs_interfaceid": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converting VIF {"id": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "address": "fa:16:3e:cc:aa:3b", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap530fb6cf-4b", "ovs_interfaceid": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:aa:3b,bridge_name='br-int',has_traffic_filtering=True,id=530fb6cf-4b83-44a2-9792-7d844987f6e8,network=Network(67a54896-b575-4b4a-a125-aba8d83f674e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap530fb6cf-4b') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:49:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1253190687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1253190687',id=10,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiZtuCjlnJJm/mGv7lthMY8BbpPUcXlvL0RQRVvPI13aTpJkIFenaeN59k9LZ4ZTFgt75ah3g634KMsDG2jlpFiZ66QrhHmscfpQ7RXE3e53ltT178RwMVQrMM4ijik8w==',key_name='tempest-keypair-304464645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d77aa113e6ca4baea8cb26d9abbb1d89',ramdisk_id='',reservation_id='r-ag679rbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-899801422',owner_user_name='tempest-TaggedBootDevicesTest_v242-899801422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:49:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e07bd13d284f4b289ce805dd71d24919',uuid=f7c9bbfa-b588-4ea7-ada4-d7f806ab2381,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "address": "fa:16:3e:f7:75:6f", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b8369b-02", "ovs_interfaceid": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converting VIF {"id": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "address": "fa:16:3e:f7:75:6f", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b8369b-02", "ovs_interfaceid": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:75:6f,bridge_name='br-int',has_traffic_filtering=True,id=e3b8369b-0287-4dc7-8465-325f8eb9e413,network=Network(67a54896-b575-4b4a-a125-aba8d83f674e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape3b8369b-02') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:49:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1253190687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1253190687',id=10,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiZtuCjlnJJm/mGv7lthMY8BbpPUcXlvL0RQRVvPI13aTpJkIFenaeN59k9LZ4ZTFgt75ah3g634KMsDG2jlpFiZ66QrhHmscfpQ7RXE3e53ltT178RwMVQrMM4ijik8w==',key_name='tempest-keypair-304464645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d77aa113e6ca4baea8cb26d9abbb1d89',ramdisk_id='',reservation_id='r-ag679rbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-899801422',owner_user_name='tempest-TaggedBootDevicesTest_v242-899801422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:49:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e07bd13d284f4b289ce805dd71d24919',uuid=f7c9bbfa-b588-4ea7-ada4-d7f806ab2381,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7994fbc-d242-4b35-aad4-88bf2f3bc7a3", "address": "fa:16:3e:d1:3f:09", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7994fbc-d2", "ovs_interfaceid": "d7994fbc-d242-4b35-aad4-88bf2f3bc7a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converting VIF {"id": "d7994fbc-d242-4b35-aad4-88bf2f3bc7a3", "address": "fa:16:3e:d1:3f:09", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7994fbc-d2", "ovs_interfaceid": "d7994fbc-d242-4b35-aad4-88bf2f3bc7a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:3f:09,bridge_name='br-int',has_traffic_filtering=True,id=d7994fbc-d242-4b35-aad4-88bf2f3bc7a3,network=Network(67a54896-b575-4b4a-a125-aba8d83f674e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7994fbc-d2') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:49:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1253190687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1253190687',id=10,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiZtuCjlnJJm/mGv7lthMY8BbpPUcXlvL0RQRVvPI13aTpJkIFenaeN59k9LZ4ZTFgt75ah3g634KMsDG2jlpFiZ66QrhHmscfpQ7RXE3e53ltT178RwMVQrMM4ijik8w==',key_name='tempest-keypair-304464645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d77aa113e6ca4baea8cb26d9abbb1d89',ramdisk_id='',reservation_id='r-ag679rbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-899801422',owner_user_name='tempest-TaggedBootDevicesTest_v242-899801422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:49:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e07bd13d284f4b289ce805dd71d24919',uuid=f7c9bbfa-b588-4ea7-ada4-d7f806ab2381,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923", "address": "fa:16:3e:f1:35:4f", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fc4dcc0-2a", "ovs_interfaceid": "9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converting VIF {"id": "9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923", "address": "fa:16:3e:f1:35:4f", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fc4dcc0-2a", "ovs_interfaceid": "9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:35:4f,bridge_name='br-int',has_traffic_filtering=True,id=9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923,network=Network(67a54896-b575-4b4a-a125-aba8d83f674e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fc4dcc0-2a') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:49:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1253190687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1253190687',id=10,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiZtuCjlnJJm/mGv7lthMY8BbpPUcXlvL0RQRVvPI13aTpJkIFenaeN59k9LZ4ZTFgt75ah3g634KMsDG2jlpFiZ66QrhHmscfpQ7RXE3e53ltT178RwMVQrMM4ijik8w==',key_name='tempest-keypair-304464645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d77aa113e6ca4baea8cb26d9abbb1d89',ramdisk_id='',reservation_id='r-ag679rbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-899801422',owner_user_name='tempest-TaggedBootDevicesTest_v242-899801422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:49:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e07bd13d284f4b289ce805dd71d24919',uuid=f7c9bbfa-b588-4ea7-ada4-d7f806ab2381,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e76b5e9-78c1-405c-a866-be6f997ae4c7", "address": "fa:16:3e:8a:53:47", "network": {"id": "3c0698b4-4d41-4ad0-a954-b112d7796107", "bridge": "br-int", "label": "tempest-device-tagging-net2-1070297502", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e76b5e9-78", "ovs_interfaceid": "4e76b5e9-78c1-405c-a866-be6f997ae4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converting VIF {"id": "4e76b5e9-78c1-405c-a866-be6f997ae4c7", "address": "fa:16:3e:8a:53:47", "network": {"id": "3c0698b4-4d41-4ad0-a954-b112d7796107", "bridge": "br-int", "label": "tempest-device-tagging-net2-1070297502", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e76b5e9-78", "ovs_interfaceid": "4e76b5e9-78c1-405c-a866-be6f997ae4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:53:47,bridge_name='br-int',has_traffic_filtering=True,id=4e76b5e9-78c1-405c-a866-be6f997ae4c7,network=Network(3c0698b4-4d41-4ad0-a954-b112d7796107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e76b5e9-78') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:49:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1253190687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1253190687',id=10,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiZtuCjlnJJm/mGv7lthMY8BbpPUcXlvL0RQRVvPI13aTpJkIFenaeN59k9LZ4ZTFgt75ah3g634KMsDG2jlpFiZ66QrhHmscfpQ7RXE3e53ltT178RwMVQrMM4ijik8w==',key_name='tempest-keypair-304464645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d77aa113e6ca4baea8cb26d9abbb1d89',ramdisk_id='',reservation_id='r-ag679rbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-899801422',owner_user_name='tempest-TaggedBootDevicesTest_v242-899801422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:49:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e07bd13d284f4b289ce805dd71d24919',uuid=f7c9bbfa-b588-4ea7-ada4-d7f806ab2381,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23fba0ea-7bd6-4b7e-81a7-055a92b53590", "address": "fa:16:3e:ff:56:8a", "network": {"id": "3c0698b4-4d41-4ad0-a954-b112d7796107", "bridge": "br-int", "label": "tempest-device-tagging-net2-1070297502", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23fba0ea-7b", "ovs_interfaceid": "23fba0ea-7bd6-4b7e-81a7-055a92b53590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converting VIF {"id": "23fba0ea-7bd6-4b7e-81a7-055a92b53590", "address": "fa:16:3e:ff:56:8a", "network": {"id": "3c0698b4-4d41-4ad0-a954-b112d7796107", "bridge": "br-int", "label": "tempest-device-tagging-net2-1070297502", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23fba0ea-7b", "ovs_interfaceid": "23fba0ea-7bd6-4b7e-81a7-055a92b53590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:56:8a,bridge_name='br-int',has_traffic_filtering=True,id=23fba0ea-7bd6-4b7e-81a7-055a92b53590,network=Network(3c0698b4-4d41-4ad0-a954-b112d7796107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23fba0ea-7b') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.objects.instance [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lazy-loading 'pci_devices' on Instance uuid f7c9bbfa-b588-4ea7-ada4-d7f806ab2381 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:50:26 user nova-compute[72809]:   <uuid>f7c9bbfa-b588-4ea7-ada4-d7f806ab2381</uuid>
Aug 09 06:50:26 user nova-compute[72809]:   <name>instance-0000000a</name>
Aug 09 06:50:26 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:50:26 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:50:26 user nova-compute[72809]:   <metadata>
Aug 09 06:50:26 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:50:26 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:50:26 user nova-compute[72809]:       <nova:name>tempest-device-tagging-server-1253190687</nova:name>
Aug 09 06:50:26 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:50:22</nova:creationTime>
Aug 09 06:50:26 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:50:26 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:50:26 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:50:26 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:50:26 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:50:26 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:50:26 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:50:26 user nova-compute[72809]:       <nova:owner>
Aug 09 06:50:26 user nova-compute[72809]:         <nova:user uuid="e07bd13d284f4b289ce805dd71d24919">tempest-TaggedBootDevicesTest_v242-899801422-project-member</nova:user>
Aug 09 06:50:26 user nova-compute[72809]:         <nova:project uuid="d77aa113e6ca4baea8cb26d9abbb1d89">tempest-TaggedBootDevicesTest_v242-899801422</nova:project>
Aug 09 06:50:26 user nova-compute[72809]:       </nova:owner>
Aug 09 06:50:26 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:50:26 user nova-compute[72809]:       <nova:ports>
Aug 09 06:50:26 user nova-compute[72809]:         <nova:port uuid="6581cf5a-ea10-419c-bd09-1f803299c311">
Aug 09 06:50:26 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 06:50:26 user nova-compute[72809]:         </nova:port>
Aug 09 06:50:26 user nova-compute[72809]:         <nova:port uuid="530fb6cf-4b83-44a2-9792-7d844987f6e8">
Aug 09 06:50:26 user nova-compute[72809]:           <nova:ip type="fixed" address="10.1.1.96" ipVersion="4"/>
Aug 09 06:50:26 user nova-compute[72809]:         </nova:port>
Aug 09 06:50:26 user nova-compute[72809]:         <nova:port uuid="e3b8369b-0287-4dc7-8465-325f8eb9e413">
Aug 09 06:50:26 user nova-compute[72809]:           <nova:ip type="fixed" address="10.1.1.8" ipVersion="4"/>
Aug 09 06:50:26 user nova-compute[72809]:         </nova:port>
Aug 09 06:50:26 user nova-compute[72809]:         <nova:port uuid="d7994fbc-d242-4b35-aad4-88bf2f3bc7a3">
Aug 09 06:50:26 user nova-compute[72809]:           <nova:ip type="fixed" address="10.1.1.220" ipVersion="4"/>
Aug 09 06:50:26 user nova-compute[72809]:         </nova:port>
Aug 09 06:50:26 user nova-compute[72809]:         <nova:port uuid="9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923">
Aug 09 06:50:26 user nova-compute[72809]:           <nova:ip type="fixed" address="10.1.1.44" ipVersion="4"/>
Aug 09 06:50:26 user nova-compute[72809]:         </nova:port>
Aug 09 06:50:26 user nova-compute[72809]:         <nova:port uuid="4e76b5e9-78c1-405c-a866-be6f997ae4c7">
Aug 09 06:50:26 user nova-compute[72809]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 09 06:50:26 user nova-compute[72809]:         </nova:port>
Aug 09 06:50:26 user nova-compute[72809]:         <nova:port uuid="23fba0ea-7bd6-4b7e-81a7-055a92b53590">
Aug 09 06:50:26 user nova-compute[72809]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 09 06:50:26 user nova-compute[72809]:         </nova:port>
Aug 09 06:50:26 user nova-compute[72809]:       </nova:ports>
Aug 09 06:50:26 user nova-compute[72809]:     </nova:instance>
Aug 09 06:50:26 user nova-compute[72809]:   </metadata>
Aug 09 06:50:26 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:50:26 user nova-compute[72809]:     <system>
Aug 09 06:50:26 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:50:26 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:50:26 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:50:26 user nova-compute[72809]:       <entry name="serial">f7c9bbfa-b588-4ea7-ada4-d7f806ab2381</entry>
Aug 09 06:50:26 user nova-compute[72809]:       <entry name="uuid">f7c9bbfa-b588-4ea7-ada4-d7f806ab2381</entry>
Aug 09 06:50:26 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:50:26 user nova-compute[72809]:     </system>
Aug 09 06:50:26 user nova-compute[72809]:   </sysinfo>
Aug 09 06:50:26 user nova-compute[72809]:   <os>
Aug 09 06:50:26 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:50:26 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 06:50:26 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:50:26 user nova-compute[72809]:   </os>
Aug 09 06:50:26 user nova-compute[72809]:   <features>
Aug 09 06:50:26 user nova-compute[72809]:     <acpi/>
Aug 09 06:50:26 user nova-compute[72809]:     <apic/>
Aug 09 06:50:26 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:50:26 user nova-compute[72809]:   </features>
Aug 09 06:50:26 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:50:26 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:50:26 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:50:26 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:50:26 user nova-compute[72809]:   </clock>
Aug 09 06:50:26 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:50:26 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:50:26 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:50:26 user nova-compute[72809]:   </cpu>
Aug 09 06:50:26 user nova-compute[72809]:   <devices>
Aug 09 06:50:26 user nova-compute[72809]:     <disk type="file" device="cdrom">
Aug 09 06:50:26 user nova-compute[72809]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 06:50:26 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/f7c9bbfa-b588-4ea7-ada4-d7f806ab2381/disk.config"/>
Aug 09 06:50:26 user nova-compute[72809]:       <target dev="hda" bus="ide"/>
Aug 09 06:50:26 user nova-compute[72809]:     </disk>
Aug 09 06:50:26 user nova-compute[72809]:     <disk type="block" device="disk">
Aug 09 06:50:26 user nova-compute[72809]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:50:26 user nova-compute[72809]:       <source dev="/dev/sdb"/>
Aug 09 06:50:26 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:50:26 user nova-compute[72809]:       <serial>c55bd25a-5fe0-4c5e-9e36-d0a73de24719</serial>
Aug 09 06:50:26 user nova-compute[72809]:     </disk>
Aug 09 06:50:26 user nova-compute[72809]:     <disk type="block" device="disk">
Aug 09 06:50:26 user nova-compute[72809]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:50:26 user nova-compute[72809]:       <source dev="/dev/sdc"/>
Aug 09 06:50:26 user nova-compute[72809]:       <target dev="vdb" bus="virtio"/>
Aug 09 06:50:26 user nova-compute[72809]:       <serial>b1599d24-eefb-4811-b6d9-3a9bd82b8587</serial>
Aug 09 06:50:26 user nova-compute[72809]:     </disk>
Aug 09 06:50:26 user nova-compute[72809]:     <disk type="block" device="disk">
Aug 09 06:50:26 user nova-compute[72809]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:50:26 user nova-compute[72809]:       <source dev="/dev/sdd"/>
Aug 09 06:50:26 user nova-compute[72809]:       <target dev="vdc" bus="virtio"/>
Aug 09 06:50:26 user nova-compute[72809]:       <serial>326cadef-34a9-4a12-9cea-77eecb2c95d0</serial>
Aug 09 06:50:26 user nova-compute[72809]:     </disk>
Aug 09 06:50:26 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:50:26 user nova-compute[72809]:       <mac address="fa:16:3e:fd:67:27"/>
Aug 09 06:50:26 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:50:26 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:50:26 user nova-compute[72809]:       <target dev="tap6581cf5a-ea"/>
Aug 09 06:50:26 user nova-compute[72809]:     </interface>
Aug 09 06:50:26 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:50:26 user nova-compute[72809]:       <mac address="fa:16:3e:cc:aa:3b"/>
Aug 09 06:50:26 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:50:26 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:50:26 user nova-compute[72809]:       <target dev="tap530fb6cf-4b"/>
Aug 09 06:50:26 user nova-compute[72809]:     </interface>
Aug 09 06:50:26 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:50:26 user nova-compute[72809]:       <mac address="fa:16:3e:f7:75:6f"/>
Aug 09 06:50:26 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:50:26 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:50:26 user nova-compute[72809]:       <target dev="tape3b8369b-02"/>
Aug 09 06:50:26 user nova-compute[72809]:     </interface>
Aug 09 06:50:26 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:50:26 user nova-compute[72809]:       <mac address="fa:16:3e:d1:3f:09"/>
Aug 09 06:50:26 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:50:26 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:50:26 user nova-compute[72809]:       <target dev="tapd7994fbc-d2"/>
Aug 09 06:50:26 user nova-compute[72809]:     </interface>
Aug 09 06:50:26 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:50:26 user nova-compute[72809]:       <mac address="fa:16:3e:f1:35:4f"/>
Aug 09 06:50:26 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:50:26 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:50:26 user nova-compute[72809]:       <target dev="tap9fc4dcc0-2a"/>
Aug 09 06:50:26 user nova-compute[72809]:     </interface>
Aug 09 06:50:26 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:50:26 user nova-compute[72809]:       <mac address="fa:16:3e:8a:53:47"/>
Aug 09 06:50:26 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:50:26 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:50:26 user nova-compute[72809]:       <target dev="tap4e76b5e9-78"/>
Aug 09 06:50:26 user nova-compute[72809]:     </interface>
Aug 09 06:50:26 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:50:26 user nova-compute[72809]:       <mac address="fa:16:3e:ff:56:8a"/>
Aug 09 06:50:26 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:50:26 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:50:26 user nova-compute[72809]:       <target dev="tap23fba0ea-7b"/>
Aug 09 06:50:26 user nova-compute[72809]:     </interface>
Aug 09 06:50:26 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:50:26 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/f7c9bbfa-b588-4ea7-ada4-d7f806ab2381/console.log" append="off"/>
Aug 09 06:50:26 user nova-compute[72809]:     </serial>
Aug 09 06:50:26 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:50:26 user nova-compute[72809]:     <video>
Aug 09 06:50:26 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:50:26 user nova-compute[72809]:     </video>
Aug 09 06:50:26 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:50:26 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:50:26 user nova-compute[72809]:     </rng>
Aug 09 06:50:26 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:50:26 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:50:26 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:50:26 user nova-compute[72809]:     </memballoon>
Aug 09 06:50:26 user nova-compute[72809]:   </devices>
Aug 09 06:50:26 user nova-compute[72809]: </domain>
Aug 09 06:50:26 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:49:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1253190687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1253190687',id=10,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiZtuCjlnJJm/mGv7lthMY8BbpPUcXlvL0RQRVvPI13aTpJkIFenaeN59k9LZ4ZTFgt75ah3g634KMsDG2jlpFiZ66QrhHmscfpQ7RXE3e53ltT178RwMVQrMM4ijik8w==',key_name='tempest-keypair-304464645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d77aa113e6ca4baea8cb26d9abbb1d89',ramdisk_id='',reservation_id='r-ag679rbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-899801422',owner_user_name='tempest-TaggedBootDevicesTest_v242-899801422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:49:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e07bd13d284f4b289ce805dd71d24919',uuid=f7c9bbfa-b588-4ea7-ada4-d7f806ab2381,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6581cf5a-ea10-419c-bd09-1f803299c311", "address": "fa:16:3e:fd:67:27", "network": {"id": "1f3ccbb7-90ef-4b31-8fe7-319423a4c195", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1335319963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6581cf5a-ea", "ovs_interfaceid": "6581cf5a-ea10-419c-bd09-1f803299c311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converting VIF {"id": "6581cf5a-ea10-419c-bd09-1f803299c311", "address": "fa:16:3e:fd:67:27", "network": {"id": "1f3ccbb7-90ef-4b31-8fe7-319423a4c195", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1335319963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6581cf5a-ea", "ovs_interfaceid": "6581cf5a-ea10-419c-bd09-1f803299c311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:67:27,bridge_name='br-int',has_traffic_filtering=True,id=6581cf5a-ea10-419c-bd09-1f803299c311,network=Network(1f3ccbb7-90ef-4b31-8fe7-319423a4c195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6581cf5a-ea') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG os_vif [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:67:27,bridge_name='br-int',has_traffic_filtering=True,id=6581cf5a-ea10-419c-bd09-1f803299c311,network=Network(1f3ccbb7-90ef-4b31-8fe7-319423a4c195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6581cf5a-ea') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6581cf5a-ea, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6581cf5a-ea, col_values=(('external_ids', {'iface-id': '6581cf5a-ea10-419c-bd09-1f803299c311', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:67:27', 'vm-uuid': 'f7c9bbfa-b588-4ea7-ada4-d7f806ab2381'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:26 user nova-compute[72809]: INFO os_vif [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:67:27,bridge_name='br-int',has_traffic_filtering=True,id=6581cf5a-ea10-419c-bd09-1f803299c311,network=Network(1f3ccbb7-90ef-4b31-8fe7-319423a4c195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6581cf5a-ea')
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:49:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1253190687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1253190687',id=10,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiZtuCjlnJJm/mGv7lthMY8BbpPUcXlvL0RQRVvPI13aTpJkIFenaeN59k9LZ4ZTFgt75ah3g634KMsDG2jlpFiZ66QrhHmscfpQ7RXE3e53ltT178RwMVQrMM4ijik8w==',key_name='tempest-keypair-304464645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d77aa113e6ca4baea8cb26d9abbb1d89',ramdisk_id='',reservation_id='r-ag679rbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-899801422',owner_user_name='tempest-TaggedBootDevicesTest_v242-899801422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:49:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e07bd13d284f4b289ce805dd71d24919',uuid=f7c9bbfa-b588-4ea7-ada4-d7f806ab2381,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "address": "fa:16:3e:cc:aa:3b", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap530fb6cf-4b", "ovs_interfaceid": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converting VIF {"id": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "address": "fa:16:3e:cc:aa:3b", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap530fb6cf-4b", "ovs_interfaceid": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:aa:3b,bridge_name='br-int',has_traffic_filtering=True,id=530fb6cf-4b83-44a2-9792-7d844987f6e8,network=Network(67a54896-b575-4b4a-a125-aba8d83f674e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap530fb6cf-4b') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG os_vif [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:aa:3b,bridge_name='br-int',has_traffic_filtering=True,id=530fb6cf-4b83-44a2-9792-7d844987f6e8,network=Network(67a54896-b575-4b4a-a125-aba8d83f674e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap530fb6cf-4b') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap530fb6cf-4b, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap530fb6cf-4b, col_values=(('external_ids', {'iface-id': '530fb6cf-4b83-44a2-9792-7d844987f6e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:aa:3b', 'vm-uuid': 'f7c9bbfa-b588-4ea7-ada4-d7f806ab2381'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:26 user nova-compute[72809]: INFO os_vif [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:aa:3b,bridge_name='br-int',has_traffic_filtering=True,id=530fb6cf-4b83-44a2-9792-7d844987f6e8,network=Network(67a54896-b575-4b4a-a125-aba8d83f674e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap530fb6cf-4b')
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:49:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1253190687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1253190687',id=10,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiZtuCjlnJJm/mGv7lthMY8BbpPUcXlvL0RQRVvPI13aTpJkIFenaeN59k9LZ4ZTFgt75ah3g634KMsDG2jlpFiZ66QrhHmscfpQ7RXE3e53ltT178RwMVQrMM4ijik8w==',key_name='tempest-keypair-304464645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d77aa113e6ca4baea8cb26d9abbb1d89',ramdisk_id='',reservation_id='r-ag679rbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-899801422',owner_user_name='tempest-TaggedBootDevicesTest_v242-899801422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:49:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e07bd13d284f4b289ce805dd71d24919',uuid=f7c9bbfa-b588-4ea7-ada4-d7f806ab2381,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "address": "fa:16:3e:f7:75:6f", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b8369b-02", "ovs_interfaceid": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converting VIF {"id": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "address": "fa:16:3e:f7:75:6f", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b8369b-02", "ovs_interfaceid": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:75:6f,bridge_name='br-int',has_traffic_filtering=True,id=e3b8369b-0287-4dc7-8465-325f8eb9e413,network=Network(67a54896-b575-4b4a-a125-aba8d83f674e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape3b8369b-02') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG os_vif [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:75:6f,bridge_name='br-int',has_traffic_filtering=True,id=e3b8369b-0287-4dc7-8465-325f8eb9e413,network=Network(67a54896-b575-4b4a-a125-aba8d83f674e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape3b8369b-02') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3b8369b-02, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape3b8369b-02, col_values=(('external_ids', {'iface-id': 'e3b8369b-0287-4dc7-8465-325f8eb9e413', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:75:6f', 'vm-uuid': 'f7c9bbfa-b588-4ea7-ada4-d7f806ab2381'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:50:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:27 user nova-compute[72809]: INFO os_vif [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:75:6f,bridge_name='br-int',has_traffic_filtering=True,id=e3b8369b-0287-4dc7-8465-325f8eb9e413,network=Network(67a54896-b575-4b4a-a125-aba8d83f674e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape3b8369b-02')
Aug 09 06:50:27 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:49:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1253190687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1253190687',id=10,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiZtuCjlnJJm/mGv7lthMY8BbpPUcXlvL0RQRVvPI13aTpJkIFenaeN59k9LZ4ZTFgt75ah3g634KMsDG2jlpFiZ66QrhHmscfpQ7RXE3e53ltT178RwMVQrMM4ijik8w==',key_name='tempest-keypair-304464645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d77aa113e6ca4baea8cb26d9abbb1d89',ramdisk_id='',reservation_id='r-ag679rbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-899801422',owner_user_name='tempest-TaggedBootDevicesTest_v242-899801422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:49:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e07bd13d284f4b289ce805dd71d24919',uuid=f7c9bbfa-b588-4ea7-ada4-d7f806ab2381,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7994fbc-d242-4b35-aad4-88bf2f3bc7a3", "address": "fa:16:3e:d1:3f:09", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7994fbc-d2", "ovs_interfaceid": "d7994fbc-d242-4b35-aad4-88bf2f3bc7a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converting VIF {"id": "d7994fbc-d242-4b35-aad4-88bf2f3bc7a3", "address": "fa:16:3e:d1:3f:09", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7994fbc-d2", "ovs_interfaceid": "d7994fbc-d242-4b35-aad4-88bf2f3bc7a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:3f:09,bridge_name='br-int',has_traffic_filtering=True,id=d7994fbc-d242-4b35-aad4-88bf2f3bc7a3,network=Network(67a54896-b575-4b4a-a125-aba8d83f674e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7994fbc-d2') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG os_vif [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:3f:09,bridge_name='br-int',has_traffic_filtering=True,id=d7994fbc-d242-4b35-aad4-88bf2f3bc7a3,network=Network(67a54896-b575-4b4a-a125-aba8d83f674e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7994fbc-d2') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6a12a-ecb9-4008-bf1b-28b2165dca99/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7994fbc-d2, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd7994fbc-d2, col_values=(('external_ids', {'iface-id': 'd7994fbc-d242-4b35-aad4-88bf2f3bc7a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:3f:09', 'vm-uuid': 'f7c9bbfa-b588-4ea7-ada4-d7f806ab2381'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:27 user nova-compute[72809]: INFO os_vif [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:3f:09,bridge_name='br-int',has_traffic_filtering=True,id=d7994fbc-d242-4b35-aad4-88bf2f3bc7a3,network=Network(67a54896-b575-4b4a-a125-aba8d83f674e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7994fbc-d2')
Aug 09 06:50:27 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:49:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1253190687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1253190687',id=10,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiZtuCjlnJJm/mGv7lthMY8BbpPUcXlvL0RQRVvPI13aTpJkIFenaeN59k9LZ4ZTFgt75ah3g634KMsDG2jlpFiZ66QrhHmscfpQ7RXE3e53ltT178RwMVQrMM4ijik8w==',key_name='tempest-keypair-304464645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d77aa113e6ca4baea8cb26d9abbb1d89',ramdisk_id='',reservation_id='r-ag679rbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-899801422',owner_user_name='tempest-TaggedBootDevicesTest_v242-899801422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:49:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e07bd13d284f4b289ce805dd71d24919',uuid=f7c9bbfa-b588-4ea7-ada4-d7f806ab2381,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923", "address": "fa:16:3e:f1:35:4f", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fc4dcc0-2a", "ovs_interfaceid": "9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converting VIF {"id": "9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923", "address": "fa:16:3e:f1:35:4f", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fc4dcc0-2a", "ovs_interfaceid": "9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:35:4f,bridge_name='br-int',has_traffic_filtering=True,id=9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923,network=Network(67a54896-b575-4b4a-a125-aba8d83f674e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fc4dcc0-2a') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG os_vif [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:35:4f,bridge_name='br-int',has_traffic_filtering=True,id=9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923,network=Network(67a54896-b575-4b4a-a125-aba8d83f674e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fc4dcc0-2a') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9fc4dcc0-2a, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9fc4dcc0-2a, col_values=(('external_ids', {'iface-id': '9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:35:4f', 'vm-uuid': 'f7c9bbfa-b588-4ea7-ada4-d7f806ab2381'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6a12a-ecb9-4008-bf1b-28b2165dca99/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6a12a-ecb9-4008-bf1b-28b2165dca99/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:27 user nova-compute[72809]: INFO os_vif [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:35:4f,bridge_name='br-int',has_traffic_filtering=True,id=9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923,network=Network(67a54896-b575-4b4a-a125-aba8d83f674e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fc4dcc0-2a')
Aug 09 06:50:27 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:49:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1253190687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1253190687',id=10,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiZtuCjlnJJm/mGv7lthMY8BbpPUcXlvL0RQRVvPI13aTpJkIFenaeN59k9LZ4ZTFgt75ah3g634KMsDG2jlpFiZ66QrhHmscfpQ7RXE3e53ltT178RwMVQrMM4ijik8w==',key_name='tempest-keypair-304464645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d77aa113e6ca4baea8cb26d9abbb1d89',ramdisk_id='',reservation_id='r-ag679rbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-899801422',owner_user_name='tempest-TaggedBootDevicesTest_v242-899801422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:49:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e07bd13d284f4b289ce805dd71d24919',uuid=f7c9bbfa-b588-4ea7-ada4-d7f806ab2381,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e76b5e9-78c1-405c-a866-be6f997ae4c7", "address": "fa:16:3e:8a:53:47", "network": {"id": "3c0698b4-4d41-4ad0-a954-b112d7796107", "bridge": "br-int", "label": "tempest-device-tagging-net2-1070297502", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e76b5e9-78", "ovs_interfaceid": "4e76b5e9-78c1-405c-a866-be6f997ae4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converting VIF {"id": "4e76b5e9-78c1-405c-a866-be6f997ae4c7", "address": "fa:16:3e:8a:53:47", "network": {"id": "3c0698b4-4d41-4ad0-a954-b112d7796107", "bridge": "br-int", "label": "tempest-device-tagging-net2-1070297502", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e76b5e9-78", "ovs_interfaceid": "4e76b5e9-78c1-405c-a866-be6f997ae4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:53:47,bridge_name='br-int',has_traffic_filtering=True,id=4e76b5e9-78c1-405c-a866-be6f997ae4c7,network=Network(3c0698b4-4d41-4ad0-a954-b112d7796107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e76b5e9-78') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG os_vif [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:53:47,bridge_name='br-int',has_traffic_filtering=True,id=4e76b5e9-78c1-405c-a866-be6f997ae4c7,network=Network(3c0698b4-4d41-4ad0-a954-b112d7796107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e76b5e9-78') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e76b5e9-78, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4e76b5e9-78, col_values=(('external_ids', {'iface-id': '4e76b5e9-78c1-405c-a866-be6f997ae4c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:53:47', 'vm-uuid': 'f7c9bbfa-b588-4ea7-ada4-d7f806ab2381'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:27 user nova-compute[72809]: INFO os_vif [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:53:47,bridge_name='br-int',has_traffic_filtering=True,id=4e76b5e9-78c1-405c-a866-be6f997ae4c7,network=Network(3c0698b4-4d41-4ad0-a954-b112d7796107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e76b5e9-78')
Aug 09 06:50:27 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:49:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1253190687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1253190687',id=10,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiZtuCjlnJJm/mGv7lthMY8BbpPUcXlvL0RQRVvPI13aTpJkIFenaeN59k9LZ4ZTFgt75ah3g634KMsDG2jlpFiZ66QrhHmscfpQ7RXE3e53ltT178RwMVQrMM4ijik8w==',key_name='tempest-keypair-304464645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d77aa113e6ca4baea8cb26d9abbb1d89',ramdisk_id='',reservation_id='r-ag679rbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-899801422',owner_user_name='tempest-TaggedBootDevicesTest_v242-899801422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:49:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e07bd13d284f4b289ce805dd71d24919',uuid=f7c9bbfa-b588-4ea7-ada4-d7f806ab2381,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23fba0ea-7bd6-4b7e-81a7-055a92b53590", "address": "fa:16:3e:ff:56:8a", "network": {"id": "3c0698b4-4d41-4ad0-a954-b112d7796107", "bridge": "br-int", "label": "tempest-device-tagging-net2-1070297502", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23fba0ea-7b", "ovs_interfaceid": "23fba0ea-7bd6-4b7e-81a7-055a92b53590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converting VIF {"id": "23fba0ea-7bd6-4b7e-81a7-055a92b53590", "address": "fa:16:3e:ff:56:8a", "network": {"id": "3c0698b4-4d41-4ad0-a954-b112d7796107", "bridge": "br-int", "label": "tempest-device-tagging-net2-1070297502", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23fba0ea-7b", "ovs_interfaceid": "23fba0ea-7bd6-4b7e-81a7-055a92b53590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:56:8a,bridge_name='br-int',has_traffic_filtering=True,id=23fba0ea-7bd6-4b7e-81a7-055a92b53590,network=Network(3c0698b4-4d41-4ad0-a954-b112d7796107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23fba0ea-7b') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG os_vif [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:56:8a,bridge_name='br-int',has_traffic_filtering=True,id=23fba0ea-7bd6-4b7e-81a7-055a92b53590,network=Network(3c0698b4-4d41-4ad0-a954-b112d7796107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23fba0ea-7b') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23fba0ea-7b, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap23fba0ea-7b, col_values=(('external_ids', {'iface-id': '23fba0ea-7bd6-4b7e-81a7-055a92b53590', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:56:8a', 'vm-uuid': 'f7c9bbfa-b588-4ea7-ada4-d7f806ab2381'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6a12a-ecb9-4008-bf1b-28b2165dca99/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:27 user nova-compute[72809]: INFO os_vif [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:56:8a,bridge_name='br-int',has_traffic_filtering=True,id=23fba0ea-7bd6-4b7e-81a7-055a92b53590,network=Network(3c0698b4-4d41-4ad0-a954-b112d7796107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23fba0ea-7b')
Aug 09 06:50:27 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] No BDM found with device name hda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] No VIF found with MAC fa:16:3e:fd:67:27, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] No VIF found with MAC fa:16:3e:f1:35:4f, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:50:27 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Using config drive
Aug 09 06:50:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG nova.compute.manager [req-f14208bb-3d99-4d66-88be-6e9ac626500b req-3d45fef4-cf44-43a3-b5d1-52b3a0f88df8 service nova] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Received event network-vif-plugged-1f55eca0-6fea-4eed-a90a-1cd7e9769d68 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f14208bb-3d99-4d66-88be-6e9ac626500b req-3d45fef4-cf44-43a3-b5d1-52b3a0f88df8 service nova] Acquiring lock "b1d6a12a-ecb9-4008-bf1b-28b2165dca99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f14208bb-3d99-4d66-88be-6e9ac626500b req-3d45fef4-cf44-43a3-b5d1-52b3a0f88df8 service nova] Lock "b1d6a12a-ecb9-4008-bf1b-28b2165dca99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f14208bb-3d99-4d66-88be-6e9ac626500b req-3d45fef4-cf44-43a3-b5d1-52b3a0f88df8 service nova] Lock "b1d6a12a-ecb9-4008-bf1b-28b2165dca99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG nova.compute.manager [req-f14208bb-3d99-4d66-88be-6e9ac626500b req-3d45fef4-cf44-43a3-b5d1-52b3a0f88df8 service nova] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] No waiting events found dispatching network-vif-plugged-1f55eca0-6fea-4eed-a90a-1cd7e9769d68 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:50:27 user nova-compute[72809]: WARNING nova.compute.manager [req-f14208bb-3d99-4d66-88be-6e9ac626500b req-3d45fef4-cf44-43a3-b5d1-52b3a0f88df8 service nova] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Received unexpected event network-vif-plugged-1f55eca0-6fea-4eed-a90a-1cd7e9769d68 for instance with vm_state building and task_state spawning.
Aug 09 06:50:27 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563827.9055817, b1d6a12a-ecb9-4008-bf1b-28b2165dca99 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:50:27 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] VM Resumed (Lifecycle Event)
Aug 09 06:50:27 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Creating config drive at /opt/stack/data/nova/instances/f7c9bbfa-b588-4ea7-ada4-d7f806ab2381/disk.config
Aug 09 06:50:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f7c9bbfa-b588-4ea7-ada4-d7f806ab2381/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpt7dvakxh {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG nova.compute.manager [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:50:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f7c9bbfa-b588-4ea7-ada4-d7f806ab2381/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpt7dvakxh" returned: 0 in 0.095s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:28 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:50:28 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Instance spawned successfully.
Aug 09 06:50:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 06:50:28 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:50:28 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563827.9090106, b1d6a12a-ecb9-4008-bf1b-28b2165dca99 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:50:28 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] VM Started (Lifecycle Event)
Aug 09 06:50:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:50:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:50:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:50:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:50:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:50:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:50:28 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:50:28 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:50:28 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:50:28 user nova-compute[72809]: DEBUG nova.compute.manager [req-e1960b18-a50f-4c42-94be-5a5fe09752f4 req-12cdaea6-805f-48c1-aca6-1ef51ae072ea service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Received event network-changed-f12bff80-425f-42ba-804d-540ad751f70c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:28 user nova-compute[72809]: DEBUG nova.compute.manager [req-e1960b18-a50f-4c42-94be-5a5fe09752f4 req-12cdaea6-805f-48c1-aca6-1ef51ae072ea service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Refreshing instance network info cache due to event network-changed-f12bff80-425f-42ba-804d-540ad751f70c. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:50:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e1960b18-a50f-4c42-94be-5a5fe09752f4 req-12cdaea6-805f-48c1-aca6-1ef51ae072ea service nova] Acquiring lock "refresh_cache-24ba9b41-d0bf-4a84-9f04-bfda9525b154" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:50:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e1960b18-a50f-4c42-94be-5a5fe09752f4 req-12cdaea6-805f-48c1-aca6-1ef51ae072ea service nova] Acquired lock "refresh_cache-24ba9b41-d0bf-4a84-9f04-bfda9525b154" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:50:28 user nova-compute[72809]: DEBUG nova.network.neutron [req-e1960b18-a50f-4c42-94be-5a5fe09752f4 req-12cdaea6-805f-48c1-aca6-1ef51ae072ea service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Refreshing network info cache for port f12bff80-425f-42ba-804d-540ad751f70c {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:50:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:28 user nova-compute[72809]: INFO nova.compute.manager [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Took 6.01 seconds to spawn the instance on the hypervisor.
Aug 09 06:50:28 user nova-compute[72809]: DEBUG nova.compute.manager [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:50:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:28 user nova-compute[72809]: INFO nova.compute.manager [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Took 6.95 seconds to build instance.
Aug 09 06:50:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-39c00da1-1cdf-494f-a4d8-f1201d3138ad tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lock "b1d6a12a-ecb9-4008-bf1b-28b2165dca99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.071s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16ad749-f432-43e8-a5f9-96158a4308cf/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16ad749-f432-43e8-a5f9-96158a4308cf/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16ad749-f432-43e8-a5f9-96158a4308cf/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-765d1478-2aed-4120-b657-6674687cac7c req-4642cda0-ab20-46d0-bd88-a8e9b4ae3fa8 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received event network-changed-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-765d1478-2aed-4120-b657-6674687cac7c req-4642cda0-ab20-46d0-bd88-a8e9b4ae3fa8 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Refreshing instance network info cache due to event network-changed-030dd6f3-f758-4b5a-b9fb-be3c64cb9341. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:50:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-765d1478-2aed-4120-b657-6674687cac7c req-4642cda0-ab20-46d0-bd88-a8e9b4ae3fa8 service nova] Acquiring lock "refresh_cache-3640991e-8a5b-4674-af81-3117d4269a68" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:50:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-765d1478-2aed-4120-b657-6674687cac7c req-4642cda0-ab20-46d0-bd88-a8e9b4ae3fa8 service nova] Acquired lock "refresh_cache-3640991e-8a5b-4674-af81-3117d4269a68" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:50:29 user nova-compute[72809]: DEBUG nova.network.neutron [req-765d1478-2aed-4120-b657-6674687cac7c req-4642cda0-ab20-46d0-bd88-a8e9b4ae3fa8 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Refreshing network info cache for port 030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:50:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16ad749-f432-43e8-a5f9-96158a4308cf/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f647a50e-ee90-480a-ad5d-68f1782628d9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f647a50e-ee90-480a-ad5d-68f1782628d9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f647a50e-ee90-480a-ad5d-68f1782628d9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f647a50e-ee90-480a-ad5d-68f1782628d9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f694fb-e406-4b66-badc-f3686f3f1dc9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f694fb-e406-4b66-badc-f3686f3f1dc9/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f694fb-e406-4b66-badc-f3686f3f1dc9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80f694fb-e406-4b66-badc-f3686f3f1dc9/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a6a74bc-2e97-4248-8b82-abb54ff4cc83/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:30 user nova-compute[72809]: DEBUG nova.network.neutron [req-e1960b18-a50f-4c42-94be-5a5fe09752f4 req-12cdaea6-805f-48c1-aca6-1ef51ae072ea service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Updated VIF entry in instance network info cache for port f12bff80-425f-42ba-804d-540ad751f70c. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:50:30 user nova-compute[72809]: DEBUG nova.network.neutron [req-e1960b18-a50f-4c42-94be-5a5fe09752f4 req-12cdaea6-805f-48c1-aca6-1ef51ae072ea service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Updating instance_info_cache with network_info: [{"id": "f12bff80-425f-42ba-804d-540ad751f70c", "address": "fa:16:3e:36:6c:27", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12bff80-42", "ovs_interfaceid": "f12bff80-425f-42ba-804d-540ad751f70c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:50:30 user nova-compute[72809]: DEBUG nova.network.neutron [req-765d1478-2aed-4120-b657-6674687cac7c req-4642cda0-ab20-46d0-bd88-a8e9b4ae3fa8 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Updated VIF entry in instance network info cache for port 030dd6f3-f758-4b5a-b9fb-be3c64cb9341. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:50:30 user nova-compute[72809]: DEBUG nova.network.neutron [req-765d1478-2aed-4120-b657-6674687cac7c req-4642cda0-ab20-46d0-bd88-a8e9b4ae3fa8 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Updating instance_info_cache with network_info: [{"id": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "address": "fa:16:3e:70:a1:b1", "network": {"id": "d6503417-7fd7-487b-8474-f23e4cc77845", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1134767045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04f60d3bd9a41fc930f728a74371a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030dd6f3-f7", "ovs_interfaceid": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:50:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e1960b18-a50f-4c42-94be-5a5fe09752f4 req-12cdaea6-805f-48c1-aca6-1ef51ae072ea service nova] Releasing lock "refresh_cache-24ba9b41-d0bf-4a84-9f04-bfda9525b154" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:50:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-765d1478-2aed-4120-b657-6674687cac7c req-4642cda0-ab20-46d0-bd88-a8e9b4ae3fa8 service nova] Releasing lock "refresh_cache-3640991e-8a5b-4674-af81-3117d4269a68" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:50:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a6a74bc-2e97-4248-8b82-abb54ff4cc83/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a6a74bc-2e97-4248-8b82-abb54ff4cc83/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-b106d6a2-6eb2-4355-9343-c993b9ca00ef req-51e56c0a-1787-481b-bae6-cf59af13e6cd service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Received event network-changed-6efe1803-2ae3-490f-8791-c2ba35919f09 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-b106d6a2-6eb2-4355-9343-c993b9ca00ef req-51e56c0a-1787-481b-bae6-cf59af13e6cd service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Refreshing instance network info cache due to event network-changed-6efe1803-2ae3-490f-8791-c2ba35919f09. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:50:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b106d6a2-6eb2-4355-9343-c993b9ca00ef req-51e56c0a-1787-481b-bae6-cf59af13e6cd service nova] Acquiring lock "refresh_cache-15dda080-3487-4316-ab7b-f7185f0a4519" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:50:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b106d6a2-6eb2-4355-9343-c993b9ca00ef req-51e56c0a-1787-481b-bae6-cf59af13e6cd service nova] Acquired lock "refresh_cache-15dda080-3487-4316-ab7b-f7185f0a4519" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:50:30 user nova-compute[72809]: DEBUG nova.network.neutron [req-b106d6a2-6eb2-4355-9343-c993b9ca00ef req-51e56c0a-1787-481b-bae6-cf59af13e6cd service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Refreshing network info cache for port 6efe1803-2ae3-490f-8791-c2ba35919f09 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:50:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a6a74bc-2e97-4248-8b82-abb54ff4cc83/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-07030f45-af84-4824-a3eb-1c8a7c60b490 req-cb511b8a-439b-4e9a-965a-a65859f235de service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-plugged-6581cf5a-ea10-419c-bd09-1f803299c311 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-07030f45-af84-4824-a3eb-1c8a7c60b490 req-cb511b8a-439b-4e9a-965a-a65859f235de service nova] Acquiring lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-07030f45-af84-4824-a3eb-1c8a7c60b490 req-cb511b8a-439b-4e9a-965a-a65859f235de service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-07030f45-af84-4824-a3eb-1c8a7c60b490 req-cb511b8a-439b-4e9a-965a-a65859f235de service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-07030f45-af84-4824-a3eb-1c8a7c60b490 req-cb511b8a-439b-4e9a-965a-a65859f235de service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] No waiting events found dispatching network-vif-plugged-6581cf5a-ea10-419c-bd09-1f803299c311 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:50:30 user nova-compute[72809]: WARNING nova.compute.manager [req-07030f45-af84-4824-a3eb-1c8a7c60b490 req-cb511b8a-439b-4e9a-965a-a65859f235de service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received unexpected event network-vif-plugged-6581cf5a-ea10-419c-bd09-1f803299c311 for instance with vm_state building and task_state spawning.
Aug 09 06:50:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563834.6645863, f7c9bbfa-b588-4ea7-ada4-d7f806ab2381 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:50:34 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] VM Resumed (Lifecycle Event)
Aug 09 06:50:34 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG nova.compute.manager [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG nova.compute.manager [None req-1743c6e2-557d-422b-a11a-b8292790b4b4 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG nova.compute.manager [req-1c546ebf-8fb8-4316-b6ef-c49d67b19c9e req-6b1f8269-e407-4645-9fa4-15031f15971a service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-plugged-e3b8369b-0287-4dc7-8465-325f8eb9e413 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1c546ebf-8fb8-4316-b6ef-c49d67b19c9e req-6b1f8269-e407-4645-9fa4-15031f15971a service nova] Acquiring lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1c546ebf-8fb8-4316-b6ef-c49d67b19c9e req-6b1f8269-e407-4645-9fa4-15031f15971a service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1c546ebf-8fb8-4316-b6ef-c49d67b19c9e req-6b1f8269-e407-4645-9fa4-15031f15971a service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG nova.compute.manager [req-1c546ebf-8fb8-4316-b6ef-c49d67b19c9e req-6b1f8269-e407-4645-9fa4-15031f15971a service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] No waiting events found dispatching network-vif-plugged-e3b8369b-0287-4dc7-8465-325f8eb9e413 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:50:34 user nova-compute[72809]: WARNING nova.compute.manager [req-1c546ebf-8fb8-4316-b6ef-c49d67b19c9e req-6b1f8269-e407-4645-9fa4-15031f15971a service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received unexpected event network-vif-plugged-e3b8369b-0287-4dc7-8465-325f8eb9e413 for instance with vm_state building and task_state spawning.
Aug 09 06:50:34 user nova-compute[72809]: DEBUG nova.compute.manager [req-173317e9-5667-497c-a7ba-70c270c2df96 req-4d2a09d9-ad5d-4e66-b345-0ff236ddca31 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-plugged-530fb6cf-4b83-44a2-9792-7d844987f6e8 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-173317e9-5667-497c-a7ba-70c270c2df96 req-4d2a09d9-ad5d-4e66-b345-0ff236ddca31 service nova] Acquiring lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-173317e9-5667-497c-a7ba-70c270c2df96 req-4d2a09d9-ad5d-4e66-b345-0ff236ddca31 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-173317e9-5667-497c-a7ba-70c270c2df96 req-4d2a09d9-ad5d-4e66-b345-0ff236ddca31 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG nova.compute.manager [req-173317e9-5667-497c-a7ba-70c270c2df96 req-4d2a09d9-ad5d-4e66-b345-0ff236ddca31 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] No waiting events found dispatching network-vif-plugged-530fb6cf-4b83-44a2-9792-7d844987f6e8 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:50:34 user nova-compute[72809]: WARNING nova.compute.manager [req-173317e9-5667-497c-a7ba-70c270c2df96 req-4d2a09d9-ad5d-4e66-b345-0ff236ddca31 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received unexpected event network-vif-plugged-530fb6cf-4b83-44a2-9792-7d844987f6e8 for instance with vm_state building and task_state spawning.
Aug 09 06:50:34 user nova-compute[72809]: DEBUG nova.compute.manager [req-173317e9-5667-497c-a7ba-70c270c2df96 req-4d2a09d9-ad5d-4e66-b345-0ff236ddca31 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-plugged-530fb6cf-4b83-44a2-9792-7d844987f6e8 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-173317e9-5667-497c-a7ba-70c270c2df96 req-4d2a09d9-ad5d-4e66-b345-0ff236ddca31 service nova] Acquiring lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-173317e9-5667-497c-a7ba-70c270c2df96 req-4d2a09d9-ad5d-4e66-b345-0ff236ddca31 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-173317e9-5667-497c-a7ba-70c270c2df96 req-4d2a09d9-ad5d-4e66-b345-0ff236ddca31 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG nova.compute.manager [req-173317e9-5667-497c-a7ba-70c270c2df96 req-4d2a09d9-ad5d-4e66-b345-0ff236ddca31 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] No waiting events found dispatching network-vif-plugged-530fb6cf-4b83-44a2-9792-7d844987f6e8 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:50:34 user nova-compute[72809]: WARNING nova.compute.manager [req-173317e9-5667-497c-a7ba-70c270c2df96 req-4d2a09d9-ad5d-4e66-b345-0ff236ddca31 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received unexpected event network-vif-plugged-530fb6cf-4b83-44a2-9792-7d844987f6e8 for instance with vm_state building and task_state spawning.
Aug 09 06:50:34 user nova-compute[72809]: DEBUG nova.compute.manager [req-30b21e5b-c58e-4855-830f-599da4145a7e req-5ffe5be5-eacd-499f-8957-6a21d0eab9e4 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-plugged-6581cf5a-ea10-419c-bd09-1f803299c311 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-30b21e5b-c58e-4855-830f-599da4145a7e req-5ffe5be5-eacd-499f-8957-6a21d0eab9e4 service nova] Acquiring lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-30b21e5b-c58e-4855-830f-599da4145a7e req-5ffe5be5-eacd-499f-8957-6a21d0eab9e4 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-30b21e5b-c58e-4855-830f-599da4145a7e req-5ffe5be5-eacd-499f-8957-6a21d0eab9e4 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG nova.compute.manager [req-30b21e5b-c58e-4855-830f-599da4145a7e req-5ffe5be5-eacd-499f-8957-6a21d0eab9e4 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] No waiting events found dispatching network-vif-plugged-6581cf5a-ea10-419c-bd09-1f803299c311 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:50:34 user nova-compute[72809]: WARNING nova.compute.manager [req-30b21e5b-c58e-4855-830f-599da4145a7e req-5ffe5be5-eacd-499f-8957-6a21d0eab9e4 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received unexpected event network-vif-plugged-6581cf5a-ea10-419c-bd09-1f803299c311 for instance with vm_state building and task_state spawning.
Aug 09 06:50:34 user nova-compute[72809]: DEBUG nova.compute.manager [req-30b21e5b-c58e-4855-830f-599da4145a7e req-5ffe5be5-eacd-499f-8957-6a21d0eab9e4 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-plugged-d7994fbc-d242-4b35-aad4-88bf2f3bc7a3 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-30b21e5b-c58e-4855-830f-599da4145a7e req-5ffe5be5-eacd-499f-8957-6a21d0eab9e4 service nova] Acquiring lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-30b21e5b-c58e-4855-830f-599da4145a7e req-5ffe5be5-eacd-499f-8957-6a21d0eab9e4 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-30b21e5b-c58e-4855-830f-599da4145a7e req-5ffe5be5-eacd-499f-8957-6a21d0eab9e4 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG nova.compute.manager [req-30b21e5b-c58e-4855-830f-599da4145a7e req-5ffe5be5-eacd-499f-8957-6a21d0eab9e4 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] No waiting events found dispatching network-vif-plugged-d7994fbc-d242-4b35-aad4-88bf2f3bc7a3 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:50:34 user nova-compute[72809]: WARNING nova.compute.manager [req-30b21e5b-c58e-4855-830f-599da4145a7e req-5ffe5be5-eacd-499f-8957-6a21d0eab9e4 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received unexpected event network-vif-plugged-d7994fbc-d242-4b35-aad4-88bf2f3bc7a3 for instance with vm_state building and task_state spawning.
Aug 09 06:50:34 user nova-compute[72809]: DEBUG nova.compute.manager [req-30b21e5b-c58e-4855-830f-599da4145a7e req-5ffe5be5-eacd-499f-8957-6a21d0eab9e4 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-plugged-d7994fbc-d242-4b35-aad4-88bf2f3bc7a3 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-30b21e5b-c58e-4855-830f-599da4145a7e req-5ffe5be5-eacd-499f-8957-6a21d0eab9e4 service nova] Acquiring lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-30b21e5b-c58e-4855-830f-599da4145a7e req-5ffe5be5-eacd-499f-8957-6a21d0eab9e4 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-30b21e5b-c58e-4855-830f-599da4145a7e req-5ffe5be5-eacd-499f-8957-6a21d0eab9e4 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG nova.compute.manager [req-30b21e5b-c58e-4855-830f-599da4145a7e req-5ffe5be5-eacd-499f-8957-6a21d0eab9e4 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] No waiting events found dispatching network-vif-plugged-d7994fbc-d242-4b35-aad4-88bf2f3bc7a3 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:50:34 user nova-compute[72809]: WARNING nova.compute.manager [req-30b21e5b-c58e-4855-830f-599da4145a7e req-5ffe5be5-eacd-499f-8957-6a21d0eab9e4 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received unexpected event network-vif-plugged-d7994fbc-d242-4b35-aad4-88bf2f3bc7a3 for instance with vm_state building and task_state spawning.
Aug 09 06:50:34 user nova-compute[72809]: DEBUG nova.compute.manager [req-30b21e5b-c58e-4855-830f-599da4145a7e req-5ffe5be5-eacd-499f-8957-6a21d0eab9e4 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-plugged-4e76b5e9-78c1-405c-a866-be6f997ae4c7 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-30b21e5b-c58e-4855-830f-599da4145a7e req-5ffe5be5-eacd-499f-8957-6a21d0eab9e4 service nova] Acquiring lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-30b21e5b-c58e-4855-830f-599da4145a7e req-5ffe5be5-eacd-499f-8957-6a21d0eab9e4 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-30b21e5b-c58e-4855-830f-599da4145a7e req-5ffe5be5-eacd-499f-8957-6a21d0eab9e4 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG nova.compute.manager [req-30b21e5b-c58e-4855-830f-599da4145a7e req-5ffe5be5-eacd-499f-8957-6a21d0eab9e4 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] No waiting events found dispatching network-vif-plugged-4e76b5e9-78c1-405c-a866-be6f997ae4c7 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:50:34 user nova-compute[72809]: WARNING nova.compute.manager [req-30b21e5b-c58e-4855-830f-599da4145a7e req-5ffe5be5-eacd-499f-8957-6a21d0eab9e4 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received unexpected event network-vif-plugged-4e76b5e9-78c1-405c-a866-be6f997ae4c7 for instance with vm_state building and task_state spawning.
Aug 09 06:50:34 user nova-compute[72809]: DEBUG nova.compute.manager [req-2783b4d2-48e4-4940-8da7-ff56a658cae7 req-5baed791-9f73-408d-9625-583d1c7db960 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-plugged-e3b8369b-0287-4dc7-8465-325f8eb9e413 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2783b4d2-48e4-4940-8da7-ff56a658cae7 req-5baed791-9f73-408d-9625-583d1c7db960 service nova] Acquiring lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2783b4d2-48e4-4940-8da7-ff56a658cae7 req-5baed791-9f73-408d-9625-583d1c7db960 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2783b4d2-48e4-4940-8da7-ff56a658cae7 req-5baed791-9f73-408d-9625-583d1c7db960 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG nova.compute.manager [req-2783b4d2-48e4-4940-8da7-ff56a658cae7 req-5baed791-9f73-408d-9625-583d1c7db960 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] No waiting events found dispatching network-vif-plugged-e3b8369b-0287-4dc7-8465-325f8eb9e413 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:50:34 user nova-compute[72809]: WARNING nova.compute.manager [req-2783b4d2-48e4-4940-8da7-ff56a658cae7 req-5baed791-9f73-408d-9625-583d1c7db960 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received unexpected event network-vif-plugged-e3b8369b-0287-4dc7-8465-325f8eb9e413 for instance with vm_state building and task_state spawning.
Aug 09 06:50:34 user nova-compute[72809]: DEBUG nova.compute.manager [req-2783b4d2-48e4-4940-8da7-ff56a658cae7 req-5baed791-9f73-408d-9625-583d1c7db960 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-plugged-9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2783b4d2-48e4-4940-8da7-ff56a658cae7 req-5baed791-9f73-408d-9625-583d1c7db960 service nova] Acquiring lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2783b4d2-48e4-4940-8da7-ff56a658cae7 req-5baed791-9f73-408d-9625-583d1c7db960 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2783b4d2-48e4-4940-8da7-ff56a658cae7 req-5baed791-9f73-408d-9625-583d1c7db960 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG nova.compute.manager [req-2783b4d2-48e4-4940-8da7-ff56a658cae7 req-5baed791-9f73-408d-9625-583d1c7db960 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] No waiting events found dispatching network-vif-plugged-9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:50:34 user nova-compute[72809]: WARNING nova.compute.manager [req-2783b4d2-48e4-4940-8da7-ff56a658cae7 req-5baed791-9f73-408d-9625-583d1c7db960 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received unexpected event network-vif-plugged-9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923 for instance with vm_state building and task_state spawning.
Aug 09 06:50:34 user nova-compute[72809]: DEBUG nova.compute.manager [req-2783b4d2-48e4-4940-8da7-ff56a658cae7 req-5baed791-9f73-408d-9625-583d1c7db960 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-plugged-9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2783b4d2-48e4-4940-8da7-ff56a658cae7 req-5baed791-9f73-408d-9625-583d1c7db960 service nova] Acquiring lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2783b4d2-48e4-4940-8da7-ff56a658cae7 req-5baed791-9f73-408d-9625-583d1c7db960 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2783b4d2-48e4-4940-8da7-ff56a658cae7 req-5baed791-9f73-408d-9625-583d1c7db960 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG nova.compute.manager [req-2783b4d2-48e4-4940-8da7-ff56a658cae7 req-5baed791-9f73-408d-9625-583d1c7db960 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] No waiting events found dispatching network-vif-plugged-9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:50:34 user nova-compute[72809]: WARNING nova.compute.manager [req-2783b4d2-48e4-4940-8da7-ff56a658cae7 req-5baed791-9f73-408d-9625-583d1c7db960 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received unexpected event network-vif-plugged-9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923 for instance with vm_state building and task_state spawning.
Aug 09 06:50:34 user nova-compute[72809]: DEBUG nova.compute.manager [req-6e6c580c-03f3-4d9c-a281-2b7b1e2eb252 req-d4b492f2-4c4b-43dc-b283-8616e0006683 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-plugged-23fba0ea-7bd6-4b7e-81a7-055a92b53590 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6e6c580c-03f3-4d9c-a281-2b7b1e2eb252 req-d4b492f2-4c4b-43dc-b283-8616e0006683 service nova] Acquiring lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6e6c580c-03f3-4d9c-a281-2b7b1e2eb252 req-d4b492f2-4c4b-43dc-b283-8616e0006683 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6e6c580c-03f3-4d9c-a281-2b7b1e2eb252 req-d4b492f2-4c4b-43dc-b283-8616e0006683 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG nova.compute.manager [req-6e6c580c-03f3-4d9c-a281-2b7b1e2eb252 req-d4b492f2-4c4b-43dc-b283-8616e0006683 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] No waiting events found dispatching network-vif-plugged-23fba0ea-7bd6-4b7e-81a7-055a92b53590 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:50:34 user nova-compute[72809]: WARNING nova.compute.manager [req-6e6c580c-03f3-4d9c-a281-2b7b1e2eb252 req-d4b492f2-4c4b-43dc-b283-8616e0006683 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received unexpected event network-vif-plugged-23fba0ea-7bd6-4b7e-81a7-055a92b53590 for instance with vm_state building and task_state spawning.
Aug 09 06:50:34 user nova-compute[72809]: DEBUG nova.compute.manager [req-6e6c580c-03f3-4d9c-a281-2b7b1e2eb252 req-d4b492f2-4c4b-43dc-b283-8616e0006683 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-plugged-23fba0ea-7bd6-4b7e-81a7-055a92b53590 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6e6c580c-03f3-4d9c-a281-2b7b1e2eb252 req-d4b492f2-4c4b-43dc-b283-8616e0006683 service nova] Acquiring lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6e6c580c-03f3-4d9c-a281-2b7b1e2eb252 req-d4b492f2-4c4b-43dc-b283-8616e0006683 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6e6c580c-03f3-4d9c-a281-2b7b1e2eb252 req-d4b492f2-4c4b-43dc-b283-8616e0006683 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:34 user nova-compute[72809]: DEBUG nova.compute.manager [req-6e6c580c-03f3-4d9c-a281-2b7b1e2eb252 req-d4b492f2-4c4b-43dc-b283-8616e0006683 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] No waiting events found dispatching network-vif-plugged-23fba0ea-7bd6-4b7e-81a7-055a92b53590 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:50:34 user nova-compute[72809]: WARNING nova.compute.manager [req-6e6c580c-03f3-4d9c-a281-2b7b1e2eb252 req-d4b492f2-4c4b-43dc-b283-8616e0006683 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received unexpected event network-vif-plugged-23fba0ea-7bd6-4b7e-81a7-055a92b53590 for instance with vm_state building and task_state spawning.
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Acquiring lock "f647a50e-ee90-480a-ad5d-68f1782628d9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Lock "f647a50e-ee90-480a-ad5d-68f1782628d9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.objects.instance [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lazy-loading 'flavor' on Instance uuid 24ba9b41-d0bf-4a84-9f04-bfda9525b154 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.objects.instance [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Lazy-loading 'flavor' on Instance uuid f647a50e-ee90-480a-ad5d-68f1782628d9 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:50:35 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Instance spawned successfully.
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 06:50:35 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:50:35 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=6940MB free_disk=25.610958099365234GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.compute.manager [req-5fc24e77-fabe-47ce-bb19-f0ac7e6cf624 req-bcfaf29c-9d06-4d3d-bee3-857769fb3dfc service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-plugged-4e76b5e9-78c1-405c-a866-be6f997ae4c7 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5fc24e77-fabe-47ce-bb19-f0ac7e6cf624 req-bcfaf29c-9d06-4d3d-bee3-857769fb3dfc service nova] Acquiring lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5fc24e77-fabe-47ce-bb19-f0ac7e6cf624 req-bcfaf29c-9d06-4d3d-bee3-857769fb3dfc service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5fc24e77-fabe-47ce-bb19-f0ac7e6cf624 req-bcfaf29c-9d06-4d3d-bee3-857769fb3dfc service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.compute.manager [req-5fc24e77-fabe-47ce-bb19-f0ac7e6cf624 req-bcfaf29c-9d06-4d3d-bee3-857769fb3dfc service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] No waiting events found dispatching network-vif-plugged-4e76b5e9-78c1-405c-a866-be6f997ae4c7 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:50:35 user nova-compute[72809]: WARNING nova.compute.manager [req-5fc24e77-fabe-47ce-bb19-f0ac7e6cf624 req-bcfaf29c-9d06-4d3d-bee3-857769fb3dfc service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received unexpected event network-vif-plugged-4e76b5e9-78c1-405c-a866-be6f997ae4c7 for instance with vm_state building and task_state spawning.
Aug 09 06:50:35 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563834.667725, f7c9bbfa-b588-4ea7-ada4-d7f806ab2381 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:50:35 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] VM Started (Lifecycle Event)
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.116s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:35 user nova-compute[72809]: INFO nova.compute.manager [None req-1743c6e2-557d-422b-a11a-b8292790b4b4 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] instance snapshotting
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:50:35 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:50:35 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-1743c6e2-557d-422b-a11a-b8292790b4b4 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Beginning live snapshot process
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Lock "f647a50e-ee90-480a-ad5d-68f1782628d9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.418s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance f647a50e-ee90-480a-ad5d-68f1782628d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 24ba9b41-d0bf-4a84-9f04-bfda9525b154 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 3640991e-8a5b-4674-af81-3117d4269a68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 15dda080-3487-4316-ab7b-f7185f0a4519 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance b9b69c9e-f91d-4681-a53b-2f0fc4b13532 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance b64e7169-044c-4d0a-9ee5-f2914f1f5529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 8a6a74bc-2e97-4248-8b82-abb54ff4cc83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 80f694fb-e406-4b66-badc-f3686f3f1dc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance d16ad749-f432-43e8-a5f9-96158a4308cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance f7c9bbfa-b588-4ea7-ada4-d7f806ab2381 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance b1d6a12a-ecb9-4008-bf1b-28b2165dca99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.network.neutron [req-b106d6a2-6eb2-4355-9343-c993b9ca00ef req-51e56c0a-1787-481b-bae6-cf59af13e6cd service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Updated VIF entry in instance network info cache for port 6efe1803-2ae3-490f-8791-c2ba35919f09. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.network.neutron [req-b106d6a2-6eb2-4355-9343-c993b9ca00ef req-51e56c0a-1787-481b-bae6-cf59af13e6cd service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Updating instance_info_cache with network_info: [{"id": "6efe1803-2ae3-490f-8791-c2ba35919f09", "address": "fa:16:3e:a7:75:9f", "network": {"id": "aae92e96-18c4-419a-b1b0-5ab55d8f26c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1926005183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52fb0421f625467a8205b8000a6dcee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efe1803-2a", "ovs_interfaceid": "6efe1803-2ae3-490f-8791-c2ba35919f09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:50:35 user nova-compute[72809]: INFO nova.compute.manager [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Took 12.91 seconds to spawn the instance on the hypervisor.
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.compute.manager [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b106d6a2-6eb2-4355-9343-c993b9ca00ef req-51e56c0a-1787-481b-bae6-cf59af13e6cd service nova] Releasing lock "refresh_cache-15dda080-3487-4316-ab7b-f7185f0a4519" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:35 user nova-compute[72809]: INFO nova.compute.manager [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Attaching volume 9764e6f5-4af3-437f-82a0-f0becb06d18c to /dev/vdb
Aug 09 06:50:35 user nova-compute[72809]: DEBUG os_brick.utils [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ca8425-b894-46fc-89bd-7db70d9a06e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Acquiring lock "f647a50e-ee90-480a-ad5d-68f1782628d9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Lock "f647a50e-ee90-480a-ad5d-68f1782628d9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:35 user nova-compute[72809]: INFO nova.compute.manager [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Attaching volume dbb427ae-9bc9-4ac3-bb76-e4da58193b14 to /dev/vdb
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2279c5e-84f9-4636-a92f-9832767c4829]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:35 user nova-compute[72809]: INFO nova.compute.manager [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Took 43.22 seconds to build instance.
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b97e99-40dc-436c-8a41-ddea5f5b8910]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[99af4cfb-8265-418c-8467-aac26276af82]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG os_brick.utils [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-1743c6e2-557d-422b-a11a-b8292790b4b4 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json -f qcow2 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c2b6964d-a276-4582-aed4-375e5611153b tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.411s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[55aae19c-7529-4e78-8963-534a213b2b53]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:50:35 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bb1592-3a0b-450a-9e9b-84bffd1eca19]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG os_brick.utils [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] <== get_connector_properties: return (228ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Updating existing volume attachment record: b60c8e74-1151-4874-ae16-f4b6a5132259 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bb7060-677d-4f3b-a5b2-42ac25c0c4fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3479ee8-b590-454b-b0e2-a6c307bd1e94]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4c720d-9c08-4cec-a4a0-3892a1e2b302]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-1743c6e2-557d-422b-a11a-b8292790b4b4 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json -f qcow2" returned: 0 in 0.163s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-1743c6e2-557d-422b-a11a-b8292790b4b4 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json -f qcow2 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:50:36 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 06:50:36 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b386eb-76dc-418e-a015-8f02dcea7152]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 06:50:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 06:50:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 06:50:36 user nova-compute[72809]: DEBUG os_brick.utils [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] <== get_connector_properties: return (216ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:50:36 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Updating existing volume attachment record: 7d7e3f9e-13cc-473f-9830-da8c96d90bd0 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 06:50:36 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:50:36 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:50:36 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 06:50:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.030s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-1743c6e2-557d-422b-a11a-b8292790b4b4 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json -f qcow2" returned: 0 in 0.153s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-1743c6e2-557d-422b-a11a-b8292790b4b4 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-1743c6e2-557d-422b-a11a-b8292790b4b4 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.133s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-1743c6e2-557d-422b-a11a-b8292790b4b4 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprhro154v/dd40ac9c6a0645ca9963c6d5697a818e.delta 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-1743c6e2-557d-422b-a11a-b8292790b4b4 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprhro154v/dd40ac9c6a0645ca9963c6d5697a818e.delta 1073741824" returned: 0 in 0.061s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:36 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-1743c6e2-557d-422b-a11a-b8292790b4b4 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 06:50:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-1743c6e2-557d-422b-a11a-b8292790b4b4 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72809) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 09 06:50:36 user nova-compute[72809]: INFO nova.virt.libvirt.host [None req-1743c6e2-557d-422b-a11a-b8292790b4b4 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] UEFI support detected
Aug 09 06:50:37 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:50:37 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:50:37 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:50:37 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:50:37 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:50:37 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:50:37 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 06:50:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-1743c6e2-557d-422b-a11a-b8292790b4b4 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72809) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 06:50:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-1743c6e2-557d-422b-a11a-b8292790b4b4 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75563008 {{(pid=72809) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 06:50:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:38 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-1743c6e2-557d-422b-a11a-b8292790b4b4 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72809) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 06:50:38 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-1743c6e2-557d-422b-a11a-b8292790b4b4 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 06:50:38 user nova-compute[72809]: DEBUG nova.privsep.utils [None req-1743c6e2-557d-422b-a11a-b8292790b4b4 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72809) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 06:50:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-1743c6e2-557d-422b-a11a-b8292790b4b4 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprhro154v/dd40ac9c6a0645ca9963c6d5697a818e.delta /opt/stack/data/nova/instances/snapshots/tmprhro154v/dd40ac9c6a0645ca9963c6d5697a818e {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-1743c6e2-557d-422b-a11a-b8292790b4b4 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprhro154v/dd40ac9c6a0645ca9963c6d5697a818e.delta /opt/stack/data/nova/instances/snapshots/tmprhro154v/dd40ac9c6a0645ca9963c6d5697a818e" returned: 0 in 0.397s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:38 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-1743c6e2-557d-422b-a11a-b8292790b4b4 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Snapshot extracted, beginning image upload
Aug 09 06:50:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:42 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-1743c6e2-557d-422b-a11a-b8292790b4b4 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Snapshot image upload complete
Aug 09 06:50:42 user nova-compute[72809]: INFO nova.compute.manager [None req-1743c6e2-557d-422b-a11a-b8292790b4b4 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Took 7.05 seconds to snapshot the instance on the hypervisor.
Aug 09 06:50:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztZlOAvN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:50:45 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:50:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:50:45 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:50:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:50:45 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 06:50:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fiKtUFLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:50:45 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:50:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f28f94-ca3d-4e5a-b361-7bbb15b3e2d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 06:50:45 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[422be4b6-26c3-4e0f-8104-32ea3b5f30dd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14] added
Aug 09 06:50:45 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f97447f-d9da-4209-860c-6362105ad6e5]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d1dd51-5851-4fe7-8f63-ef39eee43c0b]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ztZlOAvN {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ztZlOAvN" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[305e980b-7f35-4e31-9448-97b818d2aa72]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ztZlOAvN'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7acc17-1c83-41b8-b33d-4629218f5724]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e278a962-4223-4e89-92cb-06ed3513b58c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:50:45 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:50:45 user nova-compute[72809]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)
Aug 09 06:50:45 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:50:45 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:50:45 user nova-compute[72809]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)
Aug 09 06:50:45 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2566c38d-788e-4865-8c6c-e70cb2c032e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14, portal: 172.16.0.220,3260]
Aug 09 06:50:45 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14, portal: 172.16.0.220,3260] successful.
Aug 09 06:50:45 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c72162e-8275-4276-a28b-c0d9d26e5c85]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[feaed784-1c36-4f4d-89ce-25adb0711e3d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:50:45 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:50:45 user nova-compute[72809]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)
Aug 09 06:50:45 user nova-compute[72809]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 (non-flash)
Aug 09 06:50:45 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:50:45 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:50:45 user nova-compute[72809]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)
Aug 09 06:50:45 user nova-compute[72809]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 (non-flash)
Aug 09 06:50:45 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e9350f-bbb5-46c6-8a29-d133ec707d36]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 06:50:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztZlOAvN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 06:50:46 user nova-compute[72809]: DEBUG nova.compute.manager [req-ba2edaa1-ea0a-498c-8661-ab3648b47f26 req-2927bd66-20cb-47ab-84ca-b2071370c2a2 service nova] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Received event network-changed-664d7e69-c8c7-4ee9-980f-f58f8c8871b8 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:46 user nova-compute[72809]: DEBUG nova.compute.manager [req-ba2edaa1-ea0a-498c-8661-ab3648b47f26 req-2927bd66-20cb-47ab-84ca-b2071370c2a2 service nova] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Refreshing instance network info cache due to event network-changed-664d7e69-c8c7-4ee9-980f-f58f8c8871b8. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:50:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ba2edaa1-ea0a-498c-8661-ab3648b47f26 req-2927bd66-20cb-47ab-84ca-b2071370c2a2 service nova] Acquiring lock "refresh_cache-b9b69c9e-f91d-4681-a53b-2f0fc4b13532" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:50:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ba2edaa1-ea0a-498c-8661-ab3648b47f26 req-2927bd66-20cb-47ab-84ca-b2071370c2a2 service nova] Acquired lock "refresh_cache-b9b69c9e-f91d-4681-a53b-2f0fc4b13532" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:50:46 user nova-compute[72809]: DEBUG nova.network.neutron [req-ba2edaa1-ea0a-498c-8661-ab3648b47f26 req-2927bd66-20cb-47ab-84ca-b2071370c2a2 service nova] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Refreshing network info cache for port 664d7e69-c8c7-4ee9-980f-f58f8c8871b8 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:50:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b2b1e0b5-ae75-4a82-9e09-9012245ab356 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Acquiring lock "b9b69c9e-f91d-4681-a53b-2f0fc4b13532" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b2b1e0b5-ae75-4a82-9e09-9012245ab356 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Lock "b9b69c9e-f91d-4681-a53b-2f0fc4b13532" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:46 user nova-compute[72809]: DEBUG nova.objects.instance [None req-b2b1e0b5-ae75-4a82-9e09-9012245ab356 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Lazy-loading 'flavor' on Instance uuid b9b69c9e-f91d-4681-a53b-2f0fc4b13532 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:50:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b2b1e0b5-ae75-4a82-9e09-9012245ab356 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Lock "b9b69c9e-f91d-4681-a53b-2f0fc4b13532" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:46 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:50:46 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26534633864366232', 'path': '/dev/sde'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:50:46 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534633864366232', 'path': '/dev/sde'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 06:50:46 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.307s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:50:46 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:50:46 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:50:46 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:50:46 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 06:50:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b2b1e0b5-ae75-4a82-9e09-9012245ab356 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Acquiring lock "b9b69c9e-f91d-4681-a53b-2f0fc4b13532" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b2b1e0b5-ae75-4a82-9e09-9012245ab356 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Lock "b9b69c9e-f91d-4681-a53b-2f0fc4b13532" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:46 user nova-compute[72809]: INFO nova.compute.manager [None req-b2b1e0b5-ae75-4a82-9e09-9012245ab356 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Attaching volume 23c5c6b4-3b4f-4514-aff1-9f3025b9d178 to /dev/vdb
Aug 09 06:50:47 user nova-compute[72809]: DEBUG nova.objects.instance [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Lazy-loading 'flavor' on Instance uuid f647a50e-ee90-480a-ad5d-68f1782628d9 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e027330-5a5a-4175-8625-9eec845197b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 06:50:47 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG nova.network.neutron [req-ba2edaa1-ea0a-498c-8661-ab3648b47f26 req-2927bd66-20cb-47ab-84ca-b2071370c2a2 service nova] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Updated VIF entry in instance network info cache for port 664d7e69-c8c7-4ee9-980f-f58f8c8871b8. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG nova.network.neutron [req-ba2edaa1-ea0a-498c-8661-ab3648b47f26 req-2927bd66-20cb-47ab-84ca-b2071370c2a2 service nova] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Updating instance_info_cache with network_info: [{"id": "664d7e69-c8c7-4ee9-980f-f58f8c8871b8", "address": "fa:16:3e:90:04:36", "network": {"id": "aea61157-8f5e-461a-b77e-f5279119bc15", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1060654578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cd7ca02c3254d4b8e5fb9ddf3ec82bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664d7e69-c8", "ovs_interfaceid": "664d7e69-c8c7-4ee9-980f-f58f8c8871b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 06:50:47 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:50:47 user nova-compute[72809]:   <source dev="/dev/sde"/>
Aug 09 06:50:47 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 06:50:47 user nova-compute[72809]:   <serial>dbb427ae-9bc9-4ac3-bb76-e4da58193b14</serial>
Aug 09 06:50:47 user nova-compute[72809]: </disk>
Aug 09 06:50:47 user nova-compute[72809]:  {{(pid=72809) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[de13e768-b64a-464c-bdc4-41cfd1a20014]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ba2edaa1-ea0a-498c-8661-ab3648b47f26 req-2927bd66-20cb-47ab-84ca-b2071370c2a2 service nova] Releasing lock "refresh_cache-b9b69c9e-f91d-4681-a53b-2f0fc4b13532" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c] added
Aug 09 06:50:47 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebabc774-e88a-4d33-946d-de16877845d2]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG os_brick.utils [None req-b2b1e0b5-ae75-4a82-9e09-9012245ab356 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84f449b-764b-47d7-950a-dab3568e8cd1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[99abbb60-9010-47fb-b4cb-434ffb12cf55]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fiKtUFLG {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.043s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff591faf-b510-427b-b53a-f26c3854a4df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fiKtUFLG" returned: 0 in 0.044s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[846ac2d7-21b1-4cc5-b4a6-4cb4da5a1ccc]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fiKtUFLG'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[85214b7b-9666-416c-ab7d-11d45062524d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bf215f-684d-4bef-989c-7475b6a47157]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-b2b1e0b5-ae75-4a82-9e09-9012245ab356 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-b2b1e0b5-ae75-4a82-9e09-9012245ab356 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[559b1c27-d987-4a72-8685-54b661d383f6]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2b1e0b5-ae75-4a82-9e09-9012245ab356 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:50:47 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fd7cd6-fb9c-413f-884c-a1403953d073]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-b2b1e0b5-ae75-4a82-9e09-9012245ab356 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-b2b1e0b5-ae75-4a82-9e09-9012245ab356 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-b2b1e0b5-ae75-4a82-9e09-9012245ab356 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG os_brick.utils [None req-b2b1e0b5-ae75-4a82-9e09-9012245ab356 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-b2b1e0b5-ae75-4a82-9e09-9012245ab356 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Updating existing volume attachment record: ab7d3806-ab32-4e08-99d7-d0f88aa13505 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[184a0719-359f-4535-b647-bb68827eee8e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:50:47 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:50:47 user nova-compute[72809]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)
Aug 09 06:50:47 user nova-compute[72809]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 (non-flash)
Aug 09 06:50:47 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:50:47 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:50:47 user nova-compute[72809]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)
Aug 09 06:50:47 user nova-compute[72809]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 (non-flash)
Aug 09 06:50:47 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[383440e8-7789-42ba-83f8-bd6b28c16f8d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c, portal: 172.16.0.220,3260]
Aug 09 06:50:47 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c, portal: 172.16.0.220,3260] successful.
Aug 09 06:50:47 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7964d3-45bc-46f6-a0f1-0b8381862b6a]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bec5b7-c7c1-4f01-b937-8d296d65160e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:50:47 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:50:47 user nova-compute[72809]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)
Aug 09 06:50:47 user nova-compute[72809]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 (non-flash)
Aug 09 06:50:47 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:50:47 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:50:47 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:50:47 user nova-compute[72809]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)
Aug 09 06:50:47 user nova-compute[72809]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 (non-flash)
Aug 09 06:50:47 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:50:47 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.405s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb431b6e-0b99-4ddc-88f8-3559e5364a90]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fiKtUFLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] No VIF found with MAC fa:16:3e:d2:c2:42, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f8ea1edf-e009-4b1b-a635-b97cbf215aca tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Lock "f647a50e-ee90-480a-ad5d-68f1782628d9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.037s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.456s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:50:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] <== connect_volume: return (2764ms) {'type': 'block', 'scsi_wwn': '23430356633636163', 'path': '/dev/sdf'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:50:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430356633636163', 'path': '/dev/sdf'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 06:50:48 user nova-compute[72809]: DEBUG nova.objects.instance [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lazy-loading 'flavor' on Instance uuid 24ba9b41-d0bf-4a84-9f04-bfda9525b154 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:50:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 06:50:48 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:50:48 user nova-compute[72809]:   <source dev="/dev/sdf"/>
Aug 09 06:50:48 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 06:50:48 user nova-compute[72809]:   <serial>9764e6f5-4af3-437f-82a0-f0becb06d18c</serial>
Aug 09 06:50:48 user nova-compute[72809]: </disk>
Aug 09 06:50:48 user nova-compute[72809]:  {{(pid=72809) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 06:50:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:50:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:50:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] No VIF found with MAC fa:16:3e:36:6c:27, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:50:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-57094d8a-4375-4a63-a661-3adee891d517 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.577s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Acquiring lock "f647a50e-ee90-480a-ad5d-68f1782628d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Lock "f647a50e-ee90-480a-ad5d-68f1782628d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Acquiring lock "f647a50e-ee90-480a-ad5d-68f1782628d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Lock "f647a50e-ee90-480a-ad5d-68f1782628d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Lock "f647a50e-ee90-480a-ad5d-68f1782628d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:49 user nova-compute[72809]: INFO nova.compute.manager [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Terminating instance
Aug 09 06:50:49 user nova-compute[72809]: DEBUG nova.compute.manager [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 06:50:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:49 user nova-compute[72809]: DEBUG nova.compute.manager [req-373c0156-cb66-43b4-9541-e31a131ed4c0 req-33f3ed0e-bb08-4069-923b-4d4ad5bd165c service nova] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Received event network-vif-unplugged-3554b93c-4cee-4835-980f-413908f76f98 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-373c0156-cb66-43b4-9541-e31a131ed4c0 req-33f3ed0e-bb08-4069-923b-4d4ad5bd165c service nova] Acquiring lock "f647a50e-ee90-480a-ad5d-68f1782628d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-373c0156-cb66-43b4-9541-e31a131ed4c0 req-33f3ed0e-bb08-4069-923b-4d4ad5bd165c service nova] Lock "f647a50e-ee90-480a-ad5d-68f1782628d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-373c0156-cb66-43b4-9541-e31a131ed4c0 req-33f3ed0e-bb08-4069-923b-4d4ad5bd165c service nova] Lock "f647a50e-ee90-480a-ad5d-68f1782628d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:49 user nova-compute[72809]: DEBUG nova.compute.manager [req-373c0156-cb66-43b4-9541-e31a131ed4c0 req-33f3ed0e-bb08-4069-923b-4d4ad5bd165c service nova] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] No waiting events found dispatching network-vif-unplugged-3554b93c-4cee-4835-980f-413908f76f98 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:50:49 user nova-compute[72809]: DEBUG nova.compute.manager [req-373c0156-cb66-43b4-9541-e31a131ed4c0 req-33f3ed0e-bb08-4069-923b-4d4ad5bd165c service nova] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Received event network-vif-unplugged-3554b93c-4cee-4835-980f-413908f76f98 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 06:50:49 user nova-compute[72809]: DEBUG nova.compute.manager [req-2bb00afc-d79e-44f2-9249-1f9049cf46f7 req-3a8058f3-e232-4cb0-bb90-a319ada6b2fc service nova] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Received event network-changed-d83214ef-f913-4ab9-b9b5-4bcd171b1656 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:49 user nova-compute[72809]: DEBUG nova.compute.manager [req-2bb00afc-d79e-44f2-9249-1f9049cf46f7 req-3a8058f3-e232-4cb0-bb90-a319ada6b2fc service nova] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Refreshing instance network info cache due to event network-changed-d83214ef-f913-4ab9-b9b5-4bcd171b1656. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:50:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2bb00afc-d79e-44f2-9249-1f9049cf46f7 req-3a8058f3-e232-4cb0-bb90-a319ada6b2fc service nova] Acquiring lock "refresh_cache-b64e7169-044c-4d0a-9ee5-f2914f1f5529" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:50:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2bb00afc-d79e-44f2-9249-1f9049cf46f7 req-3a8058f3-e232-4cb0-bb90-a319ada6b2fc service nova] Acquired lock "refresh_cache-b64e7169-044c-4d0a-9ee5-f2914f1f5529" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:50:49 user nova-compute[72809]: DEBUG nova.network.neutron [req-2bb00afc-d79e-44f2-9249-1f9049cf46f7 req-3a8058f3-e232-4cb0-bb90-a319ada6b2fc service nova] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Refreshing network info cache for port d83214ef-f913-4ab9-b9b5-4bcd171b1656 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:50:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4564bdb1-3f0a-4c5c-87ef-353a9ade4c3c tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4564bdb1-3f0a-4c5c-87ef-353a9ade4c3c tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:49 user nova-compute[72809]: DEBUG nova.compute.manager [None req-4564bdb1-3f0a-4c5c-87ef-353a9ade4c3c tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:50:49 user nova-compute[72809]: DEBUG nova.compute.manager [None req-4564bdb1-3f0a-4c5c-87ef-353a9ade4c3c tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72809) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 09 06:50:49 user nova-compute[72809]: DEBUG nova.objects.instance [None req-4564bdb1-3f0a-4c5c-87ef-353a9ade4c3c tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lazy-loading 'flavor' on Instance uuid 24ba9b41-d0bf-4a84-9f04-bfda9525b154 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:50:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:50 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Instance destroyed successfully.
Aug 09 06:50:50 user nova-compute[72809]: DEBUG nova.objects.instance [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Lazy-loading 'resources' on Instance uuid f647a50e-ee90-480a-ad5d-68f1782628d9 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:48:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1450180385',display_name='tempest-DeleteServersTestJSON-server-1450180385',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1450180385',id=1,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:48:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3636086472e14f9099379775a9321b39',ramdisk_id='',reservation_id='r-amgb8p8v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1175700212',owner_user_name='tempest-DeleteServersTestJSON-1175700212-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:48:58Z,user_data=None,user_id='3ab5538447c24e2dadf6e69617f39f73',uuid=f647a50e-ee90-480a-ad5d-68f1782628d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3554b93c-4cee-4835-980f-413908f76f98", "address": "fa:16:3e:d2:c2:42", "network": {"id": "c3574890-d7f0-44ba-8d4c-eb378ab1c691", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-307148854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3636086472e14f9099379775a9321b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3554b93c-4c", "ovs_interfaceid": "3554b93c-4cee-4835-980f-413908f76f98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Converting VIF {"id": "3554b93c-4cee-4835-980f-413908f76f98", "address": "fa:16:3e:d2:c2:42", "network": {"id": "c3574890-d7f0-44ba-8d4c-eb378ab1c691", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-307148854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3636086472e14f9099379775a9321b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3554b93c-4c", "ovs_interfaceid": "3554b93c-4cee-4835-980f-413908f76f98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:c2:42,bridge_name='br-int',has_traffic_filtering=True,id=3554b93c-4cee-4835-980f-413908f76f98,network=Network(c3574890-d7f0-44ba-8d4c-eb378ab1c691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3554b93c-4c') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG os_vif [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:c2:42,bridge_name='br-int',has_traffic_filtering=True,id=3554b93c-4cee-4835-980f-413908f76f98,network=Network(c3574890-d7f0-44ba-8d4c-eb378ab1c691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3554b93c-4c') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3554b93c-4c, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:50 user nova-compute[72809]: INFO os_vif [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:c2:42,bridge_name='br-int',has_traffic_filtering=True,id=3554b93c-4cee-4835-980f-413908f76f98,network=Network(c3574890-d7f0-44ba-8d4c-eb378ab1c691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3554b93c-4c')
Aug 09 06:50:50 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztZlOAvN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:50:50 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:50:50 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0278ad19-ec4e-4acc-975d-8adbae9c5c68]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e7b30c-3f12-4ad9-95b8-c832490928bc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:50:50 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:50:50 user nova-compute[72809]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)
Aug 09 06:50:50 user nova-compute[72809]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 (non-flash)
Aug 09 06:50:50 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:50:50 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:50:50 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:50:50 user nova-compute[72809]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)
Aug 09 06:50:50 user nova-compute[72809]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 (non-flash)
Aug 09 06:50:50 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:50:50 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc158488040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14'): ({'sde'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Removing single pathed devices sde {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[8141ba8e-bb15-4377-8f2b-df02e4fd2a74]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3ac30b-2bea-439a-9f46-ceec705f0c1b]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Flushing IO for device /dev/sde {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed53c5f-721e-4c76-a058-50324f102050]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d2e255-a880-4399-bbf3-df8105572d6d]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] SCSI volumes sde have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d286af-3e23-4a72-9946-6c07f232fa89]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG nova.network.neutron [req-2bb00afc-d79e-44f2-9249-1f9049cf46f7 req-3a8058f3-e232-4cb0-bb90-a319ada6b2fc service nova] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Updated VIF entry in instance network info cache for port d83214ef-f913-4ab9-b9b5-4bcd171b1656. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG nova.network.neutron [req-2bb00afc-d79e-44f2-9249-1f9049cf46f7 req-3a8058f3-e232-4cb0-bb90-a319ada6b2fc service nova] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Updating instance_info_cache with network_info: [{"id": "d83214ef-f913-4ab9-b9b5-4bcd171b1656", "address": "fa:16:3e:7b:70:28", "network": {"id": "9d98057f-37e6-42f0-9a94-2240979d38f4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-490582380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06d061b94c6548d88d8c3cae6751d937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd83214ef-f9", "ovs_interfaceid": "d83214ef-f913-4ab9-b9b5-4bcd171b1656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2bb00afc-d79e-44f2-9249-1f9049cf46f7 req-3a8058f3-e232-4cb0-bb90-a319ada6b2fc service nova] Releasing lock "refresh_cache-b64e7169-044c-4d0a-9ee5-f2914f1f5529" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 -p 172.16.0.220:3260 --logout" returned: 0 in 0.101s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5de2cf-1d08-4b48-9f19-1c7582768f2c]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14, portal: 172.16.0.220,3260]
Aug 09 06:50:50 user nova-compute[72809]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14, portal: 172.16.0.220,3260] successful.
Aug 09 06:50:50 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f0fe0d-3292-4930-96e5-63bab7635590]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] <== disconnect_volume: return (356ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 06:50:50 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Deleting instance files /opt/stack/data/nova/instances/f647a50e-ee90-480a-ad5d-68f1782628d9_del
Aug 09 06:50:50 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Deletion of /opt/stack/data/nova/instances/f647a50e-ee90-480a-ad5d-68f1782628d9_del complete
Aug 09 06:50:50 user nova-compute[72809]: INFO nova.compute.manager [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Took 1.49 seconds to destroy the instance on the hypervisor.
Aug 09 06:50:50 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 06:50:50 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Instance destroyed successfully.
Aug 09 06:50:50 user nova-compute[72809]: DEBUG nova.compute.manager [None req-4564bdb1-3f0a-4c5c-87ef-353a9ade4c3c tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:50:50 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4564bdb1-3f0a-4c5c-87ef-353a9ade4c3c tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.056s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:51 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:50:51 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Took 0.89 seconds to deallocate network for instance.
Aug 09 06:50:51 user nova-compute[72809]: DEBUG nova.compute.manager [req-ca875422-c2a7-4fd0-9f2d-6a378ccc2722 req-4a3bd6b4-8cef-450c-91c7-23cd44fd385c service nova] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Received event network-vif-plugged-3554b93c-4cee-4835-980f-413908f76f98 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ca875422-c2a7-4fd0-9f2d-6a378ccc2722 req-4a3bd6b4-8cef-450c-91c7-23cd44fd385c service nova] Acquiring lock "f647a50e-ee90-480a-ad5d-68f1782628d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ca875422-c2a7-4fd0-9f2d-6a378ccc2722 req-4a3bd6b4-8cef-450c-91c7-23cd44fd385c service nova] Lock "f647a50e-ee90-480a-ad5d-68f1782628d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ca875422-c2a7-4fd0-9f2d-6a378ccc2722 req-4a3bd6b4-8cef-450c-91c7-23cd44fd385c service nova] Lock "f647a50e-ee90-480a-ad5d-68f1782628d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:51 user nova-compute[72809]: DEBUG nova.compute.manager [req-ca875422-c2a7-4fd0-9f2d-6a378ccc2722 req-4a3bd6b4-8cef-450c-91c7-23cd44fd385c service nova] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] No waiting events found dispatching network-vif-plugged-3554b93c-4cee-4835-980f-413908f76f98 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:50:51 user nova-compute[72809]: WARNING nova.compute.manager [req-ca875422-c2a7-4fd0-9f2d-6a378ccc2722 req-4a3bd6b4-8cef-450c-91c7-23cd44fd385c service nova] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Received unexpected event network-vif-plugged-3554b93c-4cee-4835-980f-413908f76f98 for instance with vm_state active and task_state deleting.
Aug 09 06:50:51 user nova-compute[72809]: DEBUG nova.compute.manager [req-d8e041dc-36aa-456d-9277-563444ec4c64 req-0aa2195c-ae51-4774-a68d-a2879f57961a service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Received event network-vif-unplugged-f12bff80-425f-42ba-804d-540ad751f70c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d8e041dc-36aa-456d-9277-563444ec4c64 req-0aa2195c-ae51-4774-a68d-a2879f57961a service nova] Acquiring lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d8e041dc-36aa-456d-9277-563444ec4c64 req-0aa2195c-ae51-4774-a68d-a2879f57961a service nova] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d8e041dc-36aa-456d-9277-563444ec4c64 req-0aa2195c-ae51-4774-a68d-a2879f57961a service nova] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:51 user nova-compute[72809]: DEBUG nova.compute.manager [req-d8e041dc-36aa-456d-9277-563444ec4c64 req-0aa2195c-ae51-4774-a68d-a2879f57961a service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] No waiting events found dispatching network-vif-unplugged-f12bff80-425f-42ba-804d-540ad751f70c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:50:51 user nova-compute[72809]: WARNING nova.compute.manager [req-d8e041dc-36aa-456d-9277-563444ec4c64 req-0aa2195c-ae51-4774-a68d-a2879f57961a service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Received unexpected event network-vif-unplugged-f12bff80-425f-42ba-804d-540ad751f70c for instance with vm_state stopped and task_state None.
Aug 09 06:50:51 user nova-compute[72809]: DEBUG nova.compute.manager [req-d8e041dc-36aa-456d-9277-563444ec4c64 req-0aa2195c-ae51-4774-a68d-a2879f57961a service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Received event network-vif-plugged-f12bff80-425f-42ba-804d-540ad751f70c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d8e041dc-36aa-456d-9277-563444ec4c64 req-0aa2195c-ae51-4774-a68d-a2879f57961a service nova] Acquiring lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d8e041dc-36aa-456d-9277-563444ec4c64 req-0aa2195c-ae51-4774-a68d-a2879f57961a service nova] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d8e041dc-36aa-456d-9277-563444ec4c64 req-0aa2195c-ae51-4774-a68d-a2879f57961a service nova] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:51 user nova-compute[72809]: DEBUG nova.compute.manager [req-d8e041dc-36aa-456d-9277-563444ec4c64 req-0aa2195c-ae51-4774-a68d-a2879f57961a service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] No waiting events found dispatching network-vif-plugged-f12bff80-425f-42ba-804d-540ad751f70c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:50:51 user nova-compute[72809]: WARNING nova.compute.manager [req-d8e041dc-36aa-456d-9277-563444ec4c64 req-0aa2195c-ae51-4774-a68d-a2879f57961a service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Received unexpected event network-vif-plugged-f12bff80-425f-42ba-804d-540ad751f70c for instance with vm_state stopped and task_state None.
Aug 09 06:50:51 user nova-compute[72809]: DEBUG nova.compute.manager [req-d8e041dc-36aa-456d-9277-563444ec4c64 req-0aa2195c-ae51-4774-a68d-a2879f57961a service nova] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Received event network-vif-deleted-3554b93c-4cee-4835-980f-413908f76f98 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:52 user nova-compute[72809]: DEBUG nova.compute.manager [req-d4d5118c-5c12-441b-bfd7-c183002eb6f6 req-c7aa2f19-7008-4250-bcd7-fc6d62b683fb service nova] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Received event network-changed-861ed195-01ae-4b1b-8a9f-3464eedeebdc {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:52 user nova-compute[72809]: DEBUG nova.compute.manager [req-d4d5118c-5c12-441b-bfd7-c183002eb6f6 req-c7aa2f19-7008-4250-bcd7-fc6d62b683fb service nova] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Refreshing instance network info cache due to event network-changed-861ed195-01ae-4b1b-8a9f-3464eedeebdc. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:50:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d4d5118c-5c12-441b-bfd7-c183002eb6f6 req-c7aa2f19-7008-4250-bcd7-fc6d62b683fb service nova] Acquiring lock "refresh_cache-8a6a74bc-2e97-4248-8b82-abb54ff4cc83" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:50:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d4d5118c-5c12-441b-bfd7-c183002eb6f6 req-c7aa2f19-7008-4250-bcd7-fc6d62b683fb service nova] Acquired lock "refresh_cache-8a6a74bc-2e97-4248-8b82-abb54ff4cc83" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:50:52 user nova-compute[72809]: DEBUG nova.network.neutron [req-d4d5118c-5c12-441b-bfd7-c183002eb6f6 req-c7aa2f19-7008-4250-bcd7-fc6d62b683fb service nova] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Refreshing network info cache for port 861ed195-01ae-4b1b-8a9f-3464eedeebdc {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:50:52 user nova-compute[72809]: INFO nova.compute.manager [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Took 0.97 seconds to detach 1 volumes for instance.
Aug 09 06:50:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Acquiring lock "8a6a74bc-2e97-4248-8b82-abb54ff4cc83" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Lock "8a6a74bc-2e97-4248-8b82-abb54ff4cc83" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:52 user nova-compute[72809]: DEBUG nova.objects.instance [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Lazy-loading 'flavor' on Instance uuid 8a6a74bc-2e97-4248-8b82-abb54ff4cc83 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:50:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Lock "8a6a74bc-2e97-4248-8b82-abb54ff4cc83" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.102s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:52 user nova-compute[72809]: DEBUG nova.network.neutron [req-d4d5118c-5c12-441b-bfd7-c183002eb6f6 req-c7aa2f19-7008-4250-bcd7-fc6d62b683fb service nova] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Updated VIF entry in instance network info cache for port 861ed195-01ae-4b1b-8a9f-3464eedeebdc. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:50:52 user nova-compute[72809]: DEBUG nova.network.neutron [req-d4d5118c-5c12-441b-bfd7-c183002eb6f6 req-c7aa2f19-7008-4250-bcd7-fc6d62b683fb service nova] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Updating instance_info_cache with network_info: [{"id": "861ed195-01ae-4b1b-8a9f-3464eedeebdc", "address": "fa:16:3e:b9:13:a6", "network": {"id": "32870d8a-a604-4a02-9d22-cb926d69718f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-190435513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc95b0bf255f49819b4b85a1a0b09212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap861ed195-01", "ovs_interfaceid": "861ed195-01ae-4b1b-8a9f-3464eedeebdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:50:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d4d5118c-5c12-441b-bfd7-c183002eb6f6 req-c7aa2f19-7008-4250-bcd7-fc6d62b683fb service nova] Releasing lock "refresh_cache-8a6a74bc-2e97-4248-8b82-abb54ff4cc83" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:50:53 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.volume.cinder [None req-b2b1e0b5-ae75-4a82-9e09-9012245ab356 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Update attachment failed for attachment ab7d3806-ab32-4e08-99d7-d0f88aa13505. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:23c5c6b4-3b4f-4514-aff1-9f3025b9d178 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:23c5c6b4-3b4f-4514-aff1-9f3025b9d178/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 was not found.).). (HTTP 500) (Request-ID: req-ff4d8971-223e-4c07-a5a7-958a4978866b) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:23c5c6b4-3b4f-4514-aff1-9f3025b9d178 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:23c5c6b4-3b4f-4514-aff1-9f3025b9d178/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 was not found.).). (HTTP 500) (Request-ID: req-ff4d8971-223e-4c07-a5a7-958a4978866b)
Aug 09 06:50:53 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Acquiring lock "8a6a74bc-2e97-4248-8b82-abb54ff4cc83" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:53 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Lock "8a6a74bc-2e97-4248-8b82-abb54ff4cc83" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:53 user nova-compute[72809]: INFO nova.compute.manager [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Attaching volume 77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa to /dev/vdb
Aug 09 06:50:53 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [None req-b2b1e0b5-ae75-4a82-9e09-9012245ab356 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Failed to attach 23c5c6b4-3b4f-4514-aff1-9f3025b9d178 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:23c5c6b4-3b4f-4514-aff1-9f3025b9d178 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:23c5c6b4-3b4f-4514-aff1-9f3025b9d178/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 was not found.).). (HTTP 500) (Request-ID: req-ff4d8971-223e-4c07-a5a7-958a4978866b)
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Traceback (most recent call last):
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]     ret_val = method(obj, context, *args, **kwargs)
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]     self._do_attach(context, instance, volume, volume_api,
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]     self._volume_attach(context, volume, connector, instance,
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]     connection_info = volume_api.attachment_update(
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]     res = method(self, ctx, *args, **kwargs)
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]     with excutils.save_and_reraise_exception():
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]     self.force_reraise()
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]     raise self.value
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]     context, '3.44', skip_version_check=True).attachments.update(
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]     return method.func(obj, *args, **kwargs)
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]     resp = self._update('/attachments/%s' % id, body)
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 318, in _update
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 226, in put
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]     return self._cs_request(url, 'PUT', **kwargs)
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]     return self.request(url, method, **kwargs)
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532]     raise exceptions.from_response(resp, body)
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:23c5c6b4-3b4f-4514-aff1-9f3025b9d178 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:23c5c6b4-3b4f-4514-aff1-9f3025b9d178/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 was not found.).). (HTTP 500) (Request-ID: req-ff4d8971-223e-4c07-a5a7-958a4978866b)
Aug 09 06:50:53 user nova-compute[72809]: ERROR nova.compute.manager [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] 
Aug 09 06:50:53 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.485s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:53 user nova-compute[72809]: DEBUG os_brick.utils [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:50:53 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:53 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:53 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8b4b76-bc02-4059-8a7f-51f45bbe271b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:53 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:53 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Deleted allocations for instance f647a50e-ee90-480a-ad5d-68f1782628d9
Aug 09 06:50:53 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:53 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df009a4-da20-4b9d-9849-75149da9c920]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:53 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:53 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:53 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4733f7cc-4787-4808-8a23-1fd46b6f81da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:53 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfed482-eb73-4928-b146-d7d39342b8ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:53 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:53 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:50:53 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 06:50:53 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:53 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:50:53 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 06:50:53 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[685841eb-eaed-4aa0-a1a7-9a52561757a4]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:53 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 06:50:53 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 06:50:53 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 06:50:53 user nova-compute[72809]: DEBUG os_brick.utils [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:50:53 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Updating existing volume attachment record: bd854acc-380f-43cd-b965-4fc8187e24dd {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 06:50:53 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b2b1e0b5-ae75-4a82-9e09-9012245ab356 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Lock "b9b69c9e-f91d-4681-a53b-2f0fc4b13532" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.265s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:53 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-93e29565-883e-4c24-b4fc-f18e8858449f tempest-DeleteServersTestJSON-1175700212 tempest-DeleteServersTestJSON-1175700212-project-member] Lock "f647a50e-ee90-480a-ad5d-68f1782628d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.105s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server [None req-b2b1e0b5-ae75-4a82-9e09-9012245ab356 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:23c5c6b4-3b4f-4514-aff1-9f3025b9d178 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:23c5c6b4-3b4f-4514-aff1-9f3025b9d178/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 was not found.).). (HTTP 500) (Request-ID: req-ff4d8971-223e-4c07-a5a7-958a4978866b)
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7473, in attach_volume
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py", line 414, in inner
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7470, in do_attach_volume
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7468, in do_attach_volume
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7490, in _attach_volume
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 318, in _update
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 226, in put
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:23c5c6b4-3b4f-4514-aff1-9f3025b9d178 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:23c5c6b4-3b4f-4514-aff1-9f3025b9d178/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:dbb427ae-9bc9-4ac3-bb76-e4da58193b14 was not found.).). (HTTP 500) (Request-ID: req-ff4d8971-223e-4c07-a5a7-958a4978866b)
Aug 09 06:50:53 user nova-compute[72809]: ERROR oslo_messaging.rpc.server 
Aug 09 06:50:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Acquiring lock "b64e7169-044c-4d0a-9ee5-f2914f1f5529" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "b64e7169-044c-4d0a-9ee5-f2914f1f5529" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:54 user nova-compute[72809]: DEBUG nova.objects.instance [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lazy-loading 'flavor' on Instance uuid b64e7169-044c-4d0a-9ee5-f2914f1f5529 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:50:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "b64e7169-044c-4d0a-9ee5-f2914f1f5529" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:50:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Acquiring lock "b64e7169-044c-4d0a-9ee5-f2914f1f5529" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:50:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "b64e7169-044c-4d0a-9ee5-f2914f1f5529" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:50:54 user nova-compute[72809]: INFO nova.compute.manager [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Attaching volume 575ab2d3-cc0f-4e7c-8c7d-977b81d488d7 to /dev/vdb
Aug 09 06:50:54 user nova-compute[72809]: DEBUG os_brick.utils [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:50:54 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:55 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5dd13df-9f3c-4bde-af7d-935db6fce9b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:55 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b28fac-c17f-4e1d-82db-5b963bf5489c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:50:55 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7feb54c-fdd7-42f7-9976-47c9cca4acf0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:55 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ce2213-ded7-4d3f-83b2-d025ad77bc48]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:50:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 06:50:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:50:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:50:55 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 06:50:55 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[61271357-8d7f-4351-9342-c248e9ae4dfa]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:50:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 06:50:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 06:50:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 06:50:55 user nova-compute[72809]: DEBUG os_brick.utils [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:50:55 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Updating existing volume attachment record: 58849708-e197-4f60-9805-bc4192bc7239 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 06:50:55 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:50:56 user nova-compute[72809]: DEBUG nova.compute.manager [req-ad7c6ec1-39dc-4aae-a2db-3c5498128fac req-b5573b50-6b4d-40d2-a989-dbe466e60e89 service nova] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Received event network-changed-277509bc-7638-47e1-b28d-85a59fc5aa01 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:50:56 user nova-compute[72809]: DEBUG nova.compute.manager [req-ad7c6ec1-39dc-4aae-a2db-3c5498128fac req-b5573b50-6b4d-40d2-a989-dbe466e60e89 service nova] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Refreshing instance network info cache due to event network-changed-277509bc-7638-47e1-b28d-85a59fc5aa01. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:50:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ad7c6ec1-39dc-4aae-a2db-3c5498128fac req-b5573b50-6b4d-40d2-a989-dbe466e60e89 service nova] Acquiring lock "refresh_cache-80f694fb-e406-4b66-badc-f3686f3f1dc9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:50:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ad7c6ec1-39dc-4aae-a2db-3c5498128fac req-b5573b50-6b4d-40d2-a989-dbe466e60e89 service nova] Acquired lock "refresh_cache-80f694fb-e406-4b66-badc-f3686f3f1dc9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:50:56 user nova-compute[72809]: DEBUG nova.network.neutron [req-ad7c6ec1-39dc-4aae-a2db-3c5498128fac req-b5573b50-6b4d-40d2-a989-dbe466e60e89 service nova] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Refreshing network info cache for port 277509bc-7638-47e1-b28d-85a59fc5aa01 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:50:56 user nova-compute[72809]: DEBUG nova.network.neutron [req-ad7c6ec1-39dc-4aae-a2db-3c5498128fac req-b5573b50-6b4d-40d2-a989-dbe466e60e89 service nova] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Updated VIF entry in instance network info cache for port 277509bc-7638-47e1-b28d-85a59fc5aa01. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:50:56 user nova-compute[72809]: DEBUG nova.network.neutron [req-ad7c6ec1-39dc-4aae-a2db-3c5498128fac req-b5573b50-6b4d-40d2-a989-dbe466e60e89 service nova] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Updating instance_info_cache with network_info: [{"id": "277509bc-7638-47e1-b28d-85a59fc5aa01", "address": "fa:16:3e:a4:5c:0f", "network": {"id": "bf108dce-d080-4820-bad9-7f930b8fb364", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1121464630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41de34302b6242b98f400b4f8e0cdb42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277509bc-76", "ovs_interfaceid": "277509bc-7638-47e1-b28d-85a59fc5aa01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:50:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ad7c6ec1-39dc-4aae-a2db-3c5498128fac req-b5573b50-6b4d-40d2-a989-dbe466e60e89 service nova] Releasing lock "refresh_cache-80f694fb-e406-4b66-badc-f3686f3f1dc9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:50:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Acquiring lock "80f694fb-e406-4b66-badc-f3686f3f1dc9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lock "80f694fb-e406-4b66-badc-f3686f3f1dc9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:00 user nova-compute[72809]: DEBUG nova.objects.instance [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lazy-loading 'flavor' on Instance uuid 80f694fb-e406-4b66-badc-f3686f3f1dc9 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:51:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lock "80f694fb-e406-4b66-badc-f3686f3f1dc9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Acquiring lock "80f694fb-e406-4b66-badc-f3686f3f1dc9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lock "80f694fb-e406-4b66-badc-f3686f3f1dc9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:00 user nova-compute[72809]: INFO nova.compute.manager [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Attaching volume 7eb4d79d-8058-4df7-8103-68fef71cb4bc to /dev/sdc
Aug 09 06:51:00 user nova-compute[72809]: DEBUG os_brick.utils [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:51:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:00 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13de830-63ae-4a89-8361-c5805214555c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:00 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[27dec635-7ecc-4d19-a9f4-ee74b68f95e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:00 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a3dfad-20a3-489a-8e1f-d3c377bbbd23]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:00 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53ebb2b-7657-4693-b0a3-07bc3433409e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:51:00 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 06:51:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:51:00 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 06:51:00 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1eb52d-0b90-4b10-8e5e-faa5ae3c96e0]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:00 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 06:51:00 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 06:51:00 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 06:51:00 user nova-compute[72809]: DEBUG os_brick.utils [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:51:00 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Updating existing volume attachment record: 176816c6-0dd2-46e4-8c3e-179b2b22b021 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UmKyeviJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:51:02 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:51:02 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:51:02 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:51:02 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:51:02 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 06:51:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[600e290e-6af5-457f-8ceb-c38595ebe592]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 06:51:02 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4520fa-ad0a-413f-b610-80045a9c29ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa] added
Aug 09 06:51:02 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06a53c3-7bc0-417a-8838-f5960e48e996]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaaaa44b-3871-4b4f-9643-02d221c88bcd]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UmKyeviJ {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UmKyeviJ" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a61858f-10ce-479c-af02-274a0ae631d2]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UmKyeviJ'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aedd4c6-8cf3-4d96-8636-ba1232825b0e]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b704cfd9-3c15-49db-86d4-88033683e2c0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:51:02 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:51:02 user nova-compute[72809]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)
Aug 09 06:51:02 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:51:02 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:51:02 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:51:02 user nova-compute[72809]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)
Aug 09 06:51:02 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:51:02 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[781226f9-d725-4f71-9f91-751d32186153]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa, portal: 172.16.0.220,3260]
Aug 09 06:51:02 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa, portal: 172.16.0.220,3260] successful.
Aug 09 06:51:02 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[899f28f8-e0f1-44b2-84e9-1c9e40522160]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f3a3ab-dbf0-461b-a37c-2332bcb5f2c0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:51:02 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:51:02 user nova-compute[72809]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)
Aug 09 06:51:02 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:51:02 user nova-compute[72809]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa (non-flash)
Aug 09 06:51:02 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:51:02 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:51:02 user nova-compute[72809]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)
Aug 09 06:51:02 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:51:02 user nova-compute[72809]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa (non-flash)
Aug 09 06:51:02 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] HCTL ('36', '-', '-', 0) found on session 7 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cceede1-fe3a-46f2-953f-c519cb53f5cd]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Searching for a device in session 7 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UmKyeviJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 06:51:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:51:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23237333039653534', 'path': '/dev/sde'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:51:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237333039653534', 'path': '/dev/sde'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 06:51:03 user nova-compute[72809]: DEBUG nova.objects.instance [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Lazy-loading 'flavor' on Instance uuid 8a6a74bc-2e97-4248-8b82-abb54ff4cc83 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:51:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] attach device xml: <disk type="block" device="disk">
Aug 09 06:51:03 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:51:03 user nova-compute[72809]:   <source dev="/dev/sde"/>
Aug 09 06:51:03 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 06:51:03 user nova-compute[72809]:   <serial>77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa</serial>
Aug 09 06:51:03 user nova-compute[72809]: </disk>
Aug 09 06:51:03 user nova-compute[72809]:  {{(pid=72809) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 06:51:04 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:51:04 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:51:04 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] No VIF found with MAC fa:16:3e:b9:13:a6, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:51:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d999f247-c9c5-4adf-a73a-7ca3ced66e00 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Lock "8a6a74bc-2e97-4248-8b82-abb54ff4cc83" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.862s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:04 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 06:51:04 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lfnICUso', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:51:04 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:51:04 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:51:04 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:51:04 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:51:04 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:51:04 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:51:04 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 06:51:04 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7 -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:04 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:04 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fcb604-8b3b-4853-be38-f582e4438fca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:04 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 06:51:04 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:04 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef8b0b3-ebc4-4706-95b9-543de590ef95]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7] added
Aug 09 06:51:05 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691563850.0236368, f647a50e-ee90-480a-ad5d-68f1782628d9 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:51:05 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] VM Stopped (Lifecycle Event)
Aug 09 06:51:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[db47ab91-a3d7-456a-944b-c92baabfa7f9]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG nova.compute.manager [None req-0fe03b73-786f-41ef-99f0-a1a57bccb3ea None None] [instance: f647a50e-ee90-480a-ad5d-68f1782628d9] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2855cec-635d-41bf-9b75-df71c9f3c09c]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lfnICUso {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lfnICUso" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f324a8-9173-45df-8446-708bca6b2f51]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lfnICUso'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90104f6-972b-4dd1-848d-c170052f5ad9]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e56f74-1cbb-434a-8c75-e912328f56d6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:51:05 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:51:05 user nova-compute[72809]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)
Aug 09 06:51:05 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:51:05 user nova-compute[72809]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa (non-flash)
Aug 09 06:51:05 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:51:05 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:51:05 user nova-compute[72809]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)
Aug 09 06:51:05 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:51:05 user nova-compute[72809]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa (non-flash)
Aug 09 06:51:05 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7 -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[1124aead-86cb-417f-aeb3-43504aed24a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7, portal: 172.16.0.220,3260]
Aug 09 06:51:05 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7, portal: 172.16.0.220,3260] successful.
Aug 09 06:51:05 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a721305-aa19-48fa-9bee-e2b95ac98570]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[77462e6d-b924-49bd-b9a0-a925d34bd4a5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:51:05 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:51:05 user nova-compute[72809]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)
Aug 09 06:51:05 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:51:05 user nova-compute[72809]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa (non-flash)
Aug 09 06:51:05 user nova-compute[72809]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7 (non-flash)
Aug 09 06:51:05 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:51:05 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:51:05 user nova-compute[72809]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)
Aug 09 06:51:05 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:51:05 user nova-compute[72809]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa (non-flash)
Aug 09 06:51:05 user nova-compute[72809]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7 (non-flash)
Aug 09 06:51:05 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f993cf-0638-482a-a22e-cdd7bf7edce3]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lfnICUso', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691563850.8279433, 24ba9b41-d0bf-4a84-9f04-bfda9525b154 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:51:05 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] VM Stopped (Lifecycle Event)
Aug 09 06:51:05 user nova-compute[72809]: DEBUG nova.compute.manager [None req-600cc8c2-c756-4ae3-87bd-6df3a3c9767a None None] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:51:05 user nova-compute[72809]: DEBUG nova.compute.manager [None req-600cc8c2-c756-4ae3-87bd-6df3a3c9767a None None] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:51:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4a54d90c-0505-4ff4-b211-8803f5ee70c9 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] volume_snapshot_create: create_info: {'snapshot_id': 'b2f010e4-4978-4593-ae39-25cfc3ee693c', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=72809) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 09 06:51:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4a54d90c-0505-4ff4-b211-8803f5ee70c9 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] snap xml: <domainsnapshot>
Aug 09 06:51:06 user nova-compute[72809]:   <disks>
Aug 09 06:51:06 user nova-compute[72809]:     <disk name="/dev/sde" snapshot="external" type="file">
Aug 09 06:51:06 user nova-compute[72809]:       <source file="/dev/new_file"/>
Aug 09 06:51:06 user nova-compute[72809]:     </disk>
Aug 09 06:51:06 user nova-compute[72809]:     <disk name="vda" snapshot="no"/>
Aug 09 06:51:06 user nova-compute[72809]:   </disks>
Aug 09 06:51:06 user nova-compute[72809]: </domainsnapshot>
Aug 09 06:51:06 user nova-compute[72809]:  {{(pid=72809) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 09 06:51:06 user nova-compute[72809]: DEBUG nova.objects.instance [None req-4a54d90c-0505-4ff4-b211-8803f5ee70c9 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Lazy-loading 'system_metadata' on Instance uuid 8a6a74bc-2e97-4248-8b82-abb54ff4cc83 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:51:06 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-4a54d90c-0505-4ff4-b211-8803f5ee70c9 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [None req-4a54d90c-0505-4ff4-b211-8803f5ee70c9 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Traceback (most recent call last):
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]     rv = execute(f, *args, **kwargs)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]     six.reraise(c, e, tb)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]     raise value
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]     rv = meth(*args, **kwargs)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] 
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [None req-4a54d90c-0505-4ff4-b211-8803f5ee70c9 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Traceback (most recent call last):
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]     self._volume_snapshot_create(context, instance, guest,
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]     rv = execute(f, *args, **kwargs)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]     six.reraise(c, e, tb)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]     raise value
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]     rv = meth(*args, **kwargs)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] 
Aug 09 06:51:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ad18566b-47c4-460a-941e-70df38734fe6 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] volume_snapshot_delete: delete_info: {'volume_id': '77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa'} {{(pid=72809) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [None req-ad18566b-47c4-460a-941e-70df38734fe6 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Traceback (most recent call last):
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83]     if delete_info['type'] != 'qcow2':
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] KeyError: 'type'
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] 
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [None req-4a54d90c-0505-4ff4-b211-8803f5ee70c9 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot b2f010e4-4978-4593-ae39-25cfc3ee693c could not be found.
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     raise value
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver 
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver 
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot b2f010e4-4978-4593-ae39-25cfc3ee693c could not be found. (HTTP 404) (Request-ID: req-93a12f92-9bd0-4b92-b12f-79d45e415c42)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver 
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver 
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot b2f010e4-4978-4593-ae39-25cfc3ee693c could not be found.
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver 
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server [None req-4a54d90c-0505-4ff4-b211-8803f5ee70c9 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     raise value
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server 
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver [None req-ad18566b-47c4-460a-941e-70df38734fe6 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver 
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver 
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-babbf1fc-d63f-467f-a3bc-fa2649dbb21a)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver 
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver 
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 09 06:51:06 user nova-compute[72809]: ERROR nova.virt.libvirt.driver 
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server [None req-ad18566b-47c4-460a-941e-70df38734fe6 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Exception during message handling: KeyError: 'type'
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 09 06:51:06 user nova-compute[72809]: ERROR oslo_messaging.rpc.server 
Aug 09 06:51:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:51:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23732616138656365', 'path': '/dev/sdg'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:51:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732616138656365', 'path': '/dev/sdg'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 06:51:06 user nova-compute[72809]: DEBUG nova.objects.instance [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lazy-loading 'flavor' on Instance uuid b64e7169-044c-4d0a-9ee5-f2914f1f5529 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:51:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 06:51:06 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:51:06 user nova-compute[72809]:   <source dev="/dev/sdg"/>
Aug 09 06:51:06 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 06:51:06 user nova-compute[72809]:   <serial>575ab2d3-cc0f-4e7c-8c7d-977b81d488d7</serial>
Aug 09 06:51:06 user nova-compute[72809]: </disk>
Aug 09 06:51:06 user nova-compute[72809]:  {{(pid=72809) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 06:51:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Acquiring lock "8a6a74bc-2e97-4248-8b82-abb54ff4cc83" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Lock "8a6a74bc-2e97-4248-8b82-abb54ff4cc83" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:06 user nova-compute[72809]: INFO nova.compute.manager [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Detaching volume 77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa
Aug 09 06:51:06 user nova-compute[72809]: INFO nova.virt.block_device [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Attempting to driver detach volume 77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa from mountpoint /dev/vdb
Aug 09 06:51:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Attempting to detach device vdb from instance 8a6a74bc-2e97-4248-8b82-abb54ff4cc83 from the persistent domain config. {{(pid=72809) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 06:51:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] detach device xml: <disk type="block" device="disk">
Aug 09 06:51:06 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:51:06 user nova-compute[72809]:   <source dev="/dev/sde"/>
Aug 09 06:51:06 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 06:51:06 user nova-compute[72809]:   <serial>77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa</serial>
Aug 09 06:51:06 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 06:51:06 user nova-compute[72809]: </disk>
Aug 09 06:51:06 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 06:51:06 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Successfully detached device vdb from instance 8a6a74bc-2e97-4248-8b82-abb54ff4cc83 from the persistent domain config.
Aug 09 06:51:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8a6a74bc-2e97-4248-8b82-abb54ff4cc83 from the live domain config. {{(pid=72809) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 06:51:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] detach device xml: <disk type="block" device="disk">
Aug 09 06:51:06 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:51:06 user nova-compute[72809]:   <source dev="/dev/sde"/>
Aug 09 06:51:06 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 06:51:06 user nova-compute[72809]:   <serial>77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa</serial>
Aug 09 06:51:06 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 06:51:06 user nova-compute[72809]: </disk>
Aug 09 06:51:06 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 06:51:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:51:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:51:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] No VIF found with MAC fa:16:3e:7b:70:28, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:51:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4cb5604b-28ac-4256-bf62-b03de937eea2 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "b64e7169-044c-4d0a-9ee5-f2914f1f5529" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.982s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Received event <DeviceRemovedEvent: 1691563867.0005186, 8a6a74bc-2e97-4248-8b82-abb54ff4cc83 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72809) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8a6a74bc-2e97-4248-8b82-abb54ff4cc83 {{(pid=72809) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 06:51:07 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Successfully detached device vdb from instance 8a6a74bc-2e97-4248-8b82-abb54ff4cc83 from the live domain config.
Aug 09 06:51:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UmKyeviJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:51:07 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:51:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a740f429-fb5c-4a69-a3b7-f740f0920311]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf4b520-cf83-456b-898f-ab26db90a628]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:51:07 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:51:07 user nova-compute[72809]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)
Aug 09 06:51:07 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:51:07 user nova-compute[72809]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa (non-flash)
Aug 09 06:51:07 user nova-compute[72809]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7 (non-flash)
Aug 09 06:51:07 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:51:07 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:51:07 user nova-compute[72809]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)
Aug 09 06:51:07 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:51:07 user nova-compute[72809]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa (non-flash)
Aug 09 06:51:07 user nova-compute[72809]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7 (non-flash)
Aug 09 06:51:07 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc1582072e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa'): ({'sde'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Removing single pathed devices sde {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96dc1f5-9bd3-4252-9441-f3cd43c897b3]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18804d5-8865-4834-ba77-3bd60ff2025b]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Flushing IO for device /dev/sde {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e1bd57-11f3-452e-9073-01e5d544cf66]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[33633fe8-df83-4aba-8ddf-3b24c0d0c85c]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] SCSI volumes sde have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c2c8cd-b0bb-4101-a994-29b1b627b125]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef5ebf2-827d-404f-92e3-187c9139cc14]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa, portal: 172.16.0.220,3260]
Aug 09 06:51:07 user nova-compute[72809]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa, portal: 172.16.0.220,3260] successful.
Aug 09 06:51:07 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77fcdd3e-6a7d-4acf-b63e-bff9e2a30cfa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9151933d-238b-43f2-a78a-c985648a2108]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] <== disconnect_volume: return (297ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 06:51:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:08 user nova-compute[72809]: DEBUG nova.objects.instance [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Lazy-loading 'flavor' on Instance uuid 8a6a74bc-2e97-4248-8b82-abb54ff4cc83 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:51:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b6a9a384-ebf8-44d5-ad28-f24afc894c37 tempest-VolumesAssistedSnapshotsTest-885844587 tempest-VolumesAssistedSnapshotsTest-885844587-project-admin] Lock "8a6a74bc-2e97-4248-8b82-abb54ff4cc83" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.850s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Acquiring lock "b64e7169-044c-4d0a-9ee5-f2914f1f5529" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "b64e7169-044c-4d0a-9ee5-f2914f1f5529" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:08 user nova-compute[72809]: INFO nova.compute.manager [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Detaching volume 575ab2d3-cc0f-4e7c-8c7d-977b81d488d7
Aug 09 06:51:08 user nova-compute[72809]: INFO nova.virt.block_device [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Attempting to driver detach volume 575ab2d3-cc0f-4e7c-8c7d-977b81d488d7 from mountpoint /dev/vdb
Aug 09 06:51:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Attempting to detach device vdb from instance b64e7169-044c-4d0a-9ee5-f2914f1f5529 from the persistent domain config. {{(pid=72809) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 06:51:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 06:51:08 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:51:08 user nova-compute[72809]:   <source dev="/dev/sdg"/>
Aug 09 06:51:08 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 06:51:08 user nova-compute[72809]:   <serial>575ab2d3-cc0f-4e7c-8c7d-977b81d488d7</serial>
Aug 09 06:51:08 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 06:51:08 user nova-compute[72809]: </disk>
Aug 09 06:51:08 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 06:51:08 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Successfully detached device vdb from instance b64e7169-044c-4d0a-9ee5-f2914f1f5529 from the persistent domain config.
Aug 09 06:51:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b64e7169-044c-4d0a-9ee5-f2914f1f5529 from the live domain config. {{(pid=72809) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 06:51:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 06:51:08 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:51:08 user nova-compute[72809]:   <source dev="/dev/sdg"/>
Aug 09 06:51:08 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 06:51:08 user nova-compute[72809]:   <serial>575ab2d3-cc0f-4e7c-8c7d-977b81d488d7</serial>
Aug 09 06:51:08 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 06:51:08 user nova-compute[72809]: </disk>
Aug 09 06:51:08 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Received event <DeviceRemovedEvent: 1691563869.1911614, b64e7169-044c-4d0a-9ee5-f2914f1f5529 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72809) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b64e7169-044c-4d0a-9ee5-f2914f1f5529 {{(pid=72809) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 06:51:09 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Successfully detached device vdb from instance b64e7169-044c-4d0a-9ee5-f2914f1f5529 from the live domain config.
Aug 09 06:51:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lfnICUso', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:51:09 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3860b84c-eb38-4366-b55b-ff7878eee4fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9913c2d-ed2f-4796-907b-80e8711da1ae]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:51:09 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:51:09 user nova-compute[72809]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)
Aug 09 06:51:09 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:51:09 user nova-compute[72809]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7 (non-flash)
Aug 09 06:51:09 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:51:09 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:51:09 user nova-compute[72809]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)
Aug 09 06:51:09 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:51:09 user nova-compute[72809]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7 (non-flash)
Aug 09 06:51:09 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc16c20e830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7'): ({'sdg'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Removing single pathed devices sdg {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c64b1b-4259-4c86-8b05-b77abfc2d051]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc39530-e2f8-41d7-91e1-5f340f98167b]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Flushing IO for device /dev/sdg {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4384db87-e95e-4fbf-b336-e9dce45bcf4e]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7801ae7-4e2a-4077-be21-9cbedb34f683]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] SCSI volumes sdg have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[942a7af3-4847-495c-837b-2810a568072f]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7 -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[169caf85-6a6f-48f1-81f6-1aeb762fb0d5]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7, portal: 172.16.0.220,3260]
Aug 09 06:51:09 user nova-compute[72809]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7, portal: 172.16.0.220,3260] successful.
Aug 09 06:51:09 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7 -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575ab2d3-cc0f-4e7c-8c7d-977b81d488d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[33af11df-ae80-4070-9c16-6c9b09cb3620]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] <== disconnect_volume: return (309ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lkWnFXxT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:51:09 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:51:09 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:51:09 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49501e1-fc70-46dd-8abd-a78b8a81fd40]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 06:51:09 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[418b873f-5902-4e52-8d0d-34127476afca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc] added
Aug 09 06:51:09 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c719c3ce-f761-4648-8c99-83f6225cca25]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e2e53e-34da-4f3c-a6df-ebfd7bd53437]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lkWnFXxT {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lkWnFXxT" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac577df-6604-45d5-aa02-34c762d35292]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lkWnFXxT'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c43b83-fff6-4319-b713-d53f10b09be4]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d037405-1c78-4caf-9e64-b2b788e5a770]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:51:09 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:51:09 user nova-compute[72809]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)
Aug 09 06:51:09 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:51:09 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:51:09 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:51:09 user nova-compute[72809]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)
Aug 09 06:51:09 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:51:09 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9c313f-26bb-4c87-93a9-1ec77d2d2388]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc, portal: 172.16.0.220,3260]
Aug 09 06:51:09 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc, portal: 172.16.0.220,3260] successful.
Aug 09 06:51:09 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[638235bd-da20-45f9-af8d-dcd03cef17a0]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[849f53d0-a6f3-4971-bbb4-ad47f8bb699a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:51:09 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:51:09 user nova-compute[72809]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)
Aug 09 06:51:09 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:51:09 user nova-compute[72809]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc (non-flash)
Aug 09 06:51:09 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:51:09 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:51:09 user nova-compute[72809]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)
Aug 09 06:51:09 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:51:09 user nova-compute[72809]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc (non-flash)
Aug 09 06:51:09 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] HCTL ('36', '-', '-', 0) found on session 9 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06345a9-f099-447b-a5da-6583ce6dccc7]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Searching for a device in session 9 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 06:51:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lkWnFXxT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 06:51:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:10 user nova-compute[72809]: DEBUG nova.objects.instance [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lazy-loading 'flavor' on Instance uuid b64e7169-044c-4d0a-9ee5-f2914f1f5529 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:51:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b9cbe390-60db-45b5-83cf-b0ba1354a841 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "b64e7169-044c-4d0a-9ee5-f2914f1f5529" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.663s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:10 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:51:10 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23565636537393436', 'path': '/dev/sde'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:51:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565636537393436', 'path': '/dev/sde'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 06:51:10 user nova-compute[72809]: DEBUG nova.objects.instance [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lazy-loading 'flavor' on Instance uuid 80f694fb-e406-4b66-badc-f3686f3f1dc9 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:51:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 06:51:10 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:51:10 user nova-compute[72809]:   <source dev="/dev/sde"/>
Aug 09 06:51:10 user nova-compute[72809]:   <target dev="sdc" bus="scsi"/>
Aug 09 06:51:10 user nova-compute[72809]:   <serial>7eb4d79d-8058-4df7-8103-68fef71cb4bc</serial>
Aug 09 06:51:10 user nova-compute[72809]:   <address type="drive" controller="0" unit="2"/>
Aug 09 06:51:10 user nova-compute[72809]: </disk>
Aug 09 06:51:10 user nova-compute[72809]:  {{(pid=72809) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 06:51:11 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] No BDM found with device name sda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:51:11 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:51:11 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:51:11 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] No VIF found with MAC fa:16:3e:a4:5c:0f, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:51:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-be291809-381e-43fc-867b-f3678e9cd621 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lock "80f694fb-e406-4b66-badc-f3686f3f1dc9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.278s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Acquiring lock "80f694fb-e406-4b66-badc-f3686f3f1dc9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lock "80f694fb-e406-4b66-badc-f3686f3f1dc9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:12 user nova-compute[72809]: INFO nova.compute.manager [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Detaching volume 7eb4d79d-8058-4df7-8103-68fef71cb4bc
Aug 09 06:51:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:12 user nova-compute[72809]: INFO nova.virt.block_device [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Attempting to driver detach volume 7eb4d79d-8058-4df7-8103-68fef71cb4bc from mountpoint /dev/sdc
Aug 09 06:51:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Attempting to detach device sdc from instance 80f694fb-e406-4b66-badc-f3686f3f1dc9 from the persistent domain config. {{(pid=72809) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 06:51:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 06:51:12 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:51:12 user nova-compute[72809]:   <source dev="/dev/sde"/>
Aug 09 06:51:12 user nova-compute[72809]:   <target dev="sdc" bus="scsi"/>
Aug 09 06:51:12 user nova-compute[72809]:   <serial>7eb4d79d-8058-4df7-8103-68fef71cb4bc</serial>
Aug 09 06:51:12 user nova-compute[72809]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 09 06:51:12 user nova-compute[72809]: </disk>
Aug 09 06:51:12 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 06:51:12 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Successfully detached device sdc from instance 80f694fb-e406-4b66-badc-f3686f3f1dc9 from the persistent domain config.
Aug 09 06:51:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 80f694fb-e406-4b66-badc-f3686f3f1dc9 from the live domain config. {{(pid=72809) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 06:51:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 06:51:12 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:51:12 user nova-compute[72809]:   <source dev="/dev/sde"/>
Aug 09 06:51:12 user nova-compute[72809]:   <target dev="sdc" bus="scsi"/>
Aug 09 06:51:12 user nova-compute[72809]:   <serial>7eb4d79d-8058-4df7-8103-68fef71cb4bc</serial>
Aug 09 06:51:12 user nova-compute[72809]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 09 06:51:12 user nova-compute[72809]: </disk>
Aug 09 06:51:12 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Received event <DeviceRemovedEvent: 1691563873.151763, 80f694fb-e406-4b66-badc-f3686f3f1dc9 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72809) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 80f694fb-e406-4b66-badc-f3686f3f1dc9 {{(pid=72809) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 06:51:13 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Successfully detached device sdc from instance 80f694fb-e406-4b66-badc-f3686f3f1dc9 from the live domain config.
Aug 09 06:51:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lkWnFXxT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:51:13 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:51:13 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f7238b-057d-4e8d-ae8a-7f18cd2ca0ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[08467850-2a74-4f59-bda6-0ea95464b855]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:51:13 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:51:13 user nova-compute[72809]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)
Aug 09 06:51:13 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:51:13 user nova-compute[72809]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc (non-flash)
Aug 09 06:51:13 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:51:13 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:51:13 user nova-compute[72809]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)
Aug 09 06:51:13 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:51:13 user nova-compute[72809]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc (non-flash)
Aug 09 06:51:13 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc1585d4160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc'): ({'sde'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Removing single pathed devices sde {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a6059b-eabf-4179-9eed-2f55e939a3d0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da5fff5-8c23-4ffd-a733-d000336f52cb]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Flushing IO for device /dev/sde {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[96947ed1-3cce-4b82-88bc-b58d2855148b]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b136c77b-9557-46d7-9ebc-ba9aee2c141c]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] SCSI volumes sde have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[445445b9-a3fa-4a17-8824-d274b02d0fb2]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ada7ef-6d6c-4012-ac57-33939058bec8]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc, portal: 172.16.0.220,3260]
Aug 09 06:51:13 user nova-compute[72809]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc, portal: 172.16.0.220,3260] successful.
Aug 09 06:51:13 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eb4d79d-8058-4df7-8103-68fef71cb4bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddacb8fe-bee7-475d-9e04-399ffef74ad9]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] <== disconnect_volume: return (306ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:51:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 06:51:14 user nova-compute[72809]: DEBUG nova.objects.instance [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lazy-loading 'flavor' on Instance uuid 80f694fb-e406-4b66-badc-f3686f3f1dc9 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:51:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c831011b-228b-40c1-9fca-63ded96be852 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lock "80f694fb-e406-4b66-badc-f3686f3f1dc9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.578s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-95be5fd0-92c7-4172-adea-88a610791769 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Acquiring lock "80f694fb-e406-4b66-badc-f3686f3f1dc9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-95be5fd0-92c7-4172-adea-88a610791769 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lock "80f694fb-e406-4b66-badc-f3686f3f1dc9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-95be5fd0-92c7-4172-adea-88a610791769 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Acquiring lock "80f694fb-e406-4b66-badc-f3686f3f1dc9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-95be5fd0-92c7-4172-adea-88a610791769 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lock "80f694fb-e406-4b66-badc-f3686f3f1dc9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-95be5fd0-92c7-4172-adea-88a610791769 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lock "80f694fb-e406-4b66-badc-f3686f3f1dc9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:15 user nova-compute[72809]: INFO nova.compute.manager [None req-95be5fd0-92c7-4172-adea-88a610791769 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Terminating instance
Aug 09 06:51:15 user nova-compute[72809]: DEBUG nova.compute.manager [None req-95be5fd0-92c7-4172-adea-88a610791769 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 06:51:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:15 user nova-compute[72809]: DEBUG nova.compute.manager [req-53283767-83be-4468-aa48-1dd27349aae9 req-f6510442-f7c0-4e39-b45c-5b1318498bc0 service nova] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Received event network-vif-unplugged-277509bc-7638-47e1-b28d-85a59fc5aa01 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:51:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-53283767-83be-4468-aa48-1dd27349aae9 req-f6510442-f7c0-4e39-b45c-5b1318498bc0 service nova] Acquiring lock "80f694fb-e406-4b66-badc-f3686f3f1dc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-53283767-83be-4468-aa48-1dd27349aae9 req-f6510442-f7c0-4e39-b45c-5b1318498bc0 service nova] Lock "80f694fb-e406-4b66-badc-f3686f3f1dc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-53283767-83be-4468-aa48-1dd27349aae9 req-f6510442-f7c0-4e39-b45c-5b1318498bc0 service nova] Lock "80f694fb-e406-4b66-badc-f3686f3f1dc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:15 user nova-compute[72809]: DEBUG nova.compute.manager [req-53283767-83be-4468-aa48-1dd27349aae9 req-f6510442-f7c0-4e39-b45c-5b1318498bc0 service nova] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] No waiting events found dispatching network-vif-unplugged-277509bc-7638-47e1-b28d-85a59fc5aa01 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:51:15 user nova-compute[72809]: DEBUG nova.compute.manager [req-53283767-83be-4468-aa48-1dd27349aae9 req-f6510442-f7c0-4e39-b45c-5b1318498bc0 service nova] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Received event network-vif-unplugged-277509bc-7638-47e1-b28d-85a59fc5aa01 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 06:51:16 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Instance destroyed successfully.
Aug 09 06:51:16 user nova-compute[72809]: DEBUG nova.objects.instance [None req-95be5fd0-92c7-4172-adea-88a610791769 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lazy-loading 'resources' on Instance uuid 80f694fb-e406-4b66-badc-f3686f3f1dc9 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:51:16 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-95be5fd0-92c7-4172-adea-88a610791769 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:49:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-493992988',display_name='tempest-AttachSCSIVolumeTestJSON-server-493992988',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-493992988',id=8,image_ref='c8b380c1-a7f5-4edf-a8d1-9eb9c9d55d99',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrE53HHXO0BB9cGQQmYWr57bzydYK17tmKu/Ekiw43aOTdY6jytzp81sNcDlxfQsmahYFgfHg+B8Ei8R2HNS98nYNTK8swfvSms1Kv7NeUe+0LRsVu7/WMeNqUNdPrfGw==',key_name='tempest-keypair-1889486654',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:49:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41de34302b6242b98f400b4f8e0cdb42',ramdisk_id='',reservation_id='r-j0fad72y',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c8b380c1-a7f5-4edf-a8d1-9eb9c9d55d99',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-551348959',owner_user_name='tempest-AttachSCSIVolumeTestJSON-551348959-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:49:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1ae3672f60e49b199c926dc559cd1ce',uuid=80f694fb-e406-4b66-badc-f3686f3f1dc9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "277509bc-7638-47e1-b28d-85a59fc5aa01", "address": "fa:16:3e:a4:5c:0f", "network": {"id": "bf108dce-d080-4820-bad9-7f930b8fb364", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1121464630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41de34302b6242b98f400b4f8e0cdb42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277509bc-76", "ovs_interfaceid": "277509bc-7638-47e1-b28d-85a59fc5aa01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:51:16 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-95be5fd0-92c7-4172-adea-88a610791769 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Converting VIF {"id": "277509bc-7638-47e1-b28d-85a59fc5aa01", "address": "fa:16:3e:a4:5c:0f", "network": {"id": "bf108dce-d080-4820-bad9-7f930b8fb364", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1121464630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41de34302b6242b98f400b4f8e0cdb42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277509bc-76", "ovs_interfaceid": "277509bc-7638-47e1-b28d-85a59fc5aa01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:51:16 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-95be5fd0-92c7-4172-adea-88a610791769 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:5c:0f,bridge_name='br-int',has_traffic_filtering=True,id=277509bc-7638-47e1-b28d-85a59fc5aa01,network=Network(bf108dce-d080-4820-bad9-7f930b8fb364),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap277509bc-76') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:51:16 user nova-compute[72809]: DEBUG os_vif [None req-95be5fd0-92c7-4172-adea-88a610791769 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:5c:0f,bridge_name='br-int',has_traffic_filtering=True,id=277509bc-7638-47e1-b28d-85a59fc5aa01,network=Network(bf108dce-d080-4820-bad9-7f930b8fb364),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap277509bc-76') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:51:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap277509bc-76, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:51:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:51:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:16 user nova-compute[72809]: INFO os_vif [None req-95be5fd0-92c7-4172-adea-88a610791769 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:5c:0f,bridge_name='br-int',has_traffic_filtering=True,id=277509bc-7638-47e1-b28d-85a59fc5aa01,network=Network(bf108dce-d080-4820-bad9-7f930b8fb364),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap277509bc-76')
Aug 09 06:51:16 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-95be5fd0-92c7-4172-adea-88a610791769 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Deleting instance files /opt/stack/data/nova/instances/80f694fb-e406-4b66-badc-f3686f3f1dc9_del
Aug 09 06:51:16 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-95be5fd0-92c7-4172-adea-88a610791769 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Deletion of /opt/stack/data/nova/instances/80f694fb-e406-4b66-badc-f3686f3f1dc9_del complete
Aug 09 06:51:16 user nova-compute[72809]: INFO nova.compute.manager [None req-95be5fd0-92c7-4172-adea-88a610791769 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 09 06:51:16 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-95be5fd0-92c7-4172-adea-88a610791769 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 06:51:16 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 06:51:16 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 06:51:17 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:51:17 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Took 1.37 seconds to deallocate network for instance.
Aug 09 06:51:17 user nova-compute[72809]: DEBUG nova.compute.manager [req-2cae93c7-6b46-4055-bb0e-7adcdd814a1b req-c7654719-fe4c-42a7-88e8-b9c8eb733e80 service nova] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Received event network-vif-deleted-277509bc-7638-47e1-b28d-85a59fc5aa01 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:51:17 user nova-compute[72809]: DEBUG nova.compute.manager [req-54c5c804-272e-4f10-867e-62f4d4ed6dd5 req-0423af75-5697-4b35-b186-c13c1e60fc69 service nova] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Received event network-vif-plugged-277509bc-7638-47e1-b28d-85a59fc5aa01 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:51:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-54c5c804-272e-4f10-867e-62f4d4ed6dd5 req-0423af75-5697-4b35-b186-c13c1e60fc69 service nova] Acquiring lock "80f694fb-e406-4b66-badc-f3686f3f1dc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-54c5c804-272e-4f10-867e-62f4d4ed6dd5 req-0423af75-5697-4b35-b186-c13c1e60fc69 service nova] Lock "80f694fb-e406-4b66-badc-f3686f3f1dc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-54c5c804-272e-4f10-867e-62f4d4ed6dd5 req-0423af75-5697-4b35-b186-c13c1e60fc69 service nova] Lock "80f694fb-e406-4b66-badc-f3686f3f1dc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:17 user nova-compute[72809]: DEBUG nova.compute.manager [req-54c5c804-272e-4f10-867e-62f4d4ed6dd5 req-0423af75-5697-4b35-b186-c13c1e60fc69 service nova] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] No waiting events found dispatching network-vif-plugged-277509bc-7638-47e1-b28d-85a59fc5aa01 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:51:17 user nova-compute[72809]: WARNING nova.compute.manager [req-54c5c804-272e-4f10-867e-62f4d4ed6dd5 req-0423af75-5697-4b35-b186-c13c1e60fc69 service nova] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Received unexpected event network-vif-plugged-277509bc-7638-47e1-b28d-85a59fc5aa01 for instance with vm_state active and task_state deleting.
Aug 09 06:51:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-95be5fd0-92c7-4172-adea-88a610791769 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-95be5fd0-92c7-4172-adea-88a610791769 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:17 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-95be5fd0-92c7-4172-adea-88a610791769 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:51:17 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-95be5fd0-92c7-4172-adea-88a610791769 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:51:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-95be5fd0-92c7-4172-adea-88a610791769 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.320s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:17 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-95be5fd0-92c7-4172-adea-88a610791769 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Deleted allocations for instance 80f694fb-e406-4b66-badc-f3686f3f1dc9
Aug 09 06:51:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-95be5fd0-92c7-4172-adea-88a610791769 tempest-AttachSCSIVolumeTestJSON-551348959 tempest-AttachSCSIVolumeTestJSON-551348959-project-member] Lock "80f694fb-e406-4b66-badc-f3686f3f1dc9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.812s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-51078c37-bb91-4db2-b338-c31676c53bee tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Acquiring lock "d16ad749-f432-43e8-a5f9-96158a4308cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-51078c37-bb91-4db2-b338-c31676c53bee tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Lock "d16ad749-f432-43e8-a5f9-96158a4308cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-51078c37-bb91-4db2-b338-c31676c53bee tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Acquiring lock "d16ad749-f432-43e8-a5f9-96158a4308cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-51078c37-bb91-4db2-b338-c31676c53bee tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Lock "d16ad749-f432-43e8-a5f9-96158a4308cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-51078c37-bb91-4db2-b338-c31676c53bee tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Lock "d16ad749-f432-43e8-a5f9-96158a4308cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:18 user nova-compute[72809]: INFO nova.compute.manager [None req-51078c37-bb91-4db2-b338-c31676c53bee tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Terminating instance
Aug 09 06:51:18 user nova-compute[72809]: DEBUG nova.compute.manager [None req-51078c37-bb91-4db2-b338-c31676c53bee tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 06:51:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:19 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Instance destroyed successfully.
Aug 09 06:51:19 user nova-compute[72809]: DEBUG nova.objects.instance [None req-51078c37-bb91-4db2-b338-c31676c53bee tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Lazy-loading 'resources' on Instance uuid d16ad749-f432-43e8-a5f9-96158a4308cf {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:51:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-51078c37-bb91-4db2-b338-c31676c53bee tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:49:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-691523299',display_name='tempest-VolumesNegativeTest-instance-691523299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-691523299',id=9,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:49:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af6ea5a7ad1f4383b077e151035a073a',ramdisk_id='',reservation_id='r-b3s4z73d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1069937085',owner_user_name='tempest-VolumesNegativeTest-1069937085-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:49:37Z,user_data=None,user_id='a8e71430bacd407ea07e7d7e36e5c748',uuid=d16ad749-f432-43e8-a5f9-96158a4308cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d551bda7-293c-42a4-b9b6-1d615735311a", "address": "fa:16:3e:33:c7:2c", "network": {"id": "80829c7c-8ba2-4c90-8504-425cf4b5ac8a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1295da1a81a44fec9e3e3e20732a553c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd551bda7-29", "ovs_interfaceid": "d551bda7-293c-42a4-b9b6-1d615735311a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:51:19 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-51078c37-bb91-4db2-b338-c31676c53bee tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Converting VIF {"id": "d551bda7-293c-42a4-b9b6-1d615735311a", "address": "fa:16:3e:33:c7:2c", "network": {"id": "80829c7c-8ba2-4c90-8504-425cf4b5ac8a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1295da1a81a44fec9e3e3e20732a553c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd551bda7-29", "ovs_interfaceid": "d551bda7-293c-42a4-b9b6-1d615735311a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:51:19 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-51078c37-bb91-4db2-b338-c31676c53bee tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:c7:2c,bridge_name='br-int',has_traffic_filtering=True,id=d551bda7-293c-42a4-b9b6-1d615735311a,network=Network(80829c7c-8ba2-4c90-8504-425cf4b5ac8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd551bda7-29') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:51:19 user nova-compute[72809]: DEBUG os_vif [None req-51078c37-bb91-4db2-b338-c31676c53bee tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:c7:2c,bridge_name='br-int',has_traffic_filtering=True,id=d551bda7-293c-42a4-b9b6-1d615735311a,network=Network(80829c7c-8ba2-4c90-8504-425cf4b5ac8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd551bda7-29') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:51:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd551bda7-29, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:51:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:51:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:19 user nova-compute[72809]: INFO os_vif [None req-51078c37-bb91-4db2-b338-c31676c53bee tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:c7:2c,bridge_name='br-int',has_traffic_filtering=True,id=d551bda7-293c-42a4-b9b6-1d615735311a,network=Network(80829c7c-8ba2-4c90-8504-425cf4b5ac8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd551bda7-29')
Aug 09 06:51:19 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-51078c37-bb91-4db2-b338-c31676c53bee tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Deleting instance files /opt/stack/data/nova/instances/d16ad749-f432-43e8-a5f9-96158a4308cf_del
Aug 09 06:51:19 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-51078c37-bb91-4db2-b338-c31676c53bee tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Deletion of /opt/stack/data/nova/instances/d16ad749-f432-43e8-a5f9-96158a4308cf_del complete
Aug 09 06:51:19 user nova-compute[72809]: INFO nova.compute.manager [None req-51078c37-bb91-4db2-b338-c31676c53bee tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Took 0.66 seconds to destroy the instance on the hypervisor.
Aug 09 06:51:19 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-51078c37-bb91-4db2-b338-c31676c53bee tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 06:51:19 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 06:51:19 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 06:51:19 user nova-compute[72809]: DEBUG nova.compute.manager [req-09fed437-fc5d-49f8-acf5-3f69707deecd req-403b31c7-780d-40f5-8fc8-03ce45f914bb service nova] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Received event network-vif-unplugged-d551bda7-293c-42a4-b9b6-1d615735311a {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:51:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-09fed437-fc5d-49f8-acf5-3f69707deecd req-403b31c7-780d-40f5-8fc8-03ce45f914bb service nova] Acquiring lock "d16ad749-f432-43e8-a5f9-96158a4308cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-09fed437-fc5d-49f8-acf5-3f69707deecd req-403b31c7-780d-40f5-8fc8-03ce45f914bb service nova] Lock "d16ad749-f432-43e8-a5f9-96158a4308cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-09fed437-fc5d-49f8-acf5-3f69707deecd req-403b31c7-780d-40f5-8fc8-03ce45f914bb service nova] Lock "d16ad749-f432-43e8-a5f9-96158a4308cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:19 user nova-compute[72809]: DEBUG nova.compute.manager [req-09fed437-fc5d-49f8-acf5-3f69707deecd req-403b31c7-780d-40f5-8fc8-03ce45f914bb service nova] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] No waiting events found dispatching network-vif-unplugged-d551bda7-293c-42a4-b9b6-1d615735311a {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:51:19 user nova-compute[72809]: DEBUG nova.compute.manager [req-09fed437-fc5d-49f8-acf5-3f69707deecd req-403b31c7-780d-40f5-8fc8-03ce45f914bb service nova] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Received event network-vif-unplugged-d551bda7-293c-42a4-b9b6-1d615735311a for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 06:51:19 user nova-compute[72809]: DEBUG nova.compute.manager [req-09fed437-fc5d-49f8-acf5-3f69707deecd req-403b31c7-780d-40f5-8fc8-03ce45f914bb service nova] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Received event network-vif-plugged-d551bda7-293c-42a4-b9b6-1d615735311a {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:51:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-09fed437-fc5d-49f8-acf5-3f69707deecd req-403b31c7-780d-40f5-8fc8-03ce45f914bb service nova] Acquiring lock "d16ad749-f432-43e8-a5f9-96158a4308cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-09fed437-fc5d-49f8-acf5-3f69707deecd req-403b31c7-780d-40f5-8fc8-03ce45f914bb service nova] Lock "d16ad749-f432-43e8-a5f9-96158a4308cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-09fed437-fc5d-49f8-acf5-3f69707deecd req-403b31c7-780d-40f5-8fc8-03ce45f914bb service nova] Lock "d16ad749-f432-43e8-a5f9-96158a4308cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:19 user nova-compute[72809]: DEBUG nova.compute.manager [req-09fed437-fc5d-49f8-acf5-3f69707deecd req-403b31c7-780d-40f5-8fc8-03ce45f914bb service nova] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] No waiting events found dispatching network-vif-plugged-d551bda7-293c-42a4-b9b6-1d615735311a {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:51:19 user nova-compute[72809]: WARNING nova.compute.manager [req-09fed437-fc5d-49f8-acf5-3f69707deecd req-403b31c7-780d-40f5-8fc8-03ce45f914bb service nova] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Received unexpected event network-vif-plugged-d551bda7-293c-42a4-b9b6-1d615735311a for instance with vm_state active and task_state deleting.
Aug 09 06:51:19 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:51:19 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Took 0.42 seconds to deallocate network for instance.
Aug 09 06:51:19 user nova-compute[72809]: DEBUG nova.compute.manager [req-ec660e78-afb0-47d1-9ea4-fb3eab158885 req-348f09c6-7fa2-4912-a65d-18e312071c79 service nova] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Received event network-vif-deleted-d551bda7-293c-42a4-b9b6-1d615735311a {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:51:19 user nova-compute[72809]: INFO nova.compute.manager [req-ec660e78-afb0-47d1-9ea4-fb3eab158885 req-348f09c6-7fa2-4912-a65d-18e312071c79 service nova] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Neutron deleted interface d551bda7-293c-42a4-b9b6-1d615735311a; detaching it from the instance and deleting it from the info cache
Aug 09 06:51:19 user nova-compute[72809]: DEBUG nova.network.neutron [req-ec660e78-afb0-47d1-9ea4-fb3eab158885 req-348f09c6-7fa2-4912-a65d-18e312071c79 service nova] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:51:19 user nova-compute[72809]: DEBUG nova.compute.manager [req-ec660e78-afb0-47d1-9ea4-fb3eab158885 req-348f09c6-7fa2-4912-a65d-18e312071c79 service nova] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Detach interface failed, port_id=d551bda7-293c-42a4-b9b6-1d615735311a, reason: Instance d16ad749-f432-43e8-a5f9-96158a4308cf could not be found. {{(pid=72809) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 06:51:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-51078c37-bb91-4db2-b338-c31676c53bee tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-51078c37-bb91-4db2-b338-c31676c53bee tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:20 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-51078c37-bb91-4db2-b338-c31676c53bee tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:51:20 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-51078c37-bb91-4db2-b338-c31676c53bee tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:51:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-51078c37-bb91-4db2-b338-c31676c53bee tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:20 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-51078c37-bb91-4db2-b338-c31676c53bee tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Deleted allocations for instance d16ad749-f432-43e8-a5f9-96158a4308cf
Aug 09 06:51:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-51078c37-bb91-4db2-b338-c31676c53bee tempest-VolumesNegativeTest-1069937085 tempest-VolumesNegativeTest-1069937085-project-member] Lock "d16ad749-f432-43e8-a5f9-96158a4308cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.565s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:24 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:51:25 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:51:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:25 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 06:51:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6a12a-ecb9-4008-bf1b-28b2165dca99/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6a12a-ecb9-4008-bf1b-28b2165dca99/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6a12a-ecb9-4008-bf1b-28b2165dca99/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6a12a-ecb9-4008-bf1b-28b2165dca99/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 06:51:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:27 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 06:51:27 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 06:51:27 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 06:51:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a6a74bc-2e97-4248-8b82-abb54ff4cc83/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a6a74bc-2e97-4248-8b82-abb54ff4cc83/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a6a74bc-2e97-4248-8b82-abb54ff4cc83/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a6a74bc-2e97-4248-8b82-abb54ff4cc83/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:28 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:51:28 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:51:28 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=7547MB free_disk=25.595386505126953GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 06:51:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:28 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 24ba9b41-d0bf-4a84-9f04-bfda9525b154 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:51:28 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 3640991e-8a5b-4674-af81-3117d4269a68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:51:28 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 15dda080-3487-4316-ab7b-f7185f0a4519 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:51:28 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance b9b69c9e-f91d-4681-a53b-2f0fc4b13532 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:51:28 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance b64e7169-044c-4d0a-9ee5-f2914f1f5529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:51:28 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 8a6a74bc-2e97-4248-8b82-abb54ff4cc83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:51:28 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance f7c9bbfa-b588-4ea7-ada4-d7f806ab2381 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:51:28 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance b1d6a12a-ecb9-4008-bf1b-28b2165dca99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:51:28 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 06:51:28 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 06:51:28 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:51:28 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:51:28 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 06:51:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.415s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:30 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:51:30 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:51:30 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 06:51:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-3640991e-8a5b-4674-af81-3117d4269a68" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:51:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-3640991e-8a5b-4674-af81-3117d4269a68" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:51:30 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 06:51:31 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691563875.999296, 80f694fb-e406-4b66-badc-f3686f3f1dc9 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:51:31 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] VM Stopped (Lifecycle Event)
Aug 09 06:51:31 user nova-compute[72809]: DEBUG nova.compute.manager [None req-3c785cf2-5c19-42d5-98f5-6becdc206110 None None] [instance: 80f694fb-e406-4b66-badc-f3686f3f1dc9] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:51:31 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Updating instance_info_cache with network_info: [{"id": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "address": "fa:16:3e:70:a1:b1", "network": {"id": "d6503417-7fd7-487b-8474-f23e4cc77845", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1134767045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04f60d3bd9a41fc930f728a74371a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030dd6f3-f7", "ovs_interfaceid": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:51:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-3640991e-8a5b-4674-af81-3117d4269a68" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:51:31 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 06:51:31 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:51:31 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:51:31 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:51:31 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:51:31 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 06:51:32 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:51:34 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691563879.4014866, d16ad749-f432-43e8-a5f9-96158a4308cf => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:51:34 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] VM Stopped (Lifecycle Event)
Aug 09 06:51:34 user nova-compute[72809]: DEBUG nova.compute.manager [None req-f2f7f501-0088-4e87-b1e8-eafe0239a514 None None] [instance: d16ad749-f432-43e8-a5f9-96158a4308cf] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:51:34 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:51:34 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:34 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72809) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 06:51:34 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 06:51:34 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 06:51:34 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:43 user nova-compute[72809]: DEBUG nova.compute.manager [req-51c50c01-ea61-4b53-956e-5afdb2872450 req-cbc7df8c-40ee-45ae-8162-c51bce2d559d service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-changed-6581cf5a-ea10-419c-bd09-1f803299c311 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:51:43 user nova-compute[72809]: DEBUG nova.compute.manager [req-51c50c01-ea61-4b53-956e-5afdb2872450 req-cbc7df8c-40ee-45ae-8162-c51bce2d559d service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Refreshing instance network info cache due to event network-changed-6581cf5a-ea10-419c-bd09-1f803299c311. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:51:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-51c50c01-ea61-4b53-956e-5afdb2872450 req-cbc7df8c-40ee-45ae-8162-c51bce2d559d service nova] Acquiring lock "refresh_cache-f7c9bbfa-b588-4ea7-ada4-d7f806ab2381" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:51:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-51c50c01-ea61-4b53-956e-5afdb2872450 req-cbc7df8c-40ee-45ae-8162-c51bce2d559d service nova] Acquired lock "refresh_cache-f7c9bbfa-b588-4ea7-ada4-d7f806ab2381" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:51:43 user nova-compute[72809]: DEBUG nova.network.neutron [req-51c50c01-ea61-4b53-956e-5afdb2872450 req-cbc7df8c-40ee-45ae-8162-c51bce2d559d service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Refreshing network info cache for port 6581cf5a-ea10-419c-bd09-1f803299c311 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:51:43 user nova-compute[72809]: DEBUG nova.network.neutron [req-51c50c01-ea61-4b53-956e-5afdb2872450 req-cbc7df8c-40ee-45ae-8162-c51bce2d559d service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Updated VIF entry in instance network info cache for port 6581cf5a-ea10-419c-bd09-1f803299c311. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:51:43 user nova-compute[72809]: DEBUG nova.network.neutron [req-51c50c01-ea61-4b53-956e-5afdb2872450 req-cbc7df8c-40ee-45ae-8162-c51bce2d559d service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Updating instance_info_cache with network_info: [{"id": "6581cf5a-ea10-419c-bd09-1f803299c311", "address": "fa:16:3e:fd:67:27", "network": {"id": "1f3ccbb7-90ef-4b31-8fe7-319423a4c195", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1335319963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6581cf5a-ea", "ovs_interfaceid": "6581cf5a-ea10-419c-bd09-1f803299c311", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "address": "fa:16:3e:cc:aa:3b", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap530fb6cf-4b", "ovs_interfaceid": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "address": "fa:16:3e:f7:75:6f", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b8369b-02", "ovs_interfaceid": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d7994fbc-d242-4b35-aad4-88bf2f3bc7a3", "address": "fa:16:3e:d1:3f:09", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7994fbc-d2", "ovs_interfaceid": "d7994fbc-d242-4b35-aad4-88bf2f3bc7a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923", "address": "fa:16:3e:f1:35:4f", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fc4dcc0-2a", "ovs_interfaceid": "9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e76b5e9-78c1-405c-a866-be6f997ae4c7", "address": "fa:16:3e:8a:53:47", "network": {"id": "3c0698b4-4d41-4ad0-a954-b112d7796107", "bridge": "br-int", "label": "tempest-device-tagging-net2-1070297502", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e76b5e9-78", "ovs_interfaceid": "4e76b5e9-78c1-405c-a866-be6f997ae4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23fba0ea-7bd6-4b7e-81a7-055a92b53590", "address": "fa:16:3e:ff:56:8a", "network": {"id": "3c0698b4-4d41-4ad0-a954-b112d7796107", "bridge": "br-int", "label": "tempest-device-tagging-net2-1070297502", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23fba0ea-7b", "ovs_interfaceid": "23fba0ea-7bd6-4b7e-81a7-055a92b53590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:51:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-51c50c01-ea61-4b53-956e-5afdb2872450 req-cbc7df8c-40ee-45ae-8162-c51bce2d559d service nova] Releasing lock "refresh_cache-f7c9bbfa-b588-4ea7-ada4-d7f806ab2381" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:51:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:51:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Acquiring lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Acquiring lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:46 user nova-compute[72809]: INFO nova.compute.manager [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Terminating instance
Aug 09 06:51:46 user nova-compute[72809]: DEBUG nova.compute.manager [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 06:51:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:46 user nova-compute[72809]: DEBUG nova.compute.manager [req-658a94ce-0335-4ebb-8e90-2664b5e669dc req-9071bf92-7270-4d5c-833a-3e150c8ba40d service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-unplugged-530fb6cf-4b83-44a2-9792-7d844987f6e8 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:51:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-658a94ce-0335-4ebb-8e90-2664b5e669dc req-9071bf92-7270-4d5c-833a-3e150c8ba40d service nova] Acquiring lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-658a94ce-0335-4ebb-8e90-2664b5e669dc req-9071bf92-7270-4d5c-833a-3e150c8ba40d service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-658a94ce-0335-4ebb-8e90-2664b5e669dc req-9071bf92-7270-4d5c-833a-3e150c8ba40d service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:46 user nova-compute[72809]: DEBUG nova.compute.manager [req-658a94ce-0335-4ebb-8e90-2664b5e669dc req-9071bf92-7270-4d5c-833a-3e150c8ba40d service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] No waiting events found dispatching network-vif-unplugged-530fb6cf-4b83-44a2-9792-7d844987f6e8 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:51:46 user nova-compute[72809]: DEBUG nova.compute.manager [req-658a94ce-0335-4ebb-8e90-2664b5e669dc req-9071bf92-7270-4d5c-833a-3e150c8ba40d service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-unplugged-530fb6cf-4b83-44a2-9792-7d844987f6e8 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 06:51:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:46 user nova-compute[72809]: DEBUG nova.compute.manager [req-7a665ed9-c50c-4bc1-97fa-02b727aabe84 req-83f21716-6bb2-48e4-a2bb-aa12c2f03bb8 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-unplugged-6581cf5a-ea10-419c-bd09-1f803299c311 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:51:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7a665ed9-c50c-4bc1-97fa-02b727aabe84 req-83f21716-6bb2-48e4-a2bb-aa12c2f03bb8 service nova] Acquiring lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7a665ed9-c50c-4bc1-97fa-02b727aabe84 req-83f21716-6bb2-48e4-a2bb-aa12c2f03bb8 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7a665ed9-c50c-4bc1-97fa-02b727aabe84 req-83f21716-6bb2-48e4-a2bb-aa12c2f03bb8 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:46 user nova-compute[72809]: DEBUG nova.compute.manager [req-7a665ed9-c50c-4bc1-97fa-02b727aabe84 req-83f21716-6bb2-48e4-a2bb-aa12c2f03bb8 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] No waiting events found dispatching network-vif-unplugged-6581cf5a-ea10-419c-bd09-1f803299c311 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:51:46 user nova-compute[72809]: DEBUG nova.compute.manager [req-7a665ed9-c50c-4bc1-97fa-02b727aabe84 req-83f21716-6bb2-48e4-a2bb-aa12c2f03bb8 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-unplugged-6581cf5a-ea10-419c-bd09-1f803299c311 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 06:51:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:47 user nova-compute[72809]: DEBUG nova.compute.manager [req-404fdabc-f39b-48da-8899-b3fc61807a3e req-bb3b6f8d-e737-4d91-92bd-0cf4a1118017 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-unplugged-e3b8369b-0287-4dc7-8465-325f8eb9e413 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:51:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-404fdabc-f39b-48da-8899-b3fc61807a3e req-bb3b6f8d-e737-4d91-92bd-0cf4a1118017 service nova] Acquiring lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-404fdabc-f39b-48da-8899-b3fc61807a3e req-bb3b6f8d-e737-4d91-92bd-0cf4a1118017 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-404fdabc-f39b-48da-8899-b3fc61807a3e req-bb3b6f8d-e737-4d91-92bd-0cf4a1118017 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:47 user nova-compute[72809]: DEBUG nova.compute.manager [req-404fdabc-f39b-48da-8899-b3fc61807a3e req-bb3b6f8d-e737-4d91-92bd-0cf4a1118017 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] No waiting events found dispatching network-vif-unplugged-e3b8369b-0287-4dc7-8465-325f8eb9e413 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:51:47 user nova-compute[72809]: DEBUG nova.compute.manager [req-404fdabc-f39b-48da-8899-b3fc61807a3e req-bb3b6f8d-e737-4d91-92bd-0cf4a1118017 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-unplugged-e3b8369b-0287-4dc7-8465-325f8eb9e413 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 06:51:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:47 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Instance destroyed successfully.
Aug 09 06:51:47 user nova-compute[72809]: DEBUG nova.objects.instance [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lazy-loading 'resources' on Instance uuid f7c9bbfa-b588-4ea7-ada4-d7f806ab2381 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:51:47 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:49:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1253190687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1253190687',id=10,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiZtuCjlnJJm/mGv7lthMY8BbpPUcXlvL0RQRVvPI13aTpJkIFenaeN59k9LZ4ZTFgt75ah3g634KMsDG2jlpFiZ66QrhHmscfpQ7RXE3e53ltT178RwMVQrMM4ijik8w==',key_name='tempest-keypair-304464645',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:50:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d77aa113e6ca4baea8cb26d9abbb1d89',ramdisk_id='',reservation_id='r-ag679rbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-899801422',owner_user_name='tempest-TaggedBootDevicesTest_v242-899801422-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:50:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e07bd13d284f4b289ce805dd71d24919',uuid=f7c9bbfa-b588-4ea7-ada4-d7f806ab2381,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6581cf5a-ea10-419c-bd09-1f803299c311", "address": "fa:16:3e:fd:67:27", "network": {"id": "1f3ccbb7-90ef-4b31-8fe7-319423a4c195", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1335319963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6581cf5a-ea", "ovs_interfaceid": "6581cf5a-ea10-419c-bd09-1f803299c311", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:51:47 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converting VIF {"id": "6581cf5a-ea10-419c-bd09-1f803299c311", "address": "fa:16:3e:fd:67:27", "network": {"id": "1f3ccbb7-90ef-4b31-8fe7-319423a4c195", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1335319963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6581cf5a-ea", "ovs_interfaceid": "6581cf5a-ea10-419c-bd09-1f803299c311", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:51:47 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:67:27,bridge_name='br-int',has_traffic_filtering=True,id=6581cf5a-ea10-419c-bd09-1f803299c311,network=Network(1f3ccbb7-90ef-4b31-8fe7-319423a4c195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6581cf5a-ea') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:51:47 user nova-compute[72809]: DEBUG os_vif [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:67:27,bridge_name='br-int',has_traffic_filtering=True,id=6581cf5a-ea10-419c-bd09-1f803299c311,network=Network(1f3ccbb7-90ef-4b31-8fe7-319423a4c195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6581cf5a-ea') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:51:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6581cf5a-ea, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:51:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:48 user nova-compute[72809]: INFO os_vif [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:67:27,bridge_name='br-int',has_traffic_filtering=True,id=6581cf5a-ea10-419c-bd09-1f803299c311,network=Network(1f3ccbb7-90ef-4b31-8fe7-319423a4c195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6581cf5a-ea')
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:49:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1253190687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1253190687',id=10,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiZtuCjlnJJm/mGv7lthMY8BbpPUcXlvL0RQRVvPI13aTpJkIFenaeN59k9LZ4ZTFgt75ah3g634KMsDG2jlpFiZ66QrhHmscfpQ7RXE3e53ltT178RwMVQrMM4ijik8w==',key_name='tempest-keypair-304464645',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:50:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d77aa113e6ca4baea8cb26d9abbb1d89',ramdisk_id='',reservation_id='r-ag679rbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-899801422',owner_user_name='tempest-TaggedBootDevicesTest_v242-899801422-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:50:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e07bd13d284f4b289ce805dd71d24919',uuid=f7c9bbfa-b588-4ea7-ada4-d7f806ab2381,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "address": "fa:16:3e:cc:aa:3b", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap530fb6cf-4b", "ovs_interfaceid": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converting VIF {"id": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "address": "fa:16:3e:cc:aa:3b", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap530fb6cf-4b", "ovs_interfaceid": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:aa:3b,bridge_name='br-int',has_traffic_filtering=True,id=530fb6cf-4b83-44a2-9792-7d844987f6e8,network=Network(67a54896-b575-4b4a-a125-aba8d83f674e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap530fb6cf-4b') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_vif [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:aa:3b,bridge_name='br-int',has_traffic_filtering=True,id=530fb6cf-4b83-44a2-9792-7d844987f6e8,network=Network(67a54896-b575-4b4a-a125-aba8d83f674e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap530fb6cf-4b') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap530fb6cf-4b, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:48 user nova-compute[72809]: INFO os_vif [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:aa:3b,bridge_name='br-int',has_traffic_filtering=True,id=530fb6cf-4b83-44a2-9792-7d844987f6e8,network=Network(67a54896-b575-4b4a-a125-aba8d83f674e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap530fb6cf-4b')
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:49:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1253190687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1253190687',id=10,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiZtuCjlnJJm/mGv7lthMY8BbpPUcXlvL0RQRVvPI13aTpJkIFenaeN59k9LZ4ZTFgt75ah3g634KMsDG2jlpFiZ66QrhHmscfpQ7RXE3e53ltT178RwMVQrMM4ijik8w==',key_name='tempest-keypair-304464645',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:50:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d77aa113e6ca4baea8cb26d9abbb1d89',ramdisk_id='',reservation_id='r-ag679rbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-899801422',owner_user_name='tempest-TaggedBootDevicesTest_v242-899801422-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:50:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e07bd13d284f4b289ce805dd71d24919',uuid=f7c9bbfa-b588-4ea7-ada4-d7f806ab2381,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "address": "fa:16:3e:f7:75:6f", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b8369b-02", "ovs_interfaceid": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converting VIF {"id": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "address": "fa:16:3e:f7:75:6f", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b8369b-02", "ovs_interfaceid": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:75:6f,bridge_name='br-int',has_traffic_filtering=True,id=e3b8369b-0287-4dc7-8465-325f8eb9e413,network=Network(67a54896-b575-4b4a-a125-aba8d83f674e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape3b8369b-02') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_vif [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:75:6f,bridge_name='br-int',has_traffic_filtering=True,id=e3b8369b-0287-4dc7-8465-325f8eb9e413,network=Network(67a54896-b575-4b4a-a125-aba8d83f674e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape3b8369b-02') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3b8369b-02, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:48 user nova-compute[72809]: INFO os_vif [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:75:6f,bridge_name='br-int',has_traffic_filtering=True,id=e3b8369b-0287-4dc7-8465-325f8eb9e413,network=Network(67a54896-b575-4b4a-a125-aba8d83f674e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape3b8369b-02')
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:49:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1253190687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1253190687',id=10,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiZtuCjlnJJm/mGv7lthMY8BbpPUcXlvL0RQRVvPI13aTpJkIFenaeN59k9LZ4ZTFgt75ah3g634KMsDG2jlpFiZ66QrhHmscfpQ7RXE3e53ltT178RwMVQrMM4ijik8w==',key_name='tempest-keypair-304464645',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:50:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d77aa113e6ca4baea8cb26d9abbb1d89',ramdisk_id='',reservation_id='r-ag679rbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-899801422',owner_user_name='tempest-TaggedBootDevicesTest_v242-899801422-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:50:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e07bd13d284f4b289ce805dd71d24919',uuid=f7c9bbfa-b588-4ea7-ada4-d7f806ab2381,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7994fbc-d242-4b35-aad4-88bf2f3bc7a3", "address": "fa:16:3e:d1:3f:09", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7994fbc-d2", "ovs_interfaceid": "d7994fbc-d242-4b35-aad4-88bf2f3bc7a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converting VIF {"id": "d7994fbc-d242-4b35-aad4-88bf2f3bc7a3", "address": "fa:16:3e:d1:3f:09", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7994fbc-d2", "ovs_interfaceid": "d7994fbc-d242-4b35-aad4-88bf2f3bc7a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:3f:09,bridge_name='br-int',has_traffic_filtering=True,id=d7994fbc-d242-4b35-aad4-88bf2f3bc7a3,network=Network(67a54896-b575-4b4a-a125-aba8d83f674e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7994fbc-d2') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_vif [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:3f:09,bridge_name='br-int',has_traffic_filtering=True,id=d7994fbc-d242-4b35-aad4-88bf2f3bc7a3,network=Network(67a54896-b575-4b4a-a125-aba8d83f674e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7994fbc-d2') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7994fbc-d2, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:48 user nova-compute[72809]: INFO os_vif [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:3f:09,bridge_name='br-int',has_traffic_filtering=True,id=d7994fbc-d242-4b35-aad4-88bf2f3bc7a3,network=Network(67a54896-b575-4b4a-a125-aba8d83f674e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7994fbc-d2')
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:49:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1253190687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1253190687',id=10,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiZtuCjlnJJm/mGv7lthMY8BbpPUcXlvL0RQRVvPI13aTpJkIFenaeN59k9LZ4ZTFgt75ah3g634KMsDG2jlpFiZ66QrhHmscfpQ7RXE3e53ltT178RwMVQrMM4ijik8w==',key_name='tempest-keypair-304464645',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:50:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d77aa113e6ca4baea8cb26d9abbb1d89',ramdisk_id='',reservation_id='r-ag679rbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-899801422',owner_user_name='tempest-TaggedBootDevicesTest_v242-899801422-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:50:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e07bd13d284f4b289ce805dd71d24919',uuid=f7c9bbfa-b588-4ea7-ada4-d7f806ab2381,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923", "address": "fa:16:3e:f1:35:4f", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fc4dcc0-2a", "ovs_interfaceid": "9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converting VIF {"id": "9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923", "address": "fa:16:3e:f1:35:4f", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fc4dcc0-2a", "ovs_interfaceid": "9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:35:4f,bridge_name='br-int',has_traffic_filtering=True,id=9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923,network=Network(67a54896-b575-4b4a-a125-aba8d83f674e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fc4dcc0-2a') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_vif [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:35:4f,bridge_name='br-int',has_traffic_filtering=True,id=9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923,network=Network(67a54896-b575-4b4a-a125-aba8d83f674e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fc4dcc0-2a') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9fc4dcc0-2a, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:48 user nova-compute[72809]: INFO os_vif [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:35:4f,bridge_name='br-int',has_traffic_filtering=True,id=9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923,network=Network(67a54896-b575-4b4a-a125-aba8d83f674e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fc4dcc0-2a')
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:49:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1253190687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1253190687',id=10,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiZtuCjlnJJm/mGv7lthMY8BbpPUcXlvL0RQRVvPI13aTpJkIFenaeN59k9LZ4ZTFgt75ah3g634KMsDG2jlpFiZ66QrhHmscfpQ7RXE3e53ltT178RwMVQrMM4ijik8w==',key_name='tempest-keypair-304464645',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:50:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d77aa113e6ca4baea8cb26d9abbb1d89',ramdisk_id='',reservation_id='r-ag679rbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-899801422',owner_user_name='tempest-TaggedBootDevicesTest_v242-899801422-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:50:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e07bd13d284f4b289ce805dd71d24919',uuid=f7c9bbfa-b588-4ea7-ada4-d7f806ab2381,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e76b5e9-78c1-405c-a866-be6f997ae4c7", "address": "fa:16:3e:8a:53:47", "network": {"id": "3c0698b4-4d41-4ad0-a954-b112d7796107", "bridge": "br-int", "label": "tempest-device-tagging-net2-1070297502", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e76b5e9-78", "ovs_interfaceid": "4e76b5e9-78c1-405c-a866-be6f997ae4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converting VIF {"id": "4e76b5e9-78c1-405c-a866-be6f997ae4c7", "address": "fa:16:3e:8a:53:47", "network": {"id": "3c0698b4-4d41-4ad0-a954-b112d7796107", "bridge": "br-int", "label": "tempest-device-tagging-net2-1070297502", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e76b5e9-78", "ovs_interfaceid": "4e76b5e9-78c1-405c-a866-be6f997ae4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:53:47,bridge_name='br-int',has_traffic_filtering=True,id=4e76b5e9-78c1-405c-a866-be6f997ae4c7,network=Network(3c0698b4-4d41-4ad0-a954-b112d7796107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e76b5e9-78') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_vif [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:53:47,bridge_name='br-int',has_traffic_filtering=True,id=4e76b5e9-78c1-405c-a866-be6f997ae4c7,network=Network(3c0698b4-4d41-4ad0-a954-b112d7796107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e76b5e9-78') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e76b5e9-78, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:48 user nova-compute[72809]: INFO os_vif [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:53:47,bridge_name='br-int',has_traffic_filtering=True,id=4e76b5e9-78c1-405c-a866-be6f997ae4c7,network=Network(3c0698b4-4d41-4ad0-a954-b112d7796107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e76b5e9-78')
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:49:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1253190687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1253190687',id=10,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiZtuCjlnJJm/mGv7lthMY8BbpPUcXlvL0RQRVvPI13aTpJkIFenaeN59k9LZ4ZTFgt75ah3g634KMsDG2jlpFiZ66QrhHmscfpQ7RXE3e53ltT178RwMVQrMM4ijik8w==',key_name='tempest-keypair-304464645',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:50:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d77aa113e6ca4baea8cb26d9abbb1d89',ramdisk_id='',reservation_id='r-ag679rbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-899801422',owner_user_name='tempest-TaggedBootDevicesTest_v242-899801422-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:50:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e07bd13d284f4b289ce805dd71d24919',uuid=f7c9bbfa-b588-4ea7-ada4-d7f806ab2381,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23fba0ea-7bd6-4b7e-81a7-055a92b53590", "address": "fa:16:3e:ff:56:8a", "network": {"id": "3c0698b4-4d41-4ad0-a954-b112d7796107", "bridge": "br-int", "label": "tempest-device-tagging-net2-1070297502", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23fba0ea-7b", "ovs_interfaceid": "23fba0ea-7bd6-4b7e-81a7-055a92b53590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converting VIF {"id": "23fba0ea-7bd6-4b7e-81a7-055a92b53590", "address": "fa:16:3e:ff:56:8a", "network": {"id": "3c0698b4-4d41-4ad0-a954-b112d7796107", "bridge": "br-int", "label": "tempest-device-tagging-net2-1070297502", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23fba0ea-7b", "ovs_interfaceid": "23fba0ea-7bd6-4b7e-81a7-055a92b53590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:56:8a,bridge_name='br-int',has_traffic_filtering=True,id=23fba0ea-7bd6-4b7e-81a7-055a92b53590,network=Network(3c0698b4-4d41-4ad0-a954-b112d7796107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23fba0ea-7b') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_vif [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:56:8a,bridge_name='br-int',has_traffic_filtering=True,id=23fba0ea-7bd6-4b7e-81a7-055a92b53590,network=Network(3c0698b4-4d41-4ad0-a954-b112d7796107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23fba0ea-7b') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23fba0ea-7b, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:48 user nova-compute[72809]: INFO os_vif [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:56:8a,bridge_name='br-int',has_traffic_filtering=True,id=23fba0ea-7bd6-4b7e-81a7-055a92b53590,network=Network(3c0698b4-4d41-4ad0-a954-b112d7796107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23fba0ea-7b')
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kevyfSjE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:51:48 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c45ab5-793d-4ffa-bceb-d11bbd44c3af]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[826c1932-8808-4267-a7c6-fb2bc19e8a9a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:51:48 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:51:48 user nova-compute[72809]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)
Aug 09 06:51:48 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:51:48 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:51:48 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:51:48 user nova-compute[72809]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 (non-flash)
Aug 09 06:51:48 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:51:48 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc15861feb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0'): ({'sdd'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Removing single pathed devices sdd {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d8311c-f209-48be-8055-fc36652c8fb3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[80054d51-1fdd-4f3f-ab8d-9b4fc5173998]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Flushing IO for device /dev/sdd {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca109ba8-88e8-42d1-a612-94a9f8918208]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.033s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d175d0-623f-4726-95eb-253e37a65dfd]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] SCSI volumes sdd have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f64cebc-82de-4a8a-911c-029d666e4615]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9504419-1632-48b2-9f99-f885e9746340]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0, portal: 172.16.0.220,3260]
Aug 09 06:51:48 user nova-compute[72809]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0, portal: 172.16.0.220,3260] successful.
Aug 09 06:51:48 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:326cadef-34a9-4a12-9cea-77eecb2c95d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3e41d9-4da3-46de-9e71-4f509c10411a]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] <== disconnect_volume: return (302ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGeIJEUT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:51:48 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee53f8e-a0f2-42d9-891a-0344c79310ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.compute.manager [req-478c1037-e992-440c-b842-1f1035c13684 req-7808e3e0-a7c0-458f-b29d-b208f0d88d80 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-plugged-530fb6cf-4b83-44a2-9792-7d844987f6e8 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-478c1037-e992-440c-b842-1f1035c13684 req-7808e3e0-a7c0-458f-b29d-b208f0d88d80 service nova] Acquiring lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-478c1037-e992-440c-b842-1f1035c13684 req-7808e3e0-a7c0-458f-b29d-b208f0d88d80 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-478c1037-e992-440c-b842-1f1035c13684 req-7808e3e0-a7c0-458f-b29d-b208f0d88d80 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.compute.manager [req-478c1037-e992-440c-b842-1f1035c13684 req-7808e3e0-a7c0-458f-b29d-b208f0d88d80 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] No waiting events found dispatching network-vif-plugged-530fb6cf-4b83-44a2-9792-7d844987f6e8 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:51:48 user nova-compute[72809]: WARNING nova.compute.manager [req-478c1037-e992-440c-b842-1f1035c13684 req-7808e3e0-a7c0-458f-b29d-b208f0d88d80 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received unexpected event network-vif-plugged-530fb6cf-4b83-44a2-9792-7d844987f6e8 for instance with vm_state active and task_state deleting.
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.compute.manager [req-478c1037-e992-440c-b842-1f1035c13684 req-7808e3e0-a7c0-458f-b29d-b208f0d88d80 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-unplugged-23fba0ea-7bd6-4b7e-81a7-055a92b53590 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-478c1037-e992-440c-b842-1f1035c13684 req-7808e3e0-a7c0-458f-b29d-b208f0d88d80 service nova] Acquiring lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-478c1037-e992-440c-b842-1f1035c13684 req-7808e3e0-a7c0-458f-b29d-b208f0d88d80 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-478c1037-e992-440c-b842-1f1035c13684 req-7808e3e0-a7c0-458f-b29d-b208f0d88d80 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.compute.manager [req-478c1037-e992-440c-b842-1f1035c13684 req-7808e3e0-a7c0-458f-b29d-b208f0d88d80 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] No waiting events found dispatching network-vif-unplugged-23fba0ea-7bd6-4b7e-81a7-055a92b53590 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.compute.manager [req-478c1037-e992-440c-b842-1f1035c13684 req-7808e3e0-a7c0-458f-b29d-b208f0d88d80 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-unplugged-23fba0ea-7bd6-4b7e-81a7-055a92b53590 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.compute.manager [req-478c1037-e992-440c-b842-1f1035c13684 req-7808e3e0-a7c0-458f-b29d-b208f0d88d80 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-plugged-23fba0ea-7bd6-4b7e-81a7-055a92b53590 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-478c1037-e992-440c-b842-1f1035c13684 req-7808e3e0-a7c0-458f-b29d-b208f0d88d80 service nova] Acquiring lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-478c1037-e992-440c-b842-1f1035c13684 req-7808e3e0-a7c0-458f-b29d-b208f0d88d80 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-478c1037-e992-440c-b842-1f1035c13684 req-7808e3e0-a7c0-458f-b29d-b208f0d88d80 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.compute.manager [req-478c1037-e992-440c-b842-1f1035c13684 req-7808e3e0-a7c0-458f-b29d-b208f0d88d80 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] No waiting events found dispatching network-vif-plugged-23fba0ea-7bd6-4b7e-81a7-055a92b53590 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:51:48 user nova-compute[72809]: WARNING nova.compute.manager [req-478c1037-e992-440c-b842-1f1035c13684 req-7808e3e0-a7c0-458f-b29d-b208f0d88d80 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received unexpected event network-vif-plugged-23fba0ea-7bd6-4b7e-81a7-055a92b53590 for instance with vm_state active and task_state deleting.
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ef4be8-abe0-47d2-aedb-2086b370374f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:51:48 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:51:48 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:51:48 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:51:48 user nova-compute[72809]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 (non-flash)
Aug 09 06:51:48 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:51:48 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc138712710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587'): ({'sdc'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Removing single pathed devices sdc {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a883909e-9ab1-4d25-81f6-d0968848059d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[20621abe-f426-4952-befc-500f85e9dfd4]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Flushing IO for device /dev/sdc {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b33a7a-248d-4dbd-9ec8-cbab5cd5cb5b]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba149b55-96ff-4418-bb39-8a3466aaf3eb]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] SCSI volumes sdc have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab58146d-93bf-497c-abe5-f501612c0aff]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b87c51-3f53-4c12-9765-06a4cb0e35a9]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587, portal: 172.16.0.220,3260]
Aug 09 06:51:48 user nova-compute[72809]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587, portal: 172.16.0.220,3260] successful.
Aug 09 06:51:48 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.compute.manager [req-484b7aa7-5be2-4bba-89fe-0328dc1e32f3 req-d6ce8ef4-d613-4d1f-ad89-7513baa4485f service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-plugged-6581cf5a-ea10-419c-bd09-1f803299c311 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-484b7aa7-5be2-4bba-89fe-0328dc1e32f3 req-d6ce8ef4-d613-4d1f-ad89-7513baa4485f service nova] Acquiring lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-484b7aa7-5be2-4bba-89fe-0328dc1e32f3 req-d6ce8ef4-d613-4d1f-ad89-7513baa4485f service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-484b7aa7-5be2-4bba-89fe-0328dc1e32f3 req-d6ce8ef4-d613-4d1f-ad89-7513baa4485f service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.compute.manager [req-484b7aa7-5be2-4bba-89fe-0328dc1e32f3 req-d6ce8ef4-d613-4d1f-ad89-7513baa4485f service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] No waiting events found dispatching network-vif-plugged-6581cf5a-ea10-419c-bd09-1f803299c311 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:51:48 user nova-compute[72809]: WARNING nova.compute.manager [req-484b7aa7-5be2-4bba-89fe-0328dc1e32f3 req-d6ce8ef4-d613-4d1f-ad89-7513baa4485f service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received unexpected event network-vif-plugged-6581cf5a-ea10-419c-bd09-1f803299c311 for instance with vm_state active and task_state deleting.
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.compute.manager [req-484b7aa7-5be2-4bba-89fe-0328dc1e32f3 req-d6ce8ef4-d613-4d1f-ad89-7513baa4485f service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-unplugged-d7994fbc-d242-4b35-aad4-88bf2f3bc7a3 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-484b7aa7-5be2-4bba-89fe-0328dc1e32f3 req-d6ce8ef4-d613-4d1f-ad89-7513baa4485f service nova] Acquiring lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-484b7aa7-5be2-4bba-89fe-0328dc1e32f3 req-d6ce8ef4-d613-4d1f-ad89-7513baa4485f service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-484b7aa7-5be2-4bba-89fe-0328dc1e32f3 req-d6ce8ef4-d613-4d1f-ad89-7513baa4485f service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.compute.manager [req-484b7aa7-5be2-4bba-89fe-0328dc1e32f3 req-d6ce8ef4-d613-4d1f-ad89-7513baa4485f service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] No waiting events found dispatching network-vif-unplugged-d7994fbc-d242-4b35-aad4-88bf2f3bc7a3 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.compute.manager [req-484b7aa7-5be2-4bba-89fe-0328dc1e32f3 req-d6ce8ef4-d613-4d1f-ad89-7513baa4485f service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-unplugged-d7994fbc-d242-4b35-aad4-88bf2f3bc7a3 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.compute.manager [req-484b7aa7-5be2-4bba-89fe-0328dc1e32f3 req-d6ce8ef4-d613-4d1f-ad89-7513baa4485f service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-plugged-d7994fbc-d242-4b35-aad4-88bf2f3bc7a3 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-484b7aa7-5be2-4bba-89fe-0328dc1e32f3 req-d6ce8ef4-d613-4d1f-ad89-7513baa4485f service nova] Acquiring lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-484b7aa7-5be2-4bba-89fe-0328dc1e32f3 req-d6ce8ef4-d613-4d1f-ad89-7513baa4485f service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-484b7aa7-5be2-4bba-89fe-0328dc1e32f3 req-d6ce8ef4-d613-4d1f-ad89-7513baa4485f service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.compute.manager [req-484b7aa7-5be2-4bba-89fe-0328dc1e32f3 req-d6ce8ef4-d613-4d1f-ad89-7513baa4485f service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] No waiting events found dispatching network-vif-plugged-d7994fbc-d242-4b35-aad4-88bf2f3bc7a3 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:51:48 user nova-compute[72809]: WARNING nova.compute.manager [req-484b7aa7-5be2-4bba-89fe-0328dc1e32f3 req-d6ce8ef4-d613-4d1f-ad89-7513baa4485f service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received unexpected event network-vif-plugged-d7994fbc-d242-4b35-aad4-88bf2f3bc7a3 for instance with vm_state active and task_state deleting.
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.compute.manager [req-484b7aa7-5be2-4bba-89fe-0328dc1e32f3 req-d6ce8ef4-d613-4d1f-ad89-7513baa4485f service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-unplugged-4e76b5e9-78c1-405c-a866-be6f997ae4c7 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-484b7aa7-5be2-4bba-89fe-0328dc1e32f3 req-d6ce8ef4-d613-4d1f-ad89-7513baa4485f service nova] Acquiring lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-484b7aa7-5be2-4bba-89fe-0328dc1e32f3 req-d6ce8ef4-d613-4d1f-ad89-7513baa4485f service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-484b7aa7-5be2-4bba-89fe-0328dc1e32f3 req-d6ce8ef4-d613-4d1f-ad89-7513baa4485f service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.compute.manager [req-484b7aa7-5be2-4bba-89fe-0328dc1e32f3 req-d6ce8ef4-d613-4d1f-ad89-7513baa4485f service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] No waiting events found dispatching network-vif-unplugged-4e76b5e9-78c1-405c-a866-be6f997ae4c7 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.compute.manager [req-484b7aa7-5be2-4bba-89fe-0328dc1e32f3 req-d6ce8ef4-d613-4d1f-ad89-7513baa4485f service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-unplugged-4e76b5e9-78c1-405c-a866-be6f997ae4c7 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.compute.manager [req-484b7aa7-5be2-4bba-89fe-0328dc1e32f3 req-d6ce8ef4-d613-4d1f-ad89-7513baa4485f service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-plugged-4e76b5e9-78c1-405c-a866-be6f997ae4c7 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-484b7aa7-5be2-4bba-89fe-0328dc1e32f3 req-d6ce8ef4-d613-4d1f-ad89-7513baa4485f service nova] Acquiring lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-484b7aa7-5be2-4bba-89fe-0328dc1e32f3 req-d6ce8ef4-d613-4d1f-ad89-7513baa4485f service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-484b7aa7-5be2-4bba-89fe-0328dc1e32f3 req-d6ce8ef4-d613-4d1f-ad89-7513baa4485f service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.compute.manager [req-484b7aa7-5be2-4bba-89fe-0328dc1e32f3 req-d6ce8ef4-d613-4d1f-ad89-7513baa4485f service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] No waiting events found dispatching network-vif-plugged-4e76b5e9-78c1-405c-a866-be6f997ae4c7 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:51:48 user nova-compute[72809]: WARNING nova.compute.manager [req-484b7aa7-5be2-4bba-89fe-0328dc1e32f3 req-d6ce8ef4-d613-4d1f-ad89-7513baa4485f service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received unexpected event network-vif-plugged-4e76b5e9-78c1-405c-a866-be6f997ae4c7 for instance with vm_state active and task_state deleting.
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1599d24-eefb-4811-b6d9-3a9bd82b8587 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c70d7e5-c48a-455d-a056-f94a01835c6d]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] <== disconnect_volume: return (304ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zsRvMqwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:51:48 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5cbb605-2d4b-4002-b545-c3b6e27d0995]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ad8bbc-d2c8-4654-9a93-69f872ae0fb0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:51:49 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:51:49 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 (non-flash)
Aug 09 06:51:49 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:51:49 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc16c20c160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719'): ({'sdb'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Removing single pathed devices sdb {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[040e5cd4-a3e7-4519-b3c4-4fd9003cc18a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00fd3a8-f9ea-4998-bfef-3db51c720ebb]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Flushing IO for device /dev/sdb {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e444114b-3fd9-4566-bb9d-36bdfffde143]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG nova.compute.manager [req-9dd7bde8-f375-448f-8c63-a7083e8db0e4 req-2fa31026-41b5-414d-8c59-a37021f17719 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-plugged-e3b8369b-0287-4dc7-8465-325f8eb9e413 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9dd7bde8-f375-448f-8c63-a7083e8db0e4 req-2fa31026-41b5-414d-8c59-a37021f17719 service nova] Acquiring lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9dd7bde8-f375-448f-8c63-a7083e8db0e4 req-2fa31026-41b5-414d-8c59-a37021f17719 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9dd7bde8-f375-448f-8c63-a7083e8db0e4 req-2fa31026-41b5-414d-8c59-a37021f17719 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG nova.compute.manager [req-9dd7bde8-f375-448f-8c63-a7083e8db0e4 req-2fa31026-41b5-414d-8c59-a37021f17719 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] No waiting events found dispatching network-vif-plugged-e3b8369b-0287-4dc7-8465-325f8eb9e413 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:51:49 user nova-compute[72809]: WARNING nova.compute.manager [req-9dd7bde8-f375-448f-8c63-a7083e8db0e4 req-2fa31026-41b5-414d-8c59-a37021f17719 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received unexpected event network-vif-plugged-e3b8369b-0287-4dc7-8465-325f8eb9e413 for instance with vm_state active and task_state deleting.
Aug 09 06:51:49 user nova-compute[72809]: DEBUG nova.compute.manager [req-9dd7bde8-f375-448f-8c63-a7083e8db0e4 req-2fa31026-41b5-414d-8c59-a37021f17719 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-unplugged-9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9dd7bde8-f375-448f-8c63-a7083e8db0e4 req-2fa31026-41b5-414d-8c59-a37021f17719 service nova] Acquiring lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9dd7bde8-f375-448f-8c63-a7083e8db0e4 req-2fa31026-41b5-414d-8c59-a37021f17719 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9dd7bde8-f375-448f-8c63-a7083e8db0e4 req-2fa31026-41b5-414d-8c59-a37021f17719 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG nova.compute.manager [req-9dd7bde8-f375-448f-8c63-a7083e8db0e4 req-2fa31026-41b5-414d-8c59-a37021f17719 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] No waiting events found dispatching network-vif-unplugged-9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG nova.compute.manager [req-9dd7bde8-f375-448f-8c63-a7083e8db0e4 req-2fa31026-41b5-414d-8c59-a37021f17719 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-unplugged-9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG nova.compute.manager [req-9dd7bde8-f375-448f-8c63-a7083e8db0e4 req-2fa31026-41b5-414d-8c59-a37021f17719 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-plugged-9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9dd7bde8-f375-448f-8c63-a7083e8db0e4 req-2fa31026-41b5-414d-8c59-a37021f17719 service nova] Acquiring lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9dd7bde8-f375-448f-8c63-a7083e8db0e4 req-2fa31026-41b5-414d-8c59-a37021f17719 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9dd7bde8-f375-448f-8c63-a7083e8db0e4 req-2fa31026-41b5-414d-8c59-a37021f17719 service nova] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG nova.compute.manager [req-9dd7bde8-f375-448f-8c63-a7083e8db0e4 req-2fa31026-41b5-414d-8c59-a37021f17719 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] No waiting events found dispatching network-vif-plugged-9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:51:49 user nova-compute[72809]: WARNING nova.compute.manager [req-9dd7bde8-f375-448f-8c63-a7083e8db0e4 req-2fa31026-41b5-414d-8c59-a37021f17719 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received unexpected event network-vif-plugged-9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923 for instance with vm_state active and task_state deleting.
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67a4fa7-24cc-4f32-9d7a-ec3bbc805367]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] SCSI volumes sdb have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25cb19b-f375-4b6b-b41f-2d7d597bdc05]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c003ac2a-e437-47de-b42a-4082d2580502]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719, portal: 172.16.0.220,3260]
Aug 09 06:51:49 user nova-compute[72809]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719, portal: 172.16.0.220,3260] successful.
Aug 09 06:51:49 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c55bd25a-5fe0-4c5e-9e36-d0a73de24719 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f204a68-d653-4f1d-9959-bf134b8248a3]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] <== disconnect_volume: return (272ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 06:51:49 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Deleting instance files /opt/stack/data/nova/instances/f7c9bbfa-b588-4ea7-ada4-d7f806ab2381_del
Aug 09 06:51:49 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Deletion of /opt/stack/data/nova/instances/f7c9bbfa-b588-4ea7-ada4-d7f806ab2381_del complete
Aug 09 06:51:49 user nova-compute[72809]: INFO nova.compute.manager [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Took 3.19 seconds to destroy the instance on the hypervisor.
Aug 09 06:51:49 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 06:51:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:50 user nova-compute[72809]: DEBUG nova.compute.manager [req-d597eec7-9b7f-44fa-8744-1a07d5fab6e3 req-03a38640-1088-40ca-afa2-4787ce09dbb2 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-deleted-d7994fbc-d242-4b35-aad4-88bf2f3bc7a3 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:51:50 user nova-compute[72809]: INFO nova.compute.manager [req-d597eec7-9b7f-44fa-8744-1a07d5fab6e3 req-03a38640-1088-40ca-afa2-4787ce09dbb2 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Neutron deleted interface d7994fbc-d242-4b35-aad4-88bf2f3bc7a3; detaching it from the instance and deleting it from the info cache
Aug 09 06:51:50 user nova-compute[72809]: DEBUG nova.network.neutron [req-d597eec7-9b7f-44fa-8744-1a07d5fab6e3 req-03a38640-1088-40ca-afa2-4787ce09dbb2 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Updating instance_info_cache with network_info: [{"id": "6581cf5a-ea10-419c-bd09-1f803299c311", "address": "fa:16:3e:fd:67:27", "network": {"id": "1f3ccbb7-90ef-4b31-8fe7-319423a4c195", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1335319963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6581cf5a-ea", "ovs_interfaceid": "6581cf5a-ea10-419c-bd09-1f803299c311", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "address": "fa:16:3e:cc:aa:3b", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap530fb6cf-4b", "ovs_interfaceid": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "address": "fa:16:3e:f7:75:6f", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b8369b-02", "ovs_interfaceid": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923", "address": "fa:16:3e:f1:35:4f", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fc4dcc0-2a", "ovs_interfaceid": "9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e76b5e9-78c1-405c-a866-be6f997ae4c7", "address": "fa:16:3e:8a:53:47", "network": {"id": "3c0698b4-4d41-4ad0-a954-b112d7796107", "bridge": "br-int", "label": "tempest-device-tagging-net2-1070297502", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e76b5e9-78", "ovs_interfaceid": "4e76b5e9-78c1-405c-a866-be6f997ae4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23fba0ea-7bd6-4b7e-81a7-055a92b53590", "address": "fa:16:3e:ff:56:8a", "network": {"id": "3c0698b4-4d41-4ad0-a954-b112d7796107", "bridge": "br-int", "label": "tempest-device-tagging-net2-1070297502", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23fba0ea-7b", "ovs_interfaceid": "23fba0ea-7bd6-4b7e-81a7-055a92b53590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:51:51 user nova-compute[72809]: DEBUG nova.compute.manager [req-d597eec7-9b7f-44fa-8744-1a07d5fab6e3 req-03a38640-1088-40ca-afa2-4787ce09dbb2 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Detach interface failed, port_id=d7994fbc-d242-4b35-aad4-88bf2f3bc7a3, reason: Instance f7c9bbfa-b588-4ea7-ada4-d7f806ab2381 could not be found. {{(pid=72809) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 06:51:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:53 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:51:53 user nova-compute[72809]: DEBUG nova.compute.manager [req-1f579023-416c-4fa8-be28-4c62933c480d req-bb90d843-ed8a-4e4d-802d-d81bc0e7c0bb service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-deleted-6581cf5a-ea10-419c-bd09-1f803299c311 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:51:53 user nova-compute[72809]: INFO nova.compute.manager [req-1f579023-416c-4fa8-be28-4c62933c480d req-bb90d843-ed8a-4e4d-802d-d81bc0e7c0bb service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Neutron deleted interface 6581cf5a-ea10-419c-bd09-1f803299c311; detaching it from the instance and deleting it from the info cache
Aug 09 06:51:53 user nova-compute[72809]: DEBUG nova.network.neutron [req-1f579023-416c-4fa8-be28-4c62933c480d req-bb90d843-ed8a-4e4d-802d-d81bc0e7c0bb service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Updating instance_info_cache with network_info: [{"id": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "address": "fa:16:3e:cc:aa:3b", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap530fb6cf-4b", "ovs_interfaceid": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "address": "fa:16:3e:f7:75:6f", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b8369b-02", "ovs_interfaceid": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923", "address": "fa:16:3e:f1:35:4f", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fc4dcc0-2a", "ovs_interfaceid": "9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e76b5e9-78c1-405c-a866-be6f997ae4c7", "address": "fa:16:3e:8a:53:47", "network": {"id": "3c0698b4-4d41-4ad0-a954-b112d7796107", "bridge": "br-int", "label": "tempest-device-tagging-net2-1070297502", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e76b5e9-78", "ovs_interfaceid": "4e76b5e9-78c1-405c-a866-be6f997ae4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23fba0ea-7bd6-4b7e-81a7-055a92b53590", "address": "fa:16:3e:ff:56:8a", "network": {"id": "3c0698b4-4d41-4ad0-a954-b112d7796107", "bridge": "br-int", "label": "tempest-device-tagging-net2-1070297502", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23fba0ea-7b", "ovs_interfaceid": "23fba0ea-7bd6-4b7e-81a7-055a92b53590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:51:53 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Took 3.70 seconds to deallocate network for instance.
Aug 09 06:51:53 user nova-compute[72809]: DEBUG nova.compute.manager [req-1f579023-416c-4fa8-be28-4c62933c480d req-bb90d843-ed8a-4e4d-802d-d81bc0e7c0bb service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Detach interface failed, port_id=6581cf5a-ea10-419c-bd09-1f803299c311, reason: Instance f7c9bbfa-b588-4ea7-ada4-d7f806ab2381 could not be found. {{(pid=72809) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 06:51:53 user nova-compute[72809]: DEBUG nova.compute.manager [req-1f579023-416c-4fa8-be28-4c62933c480d req-bb90d843-ed8a-4e4d-802d-d81bc0e7c0bb service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-deleted-4e76b5e9-78c1-405c-a866-be6f997ae4c7 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:51:53 user nova-compute[72809]: INFO nova.compute.manager [req-1f579023-416c-4fa8-be28-4c62933c480d req-bb90d843-ed8a-4e4d-802d-d81bc0e7c0bb service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Neutron deleted interface 4e76b5e9-78c1-405c-a866-be6f997ae4c7; detaching it from the instance and deleting it from the info cache
Aug 09 06:51:53 user nova-compute[72809]: DEBUG nova.network.neutron [req-1f579023-416c-4fa8-be28-4c62933c480d req-bb90d843-ed8a-4e4d-802d-d81bc0e7c0bb service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Updating instance_info_cache with network_info: [{"id": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "address": "fa:16:3e:cc:aa:3b", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap530fb6cf-4b", "ovs_interfaceid": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "address": "fa:16:3e:f7:75:6f", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b8369b-02", "ovs_interfaceid": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923", "address": "fa:16:3e:f1:35:4f", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fc4dcc0-2a", "ovs_interfaceid": "9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23fba0ea-7bd6-4b7e-81a7-055a92b53590", "address": "fa:16:3e:ff:56:8a", "network": {"id": "3c0698b4-4d41-4ad0-a954-b112d7796107", "bridge": "br-int", "label": "tempest-device-tagging-net2-1070297502", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23fba0ea-7b", "ovs_interfaceid": "23fba0ea-7bd6-4b7e-81a7-055a92b53590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:51:53 user nova-compute[72809]: DEBUG nova.compute.manager [req-1f579023-416c-4fa8-be28-4c62933c480d req-bb90d843-ed8a-4e4d-802d-d81bc0e7c0bb service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Detach interface failed, port_id=4e76b5e9-78c1-405c-a866-be6f997ae4c7, reason: Instance f7c9bbfa-b588-4ea7-ada4-d7f806ab2381 could not be found. {{(pid=72809) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 06:51:53 user nova-compute[72809]: DEBUG nova.compute.manager [req-1f579023-416c-4fa8-be28-4c62933c480d req-bb90d843-ed8a-4e4d-802d-d81bc0e7c0bb service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-deleted-23fba0ea-7bd6-4b7e-81a7-055a92b53590 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:51:53 user nova-compute[72809]: INFO nova.compute.manager [req-1f579023-416c-4fa8-be28-4c62933c480d req-bb90d843-ed8a-4e4d-802d-d81bc0e7c0bb service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Neutron deleted interface 23fba0ea-7bd6-4b7e-81a7-055a92b53590; detaching it from the instance and deleting it from the info cache
Aug 09 06:51:53 user nova-compute[72809]: DEBUG nova.network.neutron [req-1f579023-416c-4fa8-be28-4c62933c480d req-bb90d843-ed8a-4e4d-802d-d81bc0e7c0bb service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Updating instance_info_cache with network_info: [{"id": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "address": "fa:16:3e:cc:aa:3b", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap530fb6cf-4b", "ovs_interfaceid": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "address": "fa:16:3e:f7:75:6f", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b8369b-02", "ovs_interfaceid": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923", "address": "fa:16:3e:f1:35:4f", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fc4dcc0-2a", "ovs_interfaceid": "9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:51:53 user nova-compute[72809]: DEBUG nova.compute.manager [req-1f579023-416c-4fa8-be28-4c62933c480d req-bb90d843-ed8a-4e4d-802d-d81bc0e7c0bb service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Detach interface failed, port_id=23fba0ea-7bd6-4b7e-81a7-055a92b53590, reason: Instance f7c9bbfa-b588-4ea7-ada4-d7f806ab2381 could not be found. {{(pid=72809) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 06:51:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:55 user nova-compute[72809]: DEBUG nova.compute.manager [req-98e80973-de30-487c-b6f9-47e6ee415ba8 req-64a8136e-8ef9-40f2-85bf-d5452675d8e8 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Received event network-vif-deleted-9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:51:55 user nova-compute[72809]: INFO nova.compute.manager [req-98e80973-de30-487c-b6f9-47e6ee415ba8 req-64a8136e-8ef9-40f2-85bf-d5452675d8e8 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Neutron deleted interface 9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923; detaching it from the instance and deleting it from the info cache
Aug 09 06:51:55 user nova-compute[72809]: DEBUG nova.network.neutron [req-98e80973-de30-487c-b6f9-47e6ee415ba8 req-64a8136e-8ef9-40f2-85bf-d5452675d8e8 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Updating instance_info_cache with network_info: [{"id": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "address": "fa:16:3e:cc:aa:3b", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap530fb6cf-4b", "ovs_interfaceid": "530fb6cf-4b83-44a2-9792-7d844987f6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "address": "fa:16:3e:f7:75:6f", "network": {"id": "67a54896-b575-4b4a-a125-aba8d83f674e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1380853579", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d77aa113e6ca4baea8cb26d9abbb1d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b8369b-02", "ovs_interfaceid": "e3b8369b-0287-4dc7-8465-325f8eb9e413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:51:55 user nova-compute[72809]: DEBUG nova.compute.manager [req-98e80973-de30-487c-b6f9-47e6ee415ba8 req-64a8136e-8ef9-40f2-85bf-d5452675d8e8 service nova] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Detach interface failed, port_id=9fc4dcc0-2aa8-42d3-9f45-fdaf85fee923, reason: Instance f7c9bbfa-b588-4ea7-ada4-d7f806ab2381 could not be found. {{(pid=72809) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 06:51:55 user nova-compute[72809]: INFO nova.compute.manager [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Took 2.26 seconds to detach 3 volumes for instance.
Aug 09 06:51:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:51:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:51:55 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:51:55 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:51:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.259s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:55 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Deleted allocations for instance f7c9bbfa-b588-4ea7-ada4-d7f806ab2381
Aug 09 06:51:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-489c2226-7fc3-4c1a-8683-e2c9a98420c9 tempest-TaggedBootDevicesTest_v242-899801422 tempest-TaggedBootDevicesTest_v242-899801422-project-member] Lock "f7c9bbfa-b588-4ea7-ada4-d7f806ab2381" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.631s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:51:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:51:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:00 user nova-compute[72809]: DEBUG nova.compute.manager [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 06:52:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:00 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 06:52:00 user nova-compute[72809]: INFO nova.compute.claims [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Claim successful on node user
Aug 09 06:52:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Acquiring lock "5fb24f48-e72d-4c52-ad10-aae7b37171db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "5fb24f48-e72d-4c52-ad10-aae7b37171db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:00 user nova-compute[72809]: DEBUG nova.compute.manager [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 06:52:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:00 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:52:00 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:52:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:00 user nova-compute[72809]: DEBUG nova.compute.manager [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 06:52:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.096s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:00 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 06:52:00 user nova-compute[72809]: INFO nova.compute.claims [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Claim successful on node user
Aug 09 06:52:00 user nova-compute[72809]: DEBUG nova.compute.manager [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 06:52:00 user nova-compute[72809]: DEBUG nova.network.neutron [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 06:52:00 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 06:52:00 user nova-compute[72809]: DEBUG nova.compute.manager [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 06:52:00 user nova-compute[72809]: DEBUG nova.policy [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e51e8a984c724efe966662c14b0dbffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec36de19d984ff3a150db4fdd8ce327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 06:52:00 user nova-compute[72809]: DEBUG nova.compute.manager [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 06:52:00 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 06:52:00 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Creating image(s)
Aug 09 06:52:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "/opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "/opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "/opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.140s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:00 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:52:00 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG nova.compute.manager [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.130s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG nova.compute.manager [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG nova.network.neutron [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk 1073741824" returned: 0 in 0.058s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:01 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 06:52:01 user nova-compute[72809]: DEBUG nova.compute.manager [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.136s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG nova.policy [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6cd5e6af221a4c0d996b4da1cce17f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d061b94c6548d88d8c3cae6751d937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG nova.compute.manager [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 06:52:01 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Creating image(s)
Aug 09 06:52:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Acquiring lock "/opt/stack/data/nova/instances/5fb24f48-e72d-4c52-ad10-aae7b37171db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "/opt/stack/data/nova/instances/5fb24f48-e72d-4c52-ad10-aae7b37171db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "/opt/stack/data/nova/instances/5fb24f48-e72d-4c52-ad10-aae7b37171db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG nova.network.neutron [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Successfully created port: b94aa917-6963-4aee-9bc2-15b2720191be {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Cannot resize image /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG nova.objects.instance [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lazy-loading 'migration_context' on Instance uuid aec0a7ee-69e1-41cf-bfa8-5733bdedd70a {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Ensure instance console log exists: /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.158s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.141s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/5fb24f48-e72d-4c52-ad10-aae7b37171db/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/5fb24f48-e72d-4c52-ad10-aae7b37171db/disk 1073741824" returned: 0 in 0.079s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.158s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5fb24f48-e72d-4c52-ad10-aae7b37171db/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb24f48-e72d-4c52-ad10-aae7b37171db/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:01 user nova-compute[72809]: DEBUG nova.network.neutron [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Successfully created port: 7e6d0833-c258-4fec-bd3d-37233d8cc699 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb24f48-e72d-4c52-ad10-aae7b37171db/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Cannot resize image /opt/stack/data/nova/instances/5fb24f48-e72d-4c52-ad10-aae7b37171db/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.objects.instance [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lazy-loading 'migration_context' on Instance uuid 5fb24f48-e72d-4c52-ad10-aae7b37171db {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Ensure instance console log exists: /opt/stack/data/nova/instances/5fb24f48-e72d-4c52-ad10-aae7b37171db/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2e1855b9-a477-4600-b4aa-39e46487ab7c tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Acquiring lock "8a6a74bc-2e97-4248-8b82-abb54ff4cc83" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2e1855b9-a477-4600-b4aa-39e46487ab7c tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Lock "8a6a74bc-2e97-4248-8b82-abb54ff4cc83" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2e1855b9-a477-4600-b4aa-39e46487ab7c tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Acquiring lock "8a6a74bc-2e97-4248-8b82-abb54ff4cc83-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2e1855b9-a477-4600-b4aa-39e46487ab7c tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Lock "8a6a74bc-2e97-4248-8b82-abb54ff4cc83-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2e1855b9-a477-4600-b4aa-39e46487ab7c tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Lock "8a6a74bc-2e97-4248-8b82-abb54ff4cc83-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:02 user nova-compute[72809]: INFO nova.compute.manager [None req-2e1855b9-a477-4600-b4aa-39e46487ab7c tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Terminating instance
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.compute.manager [None req-2e1855b9-a477-4600-b4aa-39e46487ab7c tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.network.neutron [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Successfully updated port: b94aa917-6963-4aee-9bc2-15b2720191be {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "refresh_cache-aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquired lock "refresh_cache-aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.network.neutron [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.compute.manager [req-d675a22d-3033-47b4-8927-27150263e822 req-903d1f54-2468-445f-ae7b-03a0285d6549 service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Received event network-changed-b94aa917-6963-4aee-9bc2-15b2720191be {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.compute.manager [req-d675a22d-3033-47b4-8927-27150263e822 req-903d1f54-2468-445f-ae7b-03a0285d6549 service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Refreshing instance network info cache due to event network-changed-b94aa917-6963-4aee-9bc2-15b2720191be. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d675a22d-3033-47b4-8927-27150263e822 req-903d1f54-2468-445f-ae7b-03a0285d6549 service nova] Acquiring lock "refresh_cache-aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.network.neutron [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.compute.manager [req-67d19ff3-0fcc-4d49-93a5-94ae3223e1cc req-4ca82f04-8980-462b-9b2a-5606f951266f service nova] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Received event network-vif-unplugged-861ed195-01ae-4b1b-8a9f-3464eedeebdc {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-67d19ff3-0fcc-4d49-93a5-94ae3223e1cc req-4ca82f04-8980-462b-9b2a-5606f951266f service nova] Acquiring lock "8a6a74bc-2e97-4248-8b82-abb54ff4cc83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-67d19ff3-0fcc-4d49-93a5-94ae3223e1cc req-4ca82f04-8980-462b-9b2a-5606f951266f service nova] Lock "8a6a74bc-2e97-4248-8b82-abb54ff4cc83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-67d19ff3-0fcc-4d49-93a5-94ae3223e1cc req-4ca82f04-8980-462b-9b2a-5606f951266f service nova] Lock "8a6a74bc-2e97-4248-8b82-abb54ff4cc83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.compute.manager [req-67d19ff3-0fcc-4d49-93a5-94ae3223e1cc req-4ca82f04-8980-462b-9b2a-5606f951266f service nova] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] No waiting events found dispatching network-vif-unplugged-861ed195-01ae-4b1b-8a9f-3464eedeebdc {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.compute.manager [req-67d19ff3-0fcc-4d49-93a5-94ae3223e1cc req-4ca82f04-8980-462b-9b2a-5606f951266f service nova] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Received event network-vif-unplugged-861ed195-01ae-4b1b-8a9f-3464eedeebdc for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.network.neutron [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Updating instance_info_cache with network_info: [{"id": "b94aa917-6963-4aee-9bc2-15b2720191be", "address": "fa:16:3e:5c:5d:c2", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb94aa917-69", "ovs_interfaceid": "b94aa917-6963-4aee-9bc2-15b2720191be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Releasing lock "refresh_cache-aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.compute.manager [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Instance network_info: |[{"id": "b94aa917-6963-4aee-9bc2-15b2720191be", "address": "fa:16:3e:5c:5d:c2", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb94aa917-69", "ovs_interfaceid": "b94aa917-6963-4aee-9bc2-15b2720191be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d675a22d-3033-47b4-8927-27150263e822 req-903d1f54-2468-445f-ae7b-03a0285d6549 service nova] Acquired lock "refresh_cache-aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.network.neutron [req-d675a22d-3033-47b4-8927-27150263e822 req-903d1f54-2468-445f-ae7b-03a0285d6549 service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Refreshing network info cache for port b94aa917-6963-4aee-9bc2-15b2720191be {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Start _get_guest_xml network_info=[{"id": "b94aa917-6963-4aee-9bc2-15b2720191be", "address": "fa:16:3e:5c:5d:c2", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb94aa917-69", "ovs_interfaceid": "b94aa917-6963-4aee-9bc2-15b2720191be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:52:02 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:52:02 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:51:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-913717240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-913717240',id=12,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOO6sV+Qoal86qtcFU/3EObSR3TULxpC71/EBxvqmfNHUwrVBvM0F3kd7T3Glq1bk7tnZt3sMX+JOAHb7PEDhxWbR125C3wnEZH09gF2FMN71tfa4u3yaGKdWomhubcnMw==',key_name='tempest-keypair-38606939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ec36de19d984ff3a150db4fdd8ce327',ramdisk_id='',reservation_id='r-3i0wy02j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1006961404',owner_user_name='tempest-AttachVolumeShelveTestJSON-1006961404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:52:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e51e8a984c724efe966662c14b0dbffc',uuid=aec0a7ee-69e1-41cf-bfa8-5733bdedd70a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b94aa917-6963-4aee-9bc2-15b2720191be", "address": "fa:16:3e:5c:5d:c2", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb94aa917-69", "ovs_interfaceid": "b94aa917-6963-4aee-9bc2-15b2720191be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Converting VIF {"id": "b94aa917-6963-4aee-9bc2-15b2720191be", "address": "fa:16:3e:5c:5d:c2", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb94aa917-69", "ovs_interfaceid": "b94aa917-6963-4aee-9bc2-15b2720191be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:5d:c2,bridge_name='br-int',has_traffic_filtering=True,id=b94aa917-6963-4aee-9bc2-15b2720191be,network=Network(39277410-6754-4b40-b1bc-9777841910ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb94aa917-69') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.objects.instance [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lazy-loading 'pci_devices' on Instance uuid aec0a7ee-69e1-41cf-bfa8-5733bdedd70a {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.network.neutron [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Successfully updated port: 7e6d0833-c258-4fec-bd3d-37233d8cc699 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.compute.manager [req-8c5ee810-1718-4221-b875-043cb4da7d23 req-b6e807d3-a387-4b33-9a7a-67baa7f13440 service nova] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Received event network-changed-7e6d0833-c258-4fec-bd3d-37233d8cc699 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.compute.manager [req-8c5ee810-1718-4221-b875-043cb4da7d23 req-b6e807d3-a387-4b33-9a7a-67baa7f13440 service nova] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Refreshing instance network info cache due to event network-changed-7e6d0833-c258-4fec-bd3d-37233d8cc699. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-8c5ee810-1718-4221-b875-043cb4da7d23 req-b6e807d3-a387-4b33-9a7a-67baa7f13440 service nova] Acquiring lock "refresh_cache-5fb24f48-e72d-4c52-ad10-aae7b37171db" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-8c5ee810-1718-4221-b875-043cb4da7d23 req-b6e807d3-a387-4b33-9a7a-67baa7f13440 service nova] Acquired lock "refresh_cache-5fb24f48-e72d-4c52-ad10-aae7b37171db" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.network.neutron [req-8c5ee810-1718-4221-b875-043cb4da7d23 req-b6e807d3-a387-4b33-9a7a-67baa7f13440 service nova] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Refreshing network info cache for port 7e6d0833-c258-4fec-bd3d-37233d8cc699 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:52:02 user nova-compute[72809]:   <uuid>aec0a7ee-69e1-41cf-bfa8-5733bdedd70a</uuid>
Aug 09 06:52:02 user nova-compute[72809]:   <name>instance-0000000c</name>
Aug 09 06:52:02 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:52:02 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:52:02 user nova-compute[72809]:   <metadata>
Aug 09 06:52:02 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:52:02 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:52:02 user nova-compute[72809]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-913717240</nova:name>
Aug 09 06:52:02 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:52:02</nova:creationTime>
Aug 09 06:52:02 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:52:02 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:52:02 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:52:02 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:52:02 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:52:02 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:52:02 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:52:02 user nova-compute[72809]:       <nova:owner>
Aug 09 06:52:02 user nova-compute[72809]:         <nova:user uuid="e51e8a984c724efe966662c14b0dbffc">tempest-AttachVolumeShelveTestJSON-1006961404-project-member</nova:user>
Aug 09 06:52:02 user nova-compute[72809]:         <nova:project uuid="0ec36de19d984ff3a150db4fdd8ce327">tempest-AttachVolumeShelveTestJSON-1006961404</nova:project>
Aug 09 06:52:02 user nova-compute[72809]:       </nova:owner>
Aug 09 06:52:02 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:52:02 user nova-compute[72809]:       <nova:ports>
Aug 09 06:52:02 user nova-compute[72809]:         <nova:port uuid="b94aa917-6963-4aee-9bc2-15b2720191be">
Aug 09 06:52:02 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 06:52:02 user nova-compute[72809]:         </nova:port>
Aug 09 06:52:02 user nova-compute[72809]:       </nova:ports>
Aug 09 06:52:02 user nova-compute[72809]:     </nova:instance>
Aug 09 06:52:02 user nova-compute[72809]:   </metadata>
Aug 09 06:52:02 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:52:02 user nova-compute[72809]:     <system>
Aug 09 06:52:02 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:52:02 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:52:02 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:52:02 user nova-compute[72809]:       <entry name="serial">aec0a7ee-69e1-41cf-bfa8-5733bdedd70a</entry>
Aug 09 06:52:02 user nova-compute[72809]:       <entry name="uuid">aec0a7ee-69e1-41cf-bfa8-5733bdedd70a</entry>
Aug 09 06:52:02 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:52:02 user nova-compute[72809]:     </system>
Aug 09 06:52:02 user nova-compute[72809]:   </sysinfo>
Aug 09 06:52:02 user nova-compute[72809]:   <os>
Aug 09 06:52:02 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:52:02 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 06:52:02 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:52:02 user nova-compute[72809]:   </os>
Aug 09 06:52:02 user nova-compute[72809]:   <features>
Aug 09 06:52:02 user nova-compute[72809]:     <acpi/>
Aug 09 06:52:02 user nova-compute[72809]:     <apic/>
Aug 09 06:52:02 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:52:02 user nova-compute[72809]:   </features>
Aug 09 06:52:02 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:52:02 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:52:02 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:52:02 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:52:02 user nova-compute[72809]:   </clock>
Aug 09 06:52:02 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:52:02 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:52:02 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:52:02 user nova-compute[72809]:   </cpu>
Aug 09 06:52:02 user nova-compute[72809]:   <devices>
Aug 09 06:52:02 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:52:02 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:52:02 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk"/>
Aug 09 06:52:02 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:52:02 user nova-compute[72809]:     </disk>
Aug 09 06:52:02 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:52:02 user nova-compute[72809]:       <mac address="fa:16:3e:5c:5d:c2"/>
Aug 09 06:52:02 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:52:02 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:52:02 user nova-compute[72809]:       <target dev="tapb94aa917-69"/>
Aug 09 06:52:02 user nova-compute[72809]:     </interface>
Aug 09 06:52:02 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:52:02 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/console.log" append="off"/>
Aug 09 06:52:02 user nova-compute[72809]:     </serial>
Aug 09 06:52:02 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:52:02 user nova-compute[72809]:     <video>
Aug 09 06:52:02 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:52:02 user nova-compute[72809]:     </video>
Aug 09 06:52:02 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:52:02 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:52:02 user nova-compute[72809]:     </rng>
Aug 09 06:52:02 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:52:02 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:52:02 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:52:02 user nova-compute[72809]:     </memballoon>
Aug 09 06:52:02 user nova-compute[72809]:   </devices>
Aug 09 06:52:02 user nova-compute[72809]: </domain>
Aug 09 06:52:02 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:51:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-913717240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-913717240',id=12,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOO6sV+Qoal86qtcFU/3EObSR3TULxpC71/EBxvqmfNHUwrVBvM0F3kd7T3Glq1bk7tnZt3sMX+JOAHb7PEDhxWbR125C3wnEZH09gF2FMN71tfa4u3yaGKdWomhubcnMw==',key_name='tempest-keypair-38606939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ec36de19d984ff3a150db4fdd8ce327',ramdisk_id='',reservation_id='r-3i0wy02j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1006961404',owner_user_name='tempest-AttachVolumeShelveTestJSON-1006961404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:52:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e51e8a984c724efe966662c14b0dbffc',uuid=aec0a7ee-69e1-41cf-bfa8-5733bdedd70a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b94aa917-6963-4aee-9bc2-15b2720191be", "address": "fa:16:3e:5c:5d:c2", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb94aa917-69", "ovs_interfaceid": "b94aa917-6963-4aee-9bc2-15b2720191be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Converting VIF {"id": "b94aa917-6963-4aee-9bc2-15b2720191be", "address": "fa:16:3e:5c:5d:c2", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb94aa917-69", "ovs_interfaceid": "b94aa917-6963-4aee-9bc2-15b2720191be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:5d:c2,bridge_name='br-int',has_traffic_filtering=True,id=b94aa917-6963-4aee-9bc2-15b2720191be,network=Network(39277410-6754-4b40-b1bc-9777841910ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb94aa917-69') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG os_vif [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:5d:c2,bridge_name='br-int',has_traffic_filtering=True,id=b94aa917-6963-4aee-9bc2-15b2720191be,network=Network(39277410-6754-4b40-b1bc-9777841910ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb94aa917-69') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Acquiring lock "refresh_cache-5fb24f48-e72d-4c52-ad10-aae7b37171db" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb94aa917-69, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb94aa917-69, col_values=(('external_ids', {'iface-id': 'b94aa917-6963-4aee-9bc2-15b2720191be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:5d:c2', 'vm-uuid': 'aec0a7ee-69e1-41cf-bfa8-5733bdedd70a'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:02 user nova-compute[72809]: INFO os_vif [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:5d:c2,bridge_name='br-int',has_traffic_filtering=True,id=b94aa917-6963-4aee-9bc2-15b2720191be,network=Network(39277410-6754-4b40-b1bc-9777841910ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb94aa917-69')
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.network.neutron [req-8c5ee810-1718-4221-b875-043cb4da7d23 req-b6e807d3-a387-4b33-9a7a-67baa7f13440 service nova] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691563907.9074824, f7c9bbfa-b588-4ea7-ada4-d7f806ab2381 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:52:02 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] VM Stopped (Lifecycle Event)
Aug 09 06:52:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.compute.manager [None req-3d418897-d91f-4dba-98fe-b3dd05ef17a0 None None] [instance: f7c9bbfa-b588-4ea7-ada4-d7f806ab2381] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:52:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] No VIF found with MAC fa:16:3e:5c:5d:c2, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.network.neutron [req-d675a22d-3033-47b4-8927-27150263e822 req-903d1f54-2468-445f-ae7b-03a0285d6549 service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Updated VIF entry in instance network info cache for port b94aa917-6963-4aee-9bc2-15b2720191be. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.network.neutron [req-d675a22d-3033-47b4-8927-27150263e822 req-903d1f54-2468-445f-ae7b-03a0285d6549 service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Updating instance_info_cache with network_info: [{"id": "b94aa917-6963-4aee-9bc2-15b2720191be", "address": "fa:16:3e:5c:5d:c2", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb94aa917-69", "ovs_interfaceid": "b94aa917-6963-4aee-9bc2-15b2720191be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d675a22d-3033-47b4-8927-27150263e822 req-903d1f54-2468-445f-ae7b-03a0285d6549 service nova] Releasing lock "refresh_cache-aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:52:03 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Instance destroyed successfully.
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.objects.instance [None req-2e1855b9-a477-4600-b4aa-39e46487ab7c tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Lazy-loading 'resources' on Instance uuid 8a6a74bc-2e97-4248-8b82-abb54ff4cc83 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-2e1855b9-a477-4600-b4aa-39e46487ab7c tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-99224691',display_name='tempest-VolumesAssistedSnapshotsTest-server-99224691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-99224691',id=7,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBITPUvg9PmOqFPQcU5B39uRQZj8MMHLuiXdNl4w3p9X5sbfYnnsqUEGWVWIaTfNvgbiCD7vXPNsCKlbYnb7vks44ObrX5Hg8sa6WYd4lSPWyZMI5AKf8MH6qobp4bjF6+A==',key_name='tempest-keypair-1282205847',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:49:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc95b0bf255f49819b4b85a1a0b09212',ramdisk_id='',reservation_id='r-f9hc8v8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-731789458',owner_user_name='tempest-VolumesAssistedSnapshotsTest-731789458-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:49:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1d878cb40fa4997a1d4393549157227',uuid=8a6a74bc-2e97-4248-8b82-abb54ff4cc83,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "861ed195-01ae-4b1b-8a9f-3464eedeebdc", "address": "fa:16:3e:b9:13:a6", "network": {"id": "32870d8a-a604-4a02-9d22-cb926d69718f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-190435513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc95b0bf255f49819b4b85a1a0b09212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap861ed195-01", "ovs_interfaceid": "861ed195-01ae-4b1b-8a9f-3464eedeebdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-2e1855b9-a477-4600-b4aa-39e46487ab7c tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Converting VIF {"id": "861ed195-01ae-4b1b-8a9f-3464eedeebdc", "address": "fa:16:3e:b9:13:a6", "network": {"id": "32870d8a-a604-4a02-9d22-cb926d69718f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-190435513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc95b0bf255f49819b4b85a1a0b09212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap861ed195-01", "ovs_interfaceid": "861ed195-01ae-4b1b-8a9f-3464eedeebdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-2e1855b9-a477-4600-b4aa-39e46487ab7c tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:13:a6,bridge_name='br-int',has_traffic_filtering=True,id=861ed195-01ae-4b1b-8a9f-3464eedeebdc,network=Network(32870d8a-a604-4a02-9d22-cb926d69718f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap861ed195-01') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG os_vif [None req-2e1855b9-a477-4600-b4aa-39e46487ab7c tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:13:a6,bridge_name='br-int',has_traffic_filtering=True,id=861ed195-01ae-4b1b-8a9f-3464eedeebdc,network=Network(32870d8a-a604-4a02-9d22-cb926d69718f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap861ed195-01') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap861ed195-01, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:03 user nova-compute[72809]: INFO os_vif [None req-2e1855b9-a477-4600-b4aa-39e46487ab7c tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:13:a6,bridge_name='br-int',has_traffic_filtering=True,id=861ed195-01ae-4b1b-8a9f-3464eedeebdc,network=Network(32870d8a-a604-4a02-9d22-cb926d69718f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap861ed195-01')
Aug 09 06:52:03 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-2e1855b9-a477-4600-b4aa-39e46487ab7c tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Deleting instance files /opt/stack/data/nova/instances/8a6a74bc-2e97-4248-8b82-abb54ff4cc83_del
Aug 09 06:52:03 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-2e1855b9-a477-4600-b4aa-39e46487ab7c tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Deletion of /opt/stack/data/nova/instances/8a6a74bc-2e97-4248-8b82-abb54ff4cc83_del complete
Aug 09 06:52:03 user nova-compute[72809]: INFO nova.compute.manager [None req-2e1855b9-a477-4600-b4aa-39e46487ab7c tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 09 06:52:03 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-2e1855b9-a477-4600-b4aa-39e46487ab7c tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.network.neutron [req-8c5ee810-1718-4221-b875-043cb4da7d23 req-b6e807d3-a387-4b33-9a7a-67baa7f13440 service nova] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-8c5ee810-1718-4221-b875-043cb4da7d23 req-b6e807d3-a387-4b33-9a7a-67baa7f13440 service nova] Releasing lock "refresh_cache-5fb24f48-e72d-4c52-ad10-aae7b37171db" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Acquired lock "refresh_cache-5fb24f48-e72d-4c52-ad10-aae7b37171db" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.network.neutron [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.network.neutron [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.network.neutron [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Updating instance_info_cache with network_info: [{"id": "7e6d0833-c258-4fec-bd3d-37233d8cc699", "address": "fa:16:3e:f0:1b:b0", "network": {"id": "9d98057f-37e6-42f0-9a94-2240979d38f4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-490582380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06d061b94c6548d88d8c3cae6751d937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6d0833-c2", "ovs_interfaceid": "7e6d0833-c258-4fec-bd3d-37233d8cc699", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Releasing lock "refresh_cache-5fb24f48-e72d-4c52-ad10-aae7b37171db" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.compute.manager [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Instance network_info: |[{"id": "7e6d0833-c258-4fec-bd3d-37233d8cc699", "address": "fa:16:3e:f0:1b:b0", "network": {"id": "9d98057f-37e6-42f0-9a94-2240979d38f4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-490582380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06d061b94c6548d88d8c3cae6751d937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6d0833-c2", "ovs_interfaceid": "7e6d0833-c258-4fec-bd3d-37233d8cc699", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Start _get_guest_xml network_info=[{"id": "7e6d0833-c258-4fec-bd3d-37233d8cc699", "address": "fa:16:3e:f0:1b:b0", "network": {"id": "9d98057f-37e6-42f0-9a94-2240979d38f4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-490582380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06d061b94c6548d88d8c3cae6751d937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6d0833-c2", "ovs_interfaceid": "7e6d0833-c258-4fec-bd3d-37233d8cc699", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:52:03 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:52:03 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:51:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-390080409',display_name='tempest-VolumesAdminNegativeTest-server-390080409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-390080409',id=13,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06d061b94c6548d88d8c3cae6751d937',ramdisk_id='',reservation_id='r-4z0zwoku',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2043800207',owner_user_name='tempest-VolumesAdminNegativeTest-2043800207-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:52:01Z,user_data=None,user_id='6cd5e6af221a4c0d996b4da1cce17f55',uuid=5fb24f48-e72d-4c52-ad10-aae7b37171db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e6d0833-c258-4fec-bd3d-37233d8cc699", "address": "fa:16:3e:f0:1b:b0", "network": {"id": "9d98057f-37e6-42f0-9a94-2240979d38f4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-490582380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06d061b94c6548d88d8c3cae6751d937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6d0833-c2", "ovs_interfaceid": "7e6d0833-c258-4fec-bd3d-37233d8cc699", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Converting VIF {"id": "7e6d0833-c258-4fec-bd3d-37233d8cc699", "address": "fa:16:3e:f0:1b:b0", "network": {"id": "9d98057f-37e6-42f0-9a94-2240979d38f4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-490582380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06d061b94c6548d88d8c3cae6751d937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6d0833-c2", "ovs_interfaceid": "7e6d0833-c258-4fec-bd3d-37233d8cc699", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:1b:b0,bridge_name='br-int',has_traffic_filtering=True,id=7e6d0833-c258-4fec-bd3d-37233d8cc699,network=Network(9d98057f-37e6-42f0-9a94-2240979d38f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6d0833-c2') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:52:03 user nova-compute[72809]: DEBUG nova.objects.instance [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lazy-loading 'pci_devices' on Instance uuid 5fb24f48-e72d-4c52-ad10-aae7b37171db {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:52:04 user nova-compute[72809]:   <uuid>5fb24f48-e72d-4c52-ad10-aae7b37171db</uuid>
Aug 09 06:52:04 user nova-compute[72809]:   <name>instance-0000000d</name>
Aug 09 06:52:04 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:52:04 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:52:04 user nova-compute[72809]:   <metadata>
Aug 09 06:52:04 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:52:04 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:52:04 user nova-compute[72809]:       <nova:name>tempest-VolumesAdminNegativeTest-server-390080409</nova:name>
Aug 09 06:52:04 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:52:03</nova:creationTime>
Aug 09 06:52:04 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:52:04 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:52:04 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:52:04 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:52:04 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:52:04 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:52:04 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:52:04 user nova-compute[72809]:       <nova:owner>
Aug 09 06:52:04 user nova-compute[72809]:         <nova:user uuid="6cd5e6af221a4c0d996b4da1cce17f55">tempest-VolumesAdminNegativeTest-2043800207-project-member</nova:user>
Aug 09 06:52:04 user nova-compute[72809]:         <nova:project uuid="06d061b94c6548d88d8c3cae6751d937">tempest-VolumesAdminNegativeTest-2043800207</nova:project>
Aug 09 06:52:04 user nova-compute[72809]:       </nova:owner>
Aug 09 06:52:04 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:52:04 user nova-compute[72809]:       <nova:ports>
Aug 09 06:52:04 user nova-compute[72809]:         <nova:port uuid="7e6d0833-c258-4fec-bd3d-37233d8cc699">
Aug 09 06:52:04 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 06:52:04 user nova-compute[72809]:         </nova:port>
Aug 09 06:52:04 user nova-compute[72809]:       </nova:ports>
Aug 09 06:52:04 user nova-compute[72809]:     </nova:instance>
Aug 09 06:52:04 user nova-compute[72809]:   </metadata>
Aug 09 06:52:04 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:52:04 user nova-compute[72809]:     <system>
Aug 09 06:52:04 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:52:04 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:52:04 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:52:04 user nova-compute[72809]:       <entry name="serial">5fb24f48-e72d-4c52-ad10-aae7b37171db</entry>
Aug 09 06:52:04 user nova-compute[72809]:       <entry name="uuid">5fb24f48-e72d-4c52-ad10-aae7b37171db</entry>
Aug 09 06:52:04 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:52:04 user nova-compute[72809]:     </system>
Aug 09 06:52:04 user nova-compute[72809]:   </sysinfo>
Aug 09 06:52:04 user nova-compute[72809]:   <os>
Aug 09 06:52:04 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:52:04 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 06:52:04 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:52:04 user nova-compute[72809]:   </os>
Aug 09 06:52:04 user nova-compute[72809]:   <features>
Aug 09 06:52:04 user nova-compute[72809]:     <acpi/>
Aug 09 06:52:04 user nova-compute[72809]:     <apic/>
Aug 09 06:52:04 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:52:04 user nova-compute[72809]:   </features>
Aug 09 06:52:04 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:52:04 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:52:04 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:52:04 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:52:04 user nova-compute[72809]:   </clock>
Aug 09 06:52:04 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:52:04 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:52:04 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:52:04 user nova-compute[72809]:   </cpu>
Aug 09 06:52:04 user nova-compute[72809]:   <devices>
Aug 09 06:52:04 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:52:04 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:52:04 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/5fb24f48-e72d-4c52-ad10-aae7b37171db/disk"/>
Aug 09 06:52:04 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:52:04 user nova-compute[72809]:     </disk>
Aug 09 06:52:04 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:52:04 user nova-compute[72809]:       <mac address="fa:16:3e:f0:1b:b0"/>
Aug 09 06:52:04 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:52:04 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:52:04 user nova-compute[72809]:       <target dev="tap7e6d0833-c2"/>
Aug 09 06:52:04 user nova-compute[72809]:     </interface>
Aug 09 06:52:04 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:52:04 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/5fb24f48-e72d-4c52-ad10-aae7b37171db/console.log" append="off"/>
Aug 09 06:52:04 user nova-compute[72809]:     </serial>
Aug 09 06:52:04 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:52:04 user nova-compute[72809]:     <video>
Aug 09 06:52:04 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:52:04 user nova-compute[72809]:     </video>
Aug 09 06:52:04 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:52:04 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:52:04 user nova-compute[72809]:     </rng>
Aug 09 06:52:04 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:52:04 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:52:04 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:52:04 user nova-compute[72809]:     </memballoon>
Aug 09 06:52:04 user nova-compute[72809]:   </devices>
Aug 09 06:52:04 user nova-compute[72809]: </domain>
Aug 09 06:52:04 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:51:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-390080409',display_name='tempest-VolumesAdminNegativeTest-server-390080409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-390080409',id=13,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06d061b94c6548d88d8c3cae6751d937',ramdisk_id='',reservation_id='r-4z0zwoku',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2043800207',owner_user_name='tempest-VolumesAdminNegativeTest-2043800207-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:52:01Z,user_data=None,user_id='6cd5e6af221a4c0d996b4da1cce17f55',uuid=5fb24f48-e72d-4c52-ad10-aae7b37171db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e6d0833-c258-4fec-bd3d-37233d8cc699", "address": "fa:16:3e:f0:1b:b0", "network": {"id": "9d98057f-37e6-42f0-9a94-2240979d38f4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-490582380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06d061b94c6548d88d8c3cae6751d937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6d0833-c2", "ovs_interfaceid": "7e6d0833-c258-4fec-bd3d-37233d8cc699", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Converting VIF {"id": "7e6d0833-c258-4fec-bd3d-37233d8cc699", "address": "fa:16:3e:f0:1b:b0", "network": {"id": "9d98057f-37e6-42f0-9a94-2240979d38f4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-490582380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06d061b94c6548d88d8c3cae6751d937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6d0833-c2", "ovs_interfaceid": "7e6d0833-c258-4fec-bd3d-37233d8cc699", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:1b:b0,bridge_name='br-int',has_traffic_filtering=True,id=7e6d0833-c258-4fec-bd3d-37233d8cc699,network=Network(9d98057f-37e6-42f0-9a94-2240979d38f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6d0833-c2') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG os_vif [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:1b:b0,bridge_name='br-int',has_traffic_filtering=True,id=7e6d0833-c258-4fec-bd3d-37233d8cc699,network=Network(9d98057f-37e6-42f0-9a94-2240979d38f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6d0833-c2') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e6d0833-c2, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e6d0833-c2, col_values=(('external_ids', {'iface-id': '7e6d0833-c258-4fec-bd3d-37233d8cc699', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:1b:b0', 'vm-uuid': '5fb24f48-e72d-4c52-ad10-aae7b37171db'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:04 user nova-compute[72809]: INFO os_vif [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:1b:b0,bridge_name='br-int',has_traffic_filtering=True,id=7e6d0833-c258-4fec-bd3d-37233d8cc699,network=Network(9d98057f-37e6-42f0-9a94-2240979d38f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6d0833-c2')
Aug 09 06:52:04 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] No VIF found with MAC fa:16:3e:f0:1b:b0, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:52:04 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Took 1.08 seconds to deallocate network for instance.
Aug 09 06:52:04 user nova-compute[72809]: DEBUG nova.compute.manager [req-c55cf2f4-4b4a-4772-8a8e-460c89b3f266 req-e8ebe5f4-55d7-4075-9cfe-cae3c89febc7 service nova] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Received event network-vif-deleted-861ed195-01ae-4b1b-8a9f-3464eedeebdc {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2e1855b9-a477-4600-b4aa-39e46487ab7c tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2e1855b9-a477-4600-b4aa-39e46487ab7c tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG nova.compute.manager [req-d66afdc6-3e77-4d4f-b7c6-c2c219a78335 req-989f9c92-1dc0-4d5f-afde-fb7aad4ec93a service nova] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Received event network-vif-plugged-861ed195-01ae-4b1b-8a9f-3464eedeebdc {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d66afdc6-3e77-4d4f-b7c6-c2c219a78335 req-989f9c92-1dc0-4d5f-afde-fb7aad4ec93a service nova] Acquiring lock "8a6a74bc-2e97-4248-8b82-abb54ff4cc83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d66afdc6-3e77-4d4f-b7c6-c2c219a78335 req-989f9c92-1dc0-4d5f-afde-fb7aad4ec93a service nova] Lock "8a6a74bc-2e97-4248-8b82-abb54ff4cc83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d66afdc6-3e77-4d4f-b7c6-c2c219a78335 req-989f9c92-1dc0-4d5f-afde-fb7aad4ec93a service nova] Lock "8a6a74bc-2e97-4248-8b82-abb54ff4cc83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG nova.compute.manager [req-d66afdc6-3e77-4d4f-b7c6-c2c219a78335 req-989f9c92-1dc0-4d5f-afde-fb7aad4ec93a service nova] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] No waiting events found dispatching network-vif-plugged-861ed195-01ae-4b1b-8a9f-3464eedeebdc {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:52:04 user nova-compute[72809]: WARNING nova.compute.manager [req-d66afdc6-3e77-4d4f-b7c6-c2c219a78335 req-989f9c92-1dc0-4d5f-afde-fb7aad4ec93a service nova] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Received unexpected event network-vif-plugged-861ed195-01ae-4b1b-8a9f-3464eedeebdc for instance with vm_state deleted and task_state None.
Aug 09 06:52:04 user nova-compute[72809]: DEBUG nova.compute.manager [req-fd09e747-c56e-498d-9137-b026f79552ae req-bda06141-dad2-4c19-bd3a-e2403bdc9753 service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Received event network-vif-plugged-b94aa917-6963-4aee-9bc2-15b2720191be {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-fd09e747-c56e-498d-9137-b026f79552ae req-bda06141-dad2-4c19-bd3a-e2403bdc9753 service nova] Acquiring lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-fd09e747-c56e-498d-9137-b026f79552ae req-bda06141-dad2-4c19-bd3a-e2403bdc9753 service nova] Lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-fd09e747-c56e-498d-9137-b026f79552ae req-bda06141-dad2-4c19-bd3a-e2403bdc9753 service nova] Lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG nova.compute.manager [req-fd09e747-c56e-498d-9137-b026f79552ae req-bda06141-dad2-4c19-bd3a-e2403bdc9753 service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] No waiting events found dispatching network-vif-plugged-b94aa917-6963-4aee-9bc2-15b2720191be {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:52:04 user nova-compute[72809]: WARNING nova.compute.manager [req-fd09e747-c56e-498d-9137-b026f79552ae req-bda06141-dad2-4c19-bd3a-e2403bdc9753 service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Received unexpected event network-vif-plugged-b94aa917-6963-4aee-9bc2-15b2720191be for instance with vm_state building and task_state spawning.
Aug 09 06:52:04 user nova-compute[72809]: DEBUG nova.compute.manager [req-fd09e747-c56e-498d-9137-b026f79552ae req-bda06141-dad2-4c19-bd3a-e2403bdc9753 service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Received event network-vif-plugged-b94aa917-6963-4aee-9bc2-15b2720191be {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-fd09e747-c56e-498d-9137-b026f79552ae req-bda06141-dad2-4c19-bd3a-e2403bdc9753 service nova] Acquiring lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-fd09e747-c56e-498d-9137-b026f79552ae req-bda06141-dad2-4c19-bd3a-e2403bdc9753 service nova] Lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-fd09e747-c56e-498d-9137-b026f79552ae req-bda06141-dad2-4c19-bd3a-e2403bdc9753 service nova] Lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG nova.compute.manager [req-fd09e747-c56e-498d-9137-b026f79552ae req-bda06141-dad2-4c19-bd3a-e2403bdc9753 service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] No waiting events found dispatching network-vif-plugged-b94aa917-6963-4aee-9bc2-15b2720191be {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:52:04 user nova-compute[72809]: WARNING nova.compute.manager [req-fd09e747-c56e-498d-9137-b026f79552ae req-bda06141-dad2-4c19-bd3a-e2403bdc9753 service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Received unexpected event network-vif-plugged-b94aa917-6963-4aee-9bc2-15b2720191be for instance with vm_state building and task_state spawning.
Aug 09 06:52:04 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-2e1855b9-a477-4600-b4aa-39e46487ab7c tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-2e1855b9-a477-4600-b4aa-39e46487ab7c tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2e1855b9-a477-4600-b4aa-39e46487ab7c tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:04 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-2e1855b9-a477-4600-b4aa-39e46487ab7c tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Deleted allocations for instance 8a6a74bc-2e97-4248-8b82-abb54ff4cc83
Aug 09 06:52:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2e1855b9-a477-4600-b4aa-39e46487ab7c tempest-VolumesAssistedSnapshotsTest-731789458 tempest-VolumesAssistedSnapshotsTest-731789458-project-member] Lock "8a6a74bc-2e97-4248-8b82-abb54ff4cc83" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.809s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:06 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:06 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:06 user nova-compute[72809]: DEBUG nova.compute.manager [req-54e1c0da-5ac4-4af3-9e16-075c02054f04 req-1ded390b-9001-4ae1-8333-ebcb580c538a service nova] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Received event network-vif-plugged-7e6d0833-c258-4fec-bd3d-37233d8cc699 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:52:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-54e1c0da-5ac4-4af3-9e16-075c02054f04 req-1ded390b-9001-4ae1-8333-ebcb580c538a service nova] Acquiring lock "5fb24f48-e72d-4c52-ad10-aae7b37171db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-54e1c0da-5ac4-4af3-9e16-075c02054f04 req-1ded390b-9001-4ae1-8333-ebcb580c538a service nova] Lock "5fb24f48-e72d-4c52-ad10-aae7b37171db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-54e1c0da-5ac4-4af3-9e16-075c02054f04 req-1ded390b-9001-4ae1-8333-ebcb580c538a service nova] Lock "5fb24f48-e72d-4c52-ad10-aae7b37171db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:06 user nova-compute[72809]: DEBUG nova.compute.manager [req-54e1c0da-5ac4-4af3-9e16-075c02054f04 req-1ded390b-9001-4ae1-8333-ebcb580c538a service nova] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] No waiting events found dispatching network-vif-plugged-7e6d0833-c258-4fec-bd3d-37233d8cc699 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:52:06 user nova-compute[72809]: WARNING nova.compute.manager [req-54e1c0da-5ac4-4af3-9e16-075c02054f04 req-1ded390b-9001-4ae1-8333-ebcb580c538a service nova] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Received unexpected event network-vif-plugged-7e6d0833-c258-4fec-bd3d-37233d8cc699 for instance with vm_state building and task_state spawning.
Aug 09 06:52:06 user nova-compute[72809]: DEBUG nova.compute.manager [req-54e1c0da-5ac4-4af3-9e16-075c02054f04 req-1ded390b-9001-4ae1-8333-ebcb580c538a service nova] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Received event network-vif-plugged-7e6d0833-c258-4fec-bd3d-37233d8cc699 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:52:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-54e1c0da-5ac4-4af3-9e16-075c02054f04 req-1ded390b-9001-4ae1-8333-ebcb580c538a service nova] Acquiring lock "5fb24f48-e72d-4c52-ad10-aae7b37171db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-54e1c0da-5ac4-4af3-9e16-075c02054f04 req-1ded390b-9001-4ae1-8333-ebcb580c538a service nova] Lock "5fb24f48-e72d-4c52-ad10-aae7b37171db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-54e1c0da-5ac4-4af3-9e16-075c02054f04 req-1ded390b-9001-4ae1-8333-ebcb580c538a service nova] Lock "5fb24f48-e72d-4c52-ad10-aae7b37171db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:06 user nova-compute[72809]: DEBUG nova.compute.manager [req-54e1c0da-5ac4-4af3-9e16-075c02054f04 req-1ded390b-9001-4ae1-8333-ebcb580c538a service nova] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] No waiting events found dispatching network-vif-plugged-7e6d0833-c258-4fec-bd3d-37233d8cc699 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:52:06 user nova-compute[72809]: WARNING nova.compute.manager [req-54e1c0da-5ac4-4af3-9e16-075c02054f04 req-1ded390b-9001-4ae1-8333-ebcb580c538a service nova] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Received unexpected event network-vif-plugged-7e6d0833-c258-4fec-bd3d-37233d8cc699 for instance with vm_state building and task_state spawning.
Aug 09 06:52:07 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563927.582625, aec0a7ee-69e1-41cf-bfa8-5733bdedd70a => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:52:07 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] VM Resumed (Lifecycle Event)
Aug 09 06:52:07 user nova-compute[72809]: DEBUG nova.compute.manager [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:52:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 06:52:07 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Instance spawned successfully.
Aug 09 06:52:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 06:52:07 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:52:07 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:52:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:52:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:52:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:52:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:52:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:52:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:52:07 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:52:07 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563927.5880764, aec0a7ee-69e1-41cf-bfa8-5733bdedd70a => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:52:07 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] VM Started (Lifecycle Event)
Aug 09 06:52:07 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:52:07 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:52:07 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:52:07 user nova-compute[72809]: INFO nova.compute.manager [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Took 6.96 seconds to spawn the instance on the hypervisor.
Aug 09 06:52:07 user nova-compute[72809]: DEBUG nova.compute.manager [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:52:07 user nova-compute[72809]: INFO nova.compute.manager [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Took 7.70 seconds to build instance.
Aug 09 06:52:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-63384a32-b5f1-430a-8a05-d2e8fe5bafeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.796s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:08 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563928.0200481, 5fb24f48-e72d-4c52-ad10-aae7b37171db => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:52:08 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] VM Resumed (Lifecycle Event)
Aug 09 06:52:08 user nova-compute[72809]: DEBUG nova.compute.manager [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:52:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 06:52:08 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Instance spawned successfully.
Aug 09 06:52:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 06:52:08 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:52:08 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:52:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:52:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:52:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:52:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:52:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:52:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:52:08 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:52:08 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563928.0213215, 5fb24f48-e72d-4c52-ad10-aae7b37171db => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:52:08 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] VM Started (Lifecycle Event)
Aug 09 06:52:08 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:52:08 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:52:08 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:52:08 user nova-compute[72809]: INFO nova.compute.manager [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Took 6.80 seconds to spawn the instance on the hypervisor.
Aug 09 06:52:08 user nova-compute[72809]: DEBUG nova.compute.manager [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:52:08 user nova-compute[72809]: INFO nova.compute.manager [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Took 7.76 seconds to build instance.
Aug 09 06:52:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-83784ed9-7a43-4e2e-8988-0d54837a6b03 tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "5fb24f48-e72d-4c52-ad10-aae7b37171db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.858s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d05d7d34-d97b-487d-bf72-67b9ae24a4c6 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Acquiring lock "b1d6a12a-ecb9-4008-bf1b-28b2165dca99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d05d7d34-d97b-487d-bf72-67b9ae24a4c6 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lock "b1d6a12a-ecb9-4008-bf1b-28b2165dca99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d05d7d34-d97b-487d-bf72-67b9ae24a4c6 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Acquiring lock "b1d6a12a-ecb9-4008-bf1b-28b2165dca99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d05d7d34-d97b-487d-bf72-67b9ae24a4c6 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lock "b1d6a12a-ecb9-4008-bf1b-28b2165dca99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d05d7d34-d97b-487d-bf72-67b9ae24a4c6 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lock "b1d6a12a-ecb9-4008-bf1b-28b2165dca99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:11 user nova-compute[72809]: INFO nova.compute.manager [None req-d05d7d34-d97b-487d-bf72-67b9ae24a4c6 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Terminating instance
Aug 09 06:52:11 user nova-compute[72809]: DEBUG nova.compute.manager [None req-d05d7d34-d97b-487d-bf72-67b9ae24a4c6 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 06:52:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:12 user nova-compute[72809]: DEBUG nova.compute.manager [req-b60386e2-6ba6-4e46-a4d2-4ab71caa75b1 req-46c5d272-3743-4579-93f4-29253b54eaa3 service nova] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Received event network-vif-unplugged-1f55eca0-6fea-4eed-a90a-1cd7e9769d68 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:52:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b60386e2-6ba6-4e46-a4d2-4ab71caa75b1 req-46c5d272-3743-4579-93f4-29253b54eaa3 service nova] Acquiring lock "b1d6a12a-ecb9-4008-bf1b-28b2165dca99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b60386e2-6ba6-4e46-a4d2-4ab71caa75b1 req-46c5d272-3743-4579-93f4-29253b54eaa3 service nova] Lock "b1d6a12a-ecb9-4008-bf1b-28b2165dca99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b60386e2-6ba6-4e46-a4d2-4ab71caa75b1 req-46c5d272-3743-4579-93f4-29253b54eaa3 service nova] Lock "b1d6a12a-ecb9-4008-bf1b-28b2165dca99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:12 user nova-compute[72809]: DEBUG nova.compute.manager [req-b60386e2-6ba6-4e46-a4d2-4ab71caa75b1 req-46c5d272-3743-4579-93f4-29253b54eaa3 service nova] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] No waiting events found dispatching network-vif-unplugged-1f55eca0-6fea-4eed-a90a-1cd7e9769d68 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:52:12 user nova-compute[72809]: DEBUG nova.compute.manager [req-b60386e2-6ba6-4e46-a4d2-4ab71caa75b1 req-46c5d272-3743-4579-93f4-29253b54eaa3 service nova] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Received event network-vif-unplugged-1f55eca0-6fea-4eed-a90a-1cd7e9769d68 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 06:52:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:13 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Instance destroyed successfully.
Aug 09 06:52:13 user nova-compute[72809]: DEBUG nova.objects.instance [None req-d05d7d34-d97b-487d-bf72-67b9ae24a4c6 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lazy-loading 'resources' on Instance uuid b1d6a12a-ecb9-4008-bf1b-28b2165dca99 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:52:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-d05d7d34-d97b-487d-bf72-67b9ae24a4c6 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:50:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1074572864',display_name='tempest-VolumesActionsTest-instance-1074572864',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1074572864',id=11,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:50:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7448d7b10a924d5cbd60f6276224a8cc',ramdisk_id='',reservation_id='r-1ptvt11l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-812095692',owner_user_name='tempest-VolumesActionsTest-812095692-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:50:28Z,user_data=None,user_id='4f0a431477454b8aa0006b5d06cd53b2',uuid=b1d6a12a-ecb9-4008-bf1b-28b2165dca99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f55eca0-6fea-4eed-a90a-1cd7e9769d68", "address": "fa:16:3e:b1:e7:6f", "network": {"id": "66bd3e40-f19b-4145-baaf-8eab9760324a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1038504284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7448d7b10a924d5cbd60f6276224a8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f55eca0-6f", "ovs_interfaceid": "1f55eca0-6fea-4eed-a90a-1cd7e9769d68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:52:13 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-d05d7d34-d97b-487d-bf72-67b9ae24a4c6 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Converting VIF {"id": "1f55eca0-6fea-4eed-a90a-1cd7e9769d68", "address": "fa:16:3e:b1:e7:6f", "network": {"id": "66bd3e40-f19b-4145-baaf-8eab9760324a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1038504284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7448d7b10a924d5cbd60f6276224a8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f55eca0-6f", "ovs_interfaceid": "1f55eca0-6fea-4eed-a90a-1cd7e9769d68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:52:13 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-d05d7d34-d97b-487d-bf72-67b9ae24a4c6 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:e7:6f,bridge_name='br-int',has_traffic_filtering=True,id=1f55eca0-6fea-4eed-a90a-1cd7e9769d68,network=Network(66bd3e40-f19b-4145-baaf-8eab9760324a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f55eca0-6f') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:52:13 user nova-compute[72809]: DEBUG os_vif [None req-d05d7d34-d97b-487d-bf72-67b9ae24a4c6 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:e7:6f,bridge_name='br-int',has_traffic_filtering=True,id=1f55eca0-6fea-4eed-a90a-1cd7e9769d68,network=Network(66bd3e40-f19b-4145-baaf-8eab9760324a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f55eca0-6f') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:52:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f55eca0-6f, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:52:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:52:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:13 user nova-compute[72809]: INFO os_vif [None req-d05d7d34-d97b-487d-bf72-67b9ae24a4c6 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:e7:6f,bridge_name='br-int',has_traffic_filtering=True,id=1f55eca0-6fea-4eed-a90a-1cd7e9769d68,network=Network(66bd3e40-f19b-4145-baaf-8eab9760324a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f55eca0-6f')
Aug 09 06:52:13 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-d05d7d34-d97b-487d-bf72-67b9ae24a4c6 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Deleting instance files /opt/stack/data/nova/instances/b1d6a12a-ecb9-4008-bf1b-28b2165dca99_del
Aug 09 06:52:13 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-d05d7d34-d97b-487d-bf72-67b9ae24a4c6 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Deletion of /opt/stack/data/nova/instances/b1d6a12a-ecb9-4008-bf1b-28b2165dca99_del complete
Aug 09 06:52:13 user nova-compute[72809]: INFO nova.compute.manager [None req-d05d7d34-d97b-487d-bf72-67b9ae24a4c6 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 09 06:52:13 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-d05d7d34-d97b-487d-bf72-67b9ae24a4c6 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 06:52:13 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 06:52:13 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 06:52:13 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:52:13 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Took 0.69 seconds to deallocate network for instance.
Aug 09 06:52:13 user nova-compute[72809]: DEBUG nova.compute.manager [req-a62ea589-8996-43b6-a72e-c6430a196949 req-922be43b-7944-40e4-aee4-f8685232e6f9 service nova] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Received event network-vif-deleted-1f55eca0-6fea-4eed-a90a-1cd7e9769d68 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:52:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d05d7d34-d97b-487d-bf72-67b9ae24a4c6 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d05d7d34-d97b-487d-bf72-67b9ae24a4c6 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:14 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-d05d7d34-d97b-487d-bf72-67b9ae24a4c6 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:52:14 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-d05d7d34-d97b-487d-bf72-67b9ae24a4c6 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:52:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d05d7d34-d97b-487d-bf72-67b9ae24a4c6 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:14 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-d05d7d34-d97b-487d-bf72-67b9ae24a4c6 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Deleted allocations for instance b1d6a12a-ecb9-4008-bf1b-28b2165dca99
Aug 09 06:52:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d05d7d34-d97b-487d-bf72-67b9ae24a4c6 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lock "b1d6a12a-ecb9-4008-bf1b-28b2165dca99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.456s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:14 user nova-compute[72809]: DEBUG nova.compute.manager [req-ba68b756-4888-4a7a-89bf-4628831f0127 req-47069954-2d33-48b0-a16b-305907d63212 service nova] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Received event network-vif-plugged-1f55eca0-6fea-4eed-a90a-1cd7e9769d68 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:52:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ba68b756-4888-4a7a-89bf-4628831f0127 req-47069954-2d33-48b0-a16b-305907d63212 service nova] Acquiring lock "b1d6a12a-ecb9-4008-bf1b-28b2165dca99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ba68b756-4888-4a7a-89bf-4628831f0127 req-47069954-2d33-48b0-a16b-305907d63212 service nova] Lock "b1d6a12a-ecb9-4008-bf1b-28b2165dca99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ba68b756-4888-4a7a-89bf-4628831f0127 req-47069954-2d33-48b0-a16b-305907d63212 service nova] Lock "b1d6a12a-ecb9-4008-bf1b-28b2165dca99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:14 user nova-compute[72809]: DEBUG nova.compute.manager [req-ba68b756-4888-4a7a-89bf-4628831f0127 req-47069954-2d33-48b0-a16b-305907d63212 service nova] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] No waiting events found dispatching network-vif-plugged-1f55eca0-6fea-4eed-a90a-1cd7e9769d68 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:52:14 user nova-compute[72809]: WARNING nova.compute.manager [req-ba68b756-4888-4a7a-89bf-4628831f0127 req-47069954-2d33-48b0-a16b-305907d63212 service nova] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Received unexpected event network-vif-plugged-1f55eca0-6fea-4eed-a90a-1cd7e9769d68 for instance with vm_state deleted and task_state None.
Aug 09 06:52:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:18 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691563923.2667496, 8a6a74bc-2e97-4248-8b82-abb54ff4cc83 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:52:18 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] VM Stopped (Lifecycle Event)
Aug 09 06:52:18 user nova-compute[72809]: DEBUG nova.compute.manager [None req-b39f5ccc-7f67-429f-bb95-a784330a396e None None] [instance: 8a6a74bc-2e97-4248-8b82-abb54ff4cc83] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:52:20 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Acquiring lock "3640991e-8a5b-4674-af81-3117d4269a68" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "3640991e-8a5b-4674-af81-3117d4269a68" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:21 user nova-compute[72809]: DEBUG nova.objects.instance [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lazy-loading 'flavor' on Instance uuid 3640991e-8a5b-4674-af81-3117d4269a68 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:52:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "3640991e-8a5b-4674-af81-3117d4269a68" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Acquiring lock "3640991e-8a5b-4674-af81-3117d4269a68" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "3640991e-8a5b-4674-af81-3117d4269a68" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:22 user nova-compute[72809]: INFO nova.compute.manager [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Attaching volume d187a33a-16e4-421a-890e-be960e85387d to /dev/vdb
Aug 09 06:52:22 user nova-compute[72809]: DEBUG os_brick.utils [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:52:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:22 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[909335c5-426b-4831-9dae-c2117266b611]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:22 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c6720f-7a0c-437d-b045-68e01fb31cd5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:22 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa10560a-742e-4de7-91be-5cdaff005be6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:22 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07618e0-8841-47ea-851a-6248e029d5d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:52:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 06:52:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:52:22 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 06:52:22 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[62dba194-04b0-4a45-bb29-5386a6502e14]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 06:52:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 06:52:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 06:52:22 user nova-compute[72809]: DEBUG os_brick.utils [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:52:22 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Updating existing volume attachment record: e7de4bfe-02ac-41fe-80c4-6771924e50ba {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 06:52:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:24 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:52:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquiring lock "15dda080-3487-4316-ab7b-f7185f0a4519" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "15dda080-3487-4316-ab7b-f7185f0a4519" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:26 user nova-compute[72809]: DEBUG nova.objects.instance [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lazy-loading 'flavor' on Instance uuid 15dda080-3487-4316-ab7b-f7185f0a4519 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:52:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "15dda080-3487-4316-ab7b-f7185f0a4519" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:26 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:52:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:26 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 06:52:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquiring lock "15dda080-3487-4316-ab7b-f7185f0a4519" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "15dda080-3487-4316-ab7b-f7185f0a4519" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:27 user nova-compute[72809]: INFO nova.compute.manager [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Attaching volume 521a87a6-3612-4fe2-ba75-ffa77601e8bf to /dev/vdb
Aug 09 06:52:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG os_brick.utils [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0722fa-707b-43c2-84dc-d0dc106abaa8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[da135a12-b995-44ec-a623-12a9f9d43bdc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[280c5e86-52c0-451e-a035-b06ca6b73ab6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[18deee45-0d3c-405f-a78f-f412112df859]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:52:27 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 06:52:27 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6101b2f6-ebd8-47fd-86f7-2e88e1be8db3]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG os_brick.utils [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Updating existing volume attachment record: 52852fbb-d743-44f1-b508-15416b321856 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 06:52:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:28 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691563933.035231, b1d6a12a-ecb9-4008-bf1b-28b2165dca99 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:52:28 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] VM Stopped (Lifecycle Event)
Aug 09 06:52:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:28 user nova-compute[72809]: DEBUG nova.compute.manager [None req-8f677b9a-5f32-43d1-832b-13cc634bafde None None] [instance: b1d6a12a-ecb9-4008-bf1b-28b2165dca99] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:52:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb24f48-e72d-4c52-ad10-aae7b37171db/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb24f48-e72d-4c52-ad10-aae7b37171db/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb24f48-e72d-4c52-ad10-aae7b37171db/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb24f48-e72d-4c52-ad10-aae7b37171db/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:29 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:52:29 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:52:29 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=7840MB free_disk=25.624244689941406GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 06:52:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:30 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 24ba9b41-d0bf-4a84-9f04-bfda9525b154 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:52:30 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 3640991e-8a5b-4674-af81-3117d4269a68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:52:30 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 15dda080-3487-4316-ab7b-f7185f0a4519 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:52:30 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance b9b69c9e-f91d-4681-a53b-2f0fc4b13532 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:52:30 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance b64e7169-044c-4d0a-9ee5-f2914f1f5529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:52:30 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance aec0a7ee-69e1-41cf-bfa8-5733bdedd70a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:52:30 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 5fb24f48-e72d-4c52-ad10-aae7b37171db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:52:30 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 06:52:30 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 06:52:30 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:52:30 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:52:30 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 06:52:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.492s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:31 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:52:31 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:52:31 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 06:52:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-15dda080-3487-4316-ab7b-f7185f0a4519" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:52:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-15dda080-3487-4316-ab7b-f7185f0a4519" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:52:31 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Updating instance_info_cache with network_info: [{"id": "6efe1803-2ae3-490f-8791-c2ba35919f09", "address": "fa:16:3e:a7:75:9f", "network": {"id": "aae92e96-18c4-419a-b1b0-5ab55d8f26c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1926005183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52fb0421f625467a8205b8000a6dcee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efe1803-2a", "ovs_interfaceid": "6efe1803-2ae3-490f-8791-c2ba35919f09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-15dda080-3487-4316-ab7b-f7185f0a4519" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwOMyJVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:52:32 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:52:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:52:32 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:52:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:52:32 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee8f6d6-4b8f-4976-9181-19006e79795d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 06:52:32 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[afed970e-5609-406d-b1ca-b93a377de3d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d] added
Aug 09 06:52:32 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f670f9a8-257c-4779-a67a-6f17581e2c18]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[66215383-94d6-4185-b372-c8a70103bbc2]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fwOMyJVP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fwOMyJVP" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7d3c8e-2357-43ca-9424-f4e737c09366]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fwOMyJVP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b92b0e-c990-4ff7-b05f-8d3f43f8e2bb]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[55135b66-66fe-404b-9ce7-332cd9c46da5]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:52:32 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:52:32 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[654f8d5a-dc44-49fe-b415-c29752347d92]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d, portal: 172.16.0.220,3260]
Aug 09 06:52:32 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d, portal: 172.16.0.220,3260] successful.
Aug 09 06:52:32 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[064d5a29-c406-4ecc-a84d-4886bba10f64]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a63687c-9671-484f-92bd-2b99dd6418df]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:52:32 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:52:32 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:52:32 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:52:32 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5b25cc-23d1-430b-96fd-8a9c0ad3037b]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: None {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 06:52:32 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:33 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 06:52:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwOMyJVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 06:52:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:52:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23765636463353861', 'path': '/dev/sdb'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:52:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765636463353861', 'path': '/dev/sdb'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 06:52:33 user nova-compute[72809]: DEBUG nova.objects.instance [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lazy-loading 'flavor' on Instance uuid 3640991e-8a5b-4674-af81-3117d4269a68 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:52:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 06:52:33 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:52:33 user nova-compute[72809]:   <source dev="/dev/sdb"/>
Aug 09 06:52:33 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 06:52:33 user nova-compute[72809]:   <serial>d187a33a-16e4-421a-890e-be960e85387d</serial>
Aug 09 06:52:33 user nova-compute[72809]: </disk>
Aug 09 06:52:33 user nova-compute[72809]:  {{(pid=72809) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 06:52:34 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:52:34 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:52:34 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] No VIF found with MAC fa:16:3e:70:a1:b1, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:52:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2338b657-f28a-40e8-b4f6-7d212938a6e2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "3640991e-8a5b-4674-af81-3117d4269a68" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.366s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:35 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:35 user nova-compute[72809]: INFO nova.compute.manager [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Rescuing
Aug 09 06:52:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Acquiring lock "refresh_cache-3640991e-8a5b-4674-af81-3117d4269a68" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:52:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Acquired lock "refresh_cache-3640991e-8a5b-4674-af81-3117d4269a68" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:52:35 user nova-compute[72809]: DEBUG nova.network.neutron [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:52:36 user nova-compute[72809]: DEBUG nova.network.neutron [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Updating instance_info_cache with network_info: [{"id": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "address": "fa:16:3e:70:a1:b1", "network": {"id": "d6503417-7fd7-487b-8474-f23e4cc77845", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1134767045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04f60d3bd9a41fc930f728a74371a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030dd6f3-f7", "ovs_interfaceid": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:52:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Releasing lock "refresh_cache-3640991e-8a5b-4674-af81-3117d4269a68" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:52:36 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:36 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:36 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:36 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:36 user nova-compute[72809]: DEBUG nova.compute.manager [req-b728fd2d-e5f8-4dfe-b84d-003fc92dd900 req-416b4996-8363-4781-be21-ed09818f7c88 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received event network-vif-unplugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:52:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b728fd2d-e5f8-4dfe-b84d-003fc92dd900 req-416b4996-8363-4781-be21-ed09818f7c88 service nova] Acquiring lock "3640991e-8a5b-4674-af81-3117d4269a68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b728fd2d-e5f8-4dfe-b84d-003fc92dd900 req-416b4996-8363-4781-be21-ed09818f7c88 service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b728fd2d-e5f8-4dfe-b84d-003fc92dd900 req-416b4996-8363-4781-be21-ed09818f7c88 service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:36 user nova-compute[72809]: DEBUG nova.compute.manager [req-b728fd2d-e5f8-4dfe-b84d-003fc92dd900 req-416b4996-8363-4781-be21-ed09818f7c88 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] No waiting events found dispatching network-vif-unplugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:52:36 user nova-compute[72809]: WARNING nova.compute.manager [req-b728fd2d-e5f8-4dfe-b84d-003fc92dd900 req-416b4996-8363-4781-be21-ed09818f7c88 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received unexpected event network-vif-unplugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 for instance with vm_state active and task_state rescuing.
Aug 09 06:52:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMtUvsXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:52:37 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:52:37 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:52:37 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:52:37 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:52:37 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 06:52:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:37 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Instance destroyed successfully.
Aug 09 06:52:37 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Attempting a stable device rescue
Aug 09 06:52:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa597be-6c0b-42b6-9b28-735671e0d9cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 06:52:37 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f32951-272e-4240-8817-c17ca269c2e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf] added
Aug 09 06:52:37 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72809) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f6130d-890e-4229-98f5-8b7b1e621099]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Instance directory exists: not creating {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 06:52:37 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Creating image(s)
Aug 09 06:52:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Acquiring lock "/opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "/opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "/opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG nova.objects.instance [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3640991e-8a5b-4674-af81-3117d4269a68 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d3e6dc-3d8b-4334-934a-517f4f5c2fc9]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zMtUvsXI {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Acquiring lock "fadcfaf2c192d53c17bb1bd4747d9b3596dbc190" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "fadcfaf2c192d53c17bb1bd4747d9b3596dbc190" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zMtUvsXI" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7dde8f2-8b43-4764-9d84-37c3c86ce736]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zMtUvsXI'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[036453a1-5fd0-41b3-aaac-3c89dec455f7]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[49052a50-e393-4739-b9ae-08bbbe8ec8a9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:52:37 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:52:37 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:52:37 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:52:37 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:52:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fadcfaf2c192d53c17bb1bd4747d9b3596dbc190.part --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:38 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c418169b-e31f-40a2-9d39-fcae8d80abc4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:38 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf, portal: 172.16.0.220,3260]
Aug 09 06:52:38 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf, portal: 172.16.0.220,3260] successful.
Aug 09 06:52:38 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:38 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[48945a75-66a0-4b53-bc74-b0f285353b3a]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:38 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:38 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a88795-d0cd-46b5-bfb3-bd20538cd283]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:38 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:52:38 user nova-compute[72809]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:52:38 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:52:38 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:52:38 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:52:38 user nova-compute[72809]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:52:38 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:52:38 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:52:38 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.347s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:52:38 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 06:52:38 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] HCTL ('34', '-', '-', 0) found on session 11 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 06:52:38 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 06:52:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:38 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac6d7fc-0db6-40d4-86e6-3749c18e2a74]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:38 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Searching for a device in session 11 and hctl ['34', '*', '*', 0] yield: None {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 06:52:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fadcfaf2c192d53c17bb1bd4747d9b3596dbc190.part --force-share --output=json" returned: 0 in 0.220s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:38 user nova-compute[72809]: DEBUG nova.virt.images [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] df49c912-ce77-4b50-99da-4d9978b3371c was qcow2, converting to raw {{(pid=72809) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 06:52:38 user nova-compute[72809]: DEBUG nova.privsep.utils [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72809) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 06:52:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fadcfaf2c192d53c17bb1bd4747d9b3596dbc190.part /opt/stack/data/nova/instances/_base/fadcfaf2c192d53c17bb1bd4747d9b3596dbc190.converted {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fadcfaf2c192d53c17bb1bd4747d9b3596dbc190.part /opt/stack/data/nova/instances/_base/fadcfaf2c192d53c17bb1bd4747d9b3596dbc190.converted" returned: 0 in 0.243s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fadcfaf2c192d53c17bb1bd4747d9b3596dbc190.converted --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:38 user nova-compute[72809]: DEBUG nova.compute.manager [req-f86181cd-1f4e-4d73-b46f-838ee2ec5229 req-9812f0dd-32a2-4b79-94e3-bf97fa9cb8d1 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received event network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:52:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f86181cd-1f4e-4d73-b46f-838ee2ec5229 req-9812f0dd-32a2-4b79-94e3-bf97fa9cb8d1 service nova] Acquiring lock "3640991e-8a5b-4674-af81-3117d4269a68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f86181cd-1f4e-4d73-b46f-838ee2ec5229 req-9812f0dd-32a2-4b79-94e3-bf97fa9cb8d1 service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f86181cd-1f4e-4d73-b46f-838ee2ec5229 req-9812f0dd-32a2-4b79-94e3-bf97fa9cb8d1 service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:38 user nova-compute[72809]: DEBUG nova.compute.manager [req-f86181cd-1f4e-4d73-b46f-838ee2ec5229 req-9812f0dd-32a2-4b79-94e3-bf97fa9cb8d1 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] No waiting events found dispatching network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:52:38 user nova-compute[72809]: WARNING nova.compute.manager [req-f86181cd-1f4e-4d73-b46f-838ee2ec5229 req-9812f0dd-32a2-4b79-94e3-bf97fa9cb8d1 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received unexpected event network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 for instance with vm_state active and task_state rescuing.
Aug 09 06:52:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fadcfaf2c192d53c17bb1bd4747d9b3596dbc190.converted --force-share --output=json" returned: 0 in 0.168s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "fadcfaf2c192d53c17bb1bd4747d9b3596dbc190" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.747s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Acquiring lock "fadcfaf2c192d53c17bb1bd4747d9b3596dbc190" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "fadcfaf2c192d53c17bb1bd4747d9b3596dbc190" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fadcfaf2c192d53c17bb1bd4747d9b3596dbc190 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fadcfaf2c192d53c17bb1bd4747d9b3596dbc190 --force-share --output=json" returned: 0 in 0.170s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fadcfaf2c192d53c17bb1bd4747d9b3596dbc190,backing_fmt=raw /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk.rescue {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fadcfaf2c192d53c17bb1bd4747d9b3596dbc190,backing_fmt=raw /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk.rescue" returned: 0 in 0.066s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "fadcfaf2c192d53c17bb1bd4747d9b3596dbc190" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.objects.instance [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lazy-loading 'migration_context' on Instance uuid 3640991e-8a5b-4674-af81-3117d4269a68 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Start _get_guest_xml network_info=[{"id": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "address": "fa:16:3e:70:a1:b1", "network": {"id": "d6503417-7fd7-487b-8474-f23e4cc77845", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1134767045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1134767045-network", "vif_mac": "fa:16:3e:70:a1:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04f60d3bd9a41fc930f728a74371a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030dd6f3-f7", "ovs_interfaceid": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'df49c912-ce77-4b50-99da-4d9978b3371c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwOMyJVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '3640991e-8a5b-4674-af81-3117d4269a68', 'attached_at': '', 'detached_at': '', 'volume_id': 'd187a33a-16e4-421a-890e-be960e85387d', 'serial': 'd187a33a-16e4-421a-890e-be960e85387d'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': None, 'attachment_id': 'e7de4bfe-02ac-41fe-80c4-6771924e50ba', 'volume_type': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.objects.instance [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lazy-loading 'resources' on Instance uuid 3640991e-8a5b-4674-af81-3117d4269a68 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.objects.instance [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lazy-loading 'numa_topology' on Instance uuid 3640991e-8a5b-4674-af81-3117d4269a68 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:52:39 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:52:39 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.objects.instance [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3640991e-8a5b-4674-af81-3117d4269a68 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwOMyJVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:52:39 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:52:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Searching for a device in session 11 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMtUvsXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.388s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] <== connect_volume: return (2389ms) {'type': 'block', 'scsi_wwn': '26334623733663261', 'path': '/dev/sdc'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334623733663261', 'path': '/dev/sdc'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.085s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:52:39 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:52:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:52:39 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 06:52:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.objects.instance [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lazy-loading 'flavor' on Instance uuid 15dda080-3487-4316-ab7b-f7185f0a4519 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a92638-9ee0-46e0-94c4-3e922a033c4f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = fwOMyJVP\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 09 06:52:39 user nova-compute[72809]: node.name = iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d
Aug 09 06:52:39 user nova-compute[72809]: node.tpgt = -1
Aug 09 06:52:39 user nova-compute[72809]: node.startup = automatic
Aug 09 06:52:39 user nova-compute[72809]: node.leading_login = No
Aug 09 06:52:39 user nova-compute[72809]: iface.iscsi_ifacename = default
Aug 09 06:52:39 user nova-compute[72809]: iface.net_ifacename = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.ipaddress = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.prefix_len = 0
Aug 09 06:52:39 user nova-compute[72809]: iface.hwaddress = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.transport_name = tcp
Aug 09 06:52:39 user nova-compute[72809]: iface.initiatorname = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.state = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.vlan_id = 0
Aug 09 06:52:39 user nova-compute[72809]: iface.vlan_priority = 0
Aug 09 06:52:39 user nova-compute[72809]: iface.vlan_state = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.iface_num = 0
Aug 09 06:52:39 user nova-compute[72809]: iface.mtu = 0
Aug 09 06:52:39 user nova-compute[72809]: iface.port = 0
Aug 09 06:52:39 user nova-compute[72809]: iface.bootproto = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.subnet_mask = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.gateway = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.dhcp_alt_client_id_state = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.dhcp_alt_client_id = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.dhcp_dns = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.dhcp_learn_iqn = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.dhcp_req_vendor_id_state = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.dhcp_vendor_id_state = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.dhcp_vendor_id = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.dhcp_slp_da = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.fragmentation = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.gratuitous_arp = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.incoming_forwarding = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.tos_state = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.tos = 0
Aug 09 06:52:39 user nova-compute[72809]: iface.ttl = 0
Aug 09 06:52:39 user nova-compute[72809]: iface.delayed_ack = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.tcp_nagle = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.tcp_wsf_state = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.tcp_wsf = 0
Aug 09 06:52:39 user nova-compute[72809]: iface.tcp_timer_scale = 0
Aug 09 06:52:39 user nova-compute[72809]: iface.tcp_timestamp = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.redirect = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.def_task_mgmt_timeout = 0
Aug 09 06:52:39 user nova-compute[72809]: iface.header_digest = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.data_digest = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.immediate_data = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.initial_r2t = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.data_seq_inorder = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.data_pdu_inorder = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.erl = 0
Aug 09 06:52:39 user nova-compute[72809]: iface.max_receive_data_len = 0
Aug 09 06:52:39 user nova-compute[72809]: iface.first_burst_len = 0
Aug 09 06:52:39 user nova-compute[72809]: iface.max_outstanding_r2t = 0
Aug 09 06:52:39 user nova-compute[72809]: iface.max_burst_len = 0
Aug 09 06:52:39 user nova-compute[72809]: iface.chap_auth = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.bidi_chap = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.strict_login_compliance = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.discovery_auth = <empty>
Aug 09 06:52:39 user nova-compute[72809]: iface.discovery_logout = <empty>
Aug 09 06:52:39 user nova-compute[72809]: node.discovery_address = <empty>
Aug 09 06:52:39 user nova-compute[72809]: node.discovery_port = 0
Aug 09 06:52:39 user nova-compute[72809]: node.discovery_type = static
Aug 09 06:52:39 user nova-compute[72809]: node.session.initial_cmdsn = 0
Aug 09 06:52:39 user nova-compute[72809]: node.session.initial_login_retry_max = 8
Aug 09 06:52:39 user nova-compute[72809]: node.session.xmit_thread_priority = -20
Aug 09 06:52:39 user nova-compute[72809]: node.session.cmds_max = 128
Aug 09 06:52:39 user nova-compute[72809]: node.session.queue_depth = 32
Aug 09 06:52:39 user nova-compute[72809]: node.session.nr_sessions = 1
Aug 09 06:52:39 user nova-compute[72809]: node.session.auth.authmethod = CHAP
Aug 09 06:52:39 user nova-compute[72809]: node.session.auth.username = fwOMyJVP
Aug 09 06:52:39 user nova-compute[72809]: node.session.auth.password = ***
Aug 09 06:52:39 user nova-compute[72809]: node.session.auth.username_in = <empty>
Aug 09 06:52:39 user nova-compute[72809]: node.session.auth.password_in = <empty>
Aug 09 06:52:39 user nova-compute[72809]: node.session.auth.chap_algs = MD5
Aug 09 06:52:39 user nova-compute[72809]: node.session.timeo.replacement_timeout = 120
Aug 09 06:52:39 user nova-compute[72809]: node.session.err_timeo.abort_timeout = 15
Aug 09 06:52:39 user nova-compute[72809]: node.session.err_timeo.lu_reset_timeout = 30
Aug 09 06:52:39 user nova-compute[72809]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 09 06:52:39 user nova-compute[72809]: node.session.err_timeo.host_reset_timeout = 60
Aug 09 06:52:39 user nova-compute[72809]: node.session.iscsi.FastAbort = Yes
Aug 09 06:52:39 user nova-compute[72809]: node.session.iscsi.InitialR2T = No
Aug 09 06:52:39 user nova-compute[72809]: node.session.iscsi.ImmediateData = Yes
Aug 09 06:52:39 user nova-compute[72809]: node.session.iscsi.FirstBurstLength = 262144
Aug 09 06:52:39 user nova-compute[72809]: node.session.iscsi.MaxBurstLength = 16776192
Aug 09 06:52:39 user nova-compute[72809]: node.session.iscsi.DefaultTime2Retain = 0
Aug 09 06:52:39 user nova-compute[72809]: node.session.iscsi.DefaultTime2Wait = 2
Aug 09 06:52:39 user nova-compute[72809]: node.session.iscsi.MaxConnections = 1
Aug 09 06:52:39 user nova-compute[72809]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 09 06:52:39 user nova-compute[72809]: node.session.iscsi.ERL = 0
Aug 09 06:52:39 user nova-compute[72809]: node.session.scan = manual
Aug 09 06:52:39 user nova-compute[72809]: node.session.reopen_max = 0
Aug 09 06:52:39 user nova-compute[72809]: node.conn[0].address = 172.16.0.220
Aug 09 06:52:39 user nova-compute[72809]: node.conn[0].port = 3260
Aug 09 06:52:39 user nova-compute[72809]: node.conn[0].startup = manual
Aug 09 06:52:39 user nova-compute[72809]: node.conn[0].tcp.window_size = 524288
Aug 09 06:52:39 user nova-compute[72809]: node.conn[0].tcp.type_of_service = 0
Aug 09 06:52:39 user nova-compute[72809]: node.conn[0].timeo.logout_timeout = 15
Aug 09 06:52:39 user nova-compute[72809]: node.conn[0].timeo.login_timeout = 15
Aug 09 06:52:39 user nova-compute[72809]: node.conn[0].timeo.auth_timeout = 45
Aug 09 06:52:39 user nova-compute[72809]: node.conn[0].timeo.noop_out_interval = 5
Aug 09 06:52:39 user nova-compute[72809]: node.conn[0].timeo.noop_out_timeout = 5
Aug 09 06:52:39 user nova-compute[72809]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 09 06:52:39 user nova-compute[72809]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 09 06:52:39 user nova-compute[72809]: node.conn[0].iscsi.HeaderDigest = None
Aug 09 06:52:39 user nova-compute[72809]: node.conn[0].iscsi.DataDigest = None
Aug 09 06:52:39 user nova-compute[72809]: node.conn[0].iscsi.IFMarker = No
Aug 09 06:52:39 user nova-compute[72809]: node.conn[0].iscsi.OFMarker = No
Aug 09 06:52:39 user nova-compute[72809]: # END RECORD
Aug 09 06:52:39 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 06:52:39 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:52:39 user nova-compute[72809]:   <source dev="/dev/sdc"/>
Aug 09 06:52:39 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 06:52:39 user nova-compute[72809]:   <serial>521a87a6-3612-4fe2-ba75-ffa77601e8bf</serial>
Aug 09 06:52:39 user nova-compute[72809]: </disk>
Aug 09 06:52:39 user nova-compute[72809]:  {{(pid=72809) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[96618d4f-d87a-4eac-bc37-2360e6ecaa39]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad755255-60e3-4943-a809-483f9db6840c]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fwOMyJVP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fwOMyJVP" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e89f752-45dd-4b34-ab9a-0a5b7a93b91a]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fwOMyJVP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a6b91d-f6c5-43ff-ace3-c064b0ce73c2]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9d2400-9a02-4968-b35a-a8658019c168]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:52:39 user nova-compute[72809]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:52:39 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:52:39 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:52:39 user nova-compute[72809]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:52:39 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:52:39 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.186s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] HCTL ('33', '0', '0', 0) found on session 10 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[53174df2-7293-42b7-adc2-e7f59a4509c1]: (4, ('0 0 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Searching for a device in session 10 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwOMyJVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.213s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] <== connect_volume: return (298ms) {'type': 'block', 'scsi_wwn': '23765636463353861', 'path': '/dev/sdb'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765636463353861', 'path': '/dev/sdb'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:48:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-995514485',display_name='tempest-ServerStableDeviceRescueTest-server-995514485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-995514485',id=3,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNIAOBtUHLY5RLLblzf2H9UgwHfkxVSsn0KqwvIq1wE2eV6oO4rG/G1/BgLg8+rUoZsnFfXiYTDv+fYrNnTfaCu6vpj0/PnCJDru2o8rKGymDnbKqG9XIaRxyfKqJHb7Q==',key_name='tempest-keypair-1989347577',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:48:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c04f60d3bd9a41fc930f728a74371a2c',ramdisk_id='',reservation_id='r-w3f3gjq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1178370555',owner_user_name='tempest-ServerStableDeviceRescueTest-1178370555-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:50:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98a58716cb5f4c86952ef9e1f555e6a7',uuid=3640991e-8a5b-4674-af81-3117d4269a68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "address": "fa:16:3e:70:a1:b1", "network": {"id": "d6503417-7fd7-487b-8474-f23e4cc77845", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1134767045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1134767045-network", "vif_mac": "fa:16:3e:70:a1:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04f60d3bd9a41fc930f728a74371a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030dd6f3-f7", "ovs_interfaceid": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Converting VIF {"id": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "address": "fa:16:3e:70:a1:b1", "network": {"id": "d6503417-7fd7-487b-8474-f23e4cc77845", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1134767045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1134767045-network", "vif_mac": "fa:16:3e:70:a1:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04f60d3bd9a41fc930f728a74371a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030dd6f3-f7", "ovs_interfaceid": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:a1:b1,bridge_name='br-int',has_traffic_filtering=True,id=030dd6f3-f758-4b5a-b9fb-be3c64cb9341,network=Network(d6503417-7fd7-487b-8474-f23e4cc77845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030dd6f3-f7') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.objects.instance [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lazy-loading 'pci_devices' on Instance uuid 3640991e-8a5b-4674-af81-3117d4269a68 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:52:39 user nova-compute[72809]:   <uuid>3640991e-8a5b-4674-af81-3117d4269a68</uuid>
Aug 09 06:52:39 user nova-compute[72809]:   <name>instance-00000003</name>
Aug 09 06:52:39 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:52:39 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:52:39 user nova-compute[72809]:   <metadata>
Aug 09 06:52:39 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:52:39 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:52:39 user nova-compute[72809]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-995514485</nova:name>
Aug 09 06:52:39 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:52:39</nova:creationTime>
Aug 09 06:52:39 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:52:39 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:52:39 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:52:39 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:52:39 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:52:39 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:52:39 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:52:39 user nova-compute[72809]:       <nova:owner>
Aug 09 06:52:39 user nova-compute[72809]:         <nova:user uuid="98a58716cb5f4c86952ef9e1f555e6a7">tempest-ServerStableDeviceRescueTest-1178370555-project-member</nova:user>
Aug 09 06:52:39 user nova-compute[72809]:         <nova:project uuid="c04f60d3bd9a41fc930f728a74371a2c">tempest-ServerStableDeviceRescueTest-1178370555</nova:project>
Aug 09 06:52:39 user nova-compute[72809]:       </nova:owner>
Aug 09 06:52:39 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:52:39 user nova-compute[72809]:       <nova:ports>
Aug 09 06:52:39 user nova-compute[72809]:         <nova:port uuid="030dd6f3-f758-4b5a-b9fb-be3c64cb9341">
Aug 09 06:52:39 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 06:52:39 user nova-compute[72809]:         </nova:port>
Aug 09 06:52:39 user nova-compute[72809]:       </nova:ports>
Aug 09 06:52:39 user nova-compute[72809]:     </nova:instance>
Aug 09 06:52:39 user nova-compute[72809]:   </metadata>
Aug 09 06:52:39 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:52:39 user nova-compute[72809]:     <system>
Aug 09 06:52:39 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:52:39 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:52:39 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:52:39 user nova-compute[72809]:       <entry name="serial">3640991e-8a5b-4674-af81-3117d4269a68</entry>
Aug 09 06:52:39 user nova-compute[72809]:       <entry name="uuid">3640991e-8a5b-4674-af81-3117d4269a68</entry>
Aug 09 06:52:39 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:52:39 user nova-compute[72809]:     </system>
Aug 09 06:52:39 user nova-compute[72809]:   </sysinfo>
Aug 09 06:52:39 user nova-compute[72809]:   <os>
Aug 09 06:52:39 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:52:39 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:52:39 user nova-compute[72809]:   </os>
Aug 09 06:52:39 user nova-compute[72809]:   <features>
Aug 09 06:52:39 user nova-compute[72809]:     <acpi/>
Aug 09 06:52:39 user nova-compute[72809]:     <apic/>
Aug 09 06:52:39 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:52:39 user nova-compute[72809]:   </features>
Aug 09 06:52:39 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:52:39 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:52:39 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:52:39 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:52:39 user nova-compute[72809]:   </clock>
Aug 09 06:52:39 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:52:39 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:52:39 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:52:39 user nova-compute[72809]:   </cpu>
Aug 09 06:52:39 user nova-compute[72809]:   <devices>
Aug 09 06:52:39 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:52:39 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:52:39 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk"/>
Aug 09 06:52:39 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:52:39 user nova-compute[72809]:     </disk>
Aug 09 06:52:39 user nova-compute[72809]:     <disk type="block" device="disk">
Aug 09 06:52:39 user nova-compute[72809]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:52:39 user nova-compute[72809]:       <source dev="/dev/sdb"/>
Aug 09 06:52:39 user nova-compute[72809]:       <target dev="vdb" bus="virtio"/>
Aug 09 06:52:39 user nova-compute[72809]:       <serial>d187a33a-16e4-421a-890e-be960e85387d</serial>
Aug 09 06:52:39 user nova-compute[72809]:     </disk>
Aug 09 06:52:39 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:52:39 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:52:39 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk.rescue"/>
Aug 09 06:52:39 user nova-compute[72809]:       <target dev="vdc" bus="virtio"/>
Aug 09 06:52:39 user nova-compute[72809]:       <boot order="1"/>
Aug 09 06:52:39 user nova-compute[72809]:     </disk>
Aug 09 06:52:39 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:52:39 user nova-compute[72809]:       <mac address="fa:16:3e:70:a1:b1"/>
Aug 09 06:52:39 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:52:39 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:52:39 user nova-compute[72809]:       <target dev="tap030dd6f3-f7"/>
Aug 09 06:52:39 user nova-compute[72809]:     </interface>
Aug 09 06:52:39 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:52:39 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/console.log" append="off"/>
Aug 09 06:52:39 user nova-compute[72809]:     </serial>
Aug 09 06:52:39 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:52:39 user nova-compute[72809]:     <video>
Aug 09 06:52:39 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:52:39 user nova-compute[72809]:     </video>
Aug 09 06:52:39 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:52:39 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:52:39 user nova-compute[72809]:     </rng>
Aug 09 06:52:39 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:52:39 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:52:39 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:52:39 user nova-compute[72809]:     </memballoon>
Aug 09 06:52:39 user nova-compute[72809]:   </devices>
Aug 09 06:52:39 user nova-compute[72809]: </domain>
Aug 09 06:52:39 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:52:39 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Instance destroyed successfully.
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:52:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] No VIF found with MAC fa:16:3e:70:a1:b1, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:52:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:52:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:52:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] No VIF found with MAC fa:16:3e:a7:75:9f, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:52:40 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-54761f4f-c96d-438e-b052-4b05c50404ce tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "15dda080-3487-4316-ab7b-f7185f0a4519" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.313s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:40 user nova-compute[72809]: DEBUG nova.objects.instance [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lazy-loading 'flavor' on Instance uuid 24ba9b41-d0bf-4a84-9f04-bfda9525b154 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:52:40 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "refresh_cache-24ba9b41-d0bf-4a84-9f04-bfda9525b154" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:52:40 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquired lock "refresh_cache-24ba9b41-d0bf-4a84-9f04-bfda9525b154" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:52:40 user nova-compute[72809]: DEBUG nova.network.neutron [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:52:40 user nova-compute[72809]: DEBUG nova.objects.instance [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lazy-loading 'info_cache' on Instance uuid 24ba9b41-d0bf-4a84-9f04-bfda9525b154 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG nova.network.neutron [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Updating instance_info_cache with network_info: [{"id": "f12bff80-425f-42ba-804d-540ad751f70c", "address": "fa:16:3e:36:6c:27", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12bff80-42", "ovs_interfaceid": "f12bff80-425f-42ba-804d-540ad751f70c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Releasing lock "refresh_cache-24ba9b41-d0bf-4a84-9f04-bfda9525b154" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:41 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Instance destroyed successfully.
Aug 09 06:52:41 user nova-compute[72809]: DEBUG nova.objects.instance [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lazy-loading 'resources' on Instance uuid 24ba9b41-d0bf-4a84-9f04-bfda9525b154 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:48:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-450574580',display_name='tempest-AttachVolumeTestJSON-server-450574580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-450574580',id=2,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDJ0cgVVGdxmBusvy2LpBlTCELREPHX0PiRGBl4xUaShS+GxBoB6howy4sQdzJp5xGl40sCcx5e/0j2dhekoUvRjUbaKjJ/gVIKho4UvqK2B4IB5h/y1k8THmm8SIXqLw==',key_name='tempest-keypair-1151798744',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:48:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='55a7945f87914776a3f58bda58b7c90c',ramdisk_id='',reservation_id='r-0e3nfuh3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1328011883',owner_user_name='tempest-AttachVolumeTestJSON-1328011883-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:50:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87785e8362a14385a951638f4d7cf817',uuid=24ba9b41-d0bf-4a84-9f04-bfda9525b154,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f12bff80-425f-42ba-804d-540ad751f70c", "address": "fa:16:3e:36:6c:27", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12bff80-42", "ovs_interfaceid": "f12bff80-425f-42ba-804d-540ad751f70c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Converting VIF {"id": "f12bff80-425f-42ba-804d-540ad751f70c", "address": "fa:16:3e:36:6c:27", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12bff80-42", "ovs_interfaceid": "f12bff80-425f-42ba-804d-540ad751f70c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:6c:27,bridge_name='br-int',has_traffic_filtering=True,id=f12bff80-425f-42ba-804d-540ad751f70c,network=Network(3430cb1f-9729-4613-bc8b-0fcdafd88198),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12bff80-42') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG os_vif [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:6c:27,bridge_name='br-int',has_traffic_filtering=True,id=f12bff80-425f-42ba-804d-540ad751f70c,network=Network(3430cb1f-9729-4613-bc8b-0fcdafd88198),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12bff80-42') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf12bff80-42, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:41 user nova-compute[72809]: INFO os_vif [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:6c:27,bridge_name='br-int',has_traffic_filtering=True,id=f12bff80-425f-42ba-804d-540ad751f70c,network=Network(3430cb1f-9729-4613-bc8b-0fcdafd88198),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12bff80-42')
Aug 09 06:52:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fiKtUFLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:52:41 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:52:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7031e85a-4b13-4bfb-9b68-92593b5cb0a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a07b139-1b3e-401b-8f0f-0935b7d18395]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:52:41 user nova-compute[72809]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:52:41 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:52:41 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:52:41 user nova-compute[72809]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:52:41 user nova-compute[72809]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:52:41 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc1386ce5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c'): ({'sdf'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Removing single pathed devices sdf {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[750e817e-8c24-4cf9-90c0-16ec211f5537]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b034f263-c5e1-4e65-8d10-37b5759c3571]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Flushing IO for device /dev/sdf {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG nova.compute.manager [req-a0a23dfb-0f92-4d45-bd55-cb7c0b41aff2 req-8f2c2833-2e31-4f0f-8bb6-af5daa3e9770 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received event network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a0a23dfb-0f92-4d45-bd55-cb7c0b41aff2 req-8f2c2833-2e31-4f0f-8bb6-af5daa3e9770 service nova] Acquiring lock "3640991e-8a5b-4674-af81-3117d4269a68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a0a23dfb-0f92-4d45-bd55-cb7c0b41aff2 req-8f2c2833-2e31-4f0f-8bb6-af5daa3e9770 service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a0a23dfb-0f92-4d45-bd55-cb7c0b41aff2 req-8f2c2833-2e31-4f0f-8bb6-af5daa3e9770 service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG nova.compute.manager [req-a0a23dfb-0f92-4d45-bd55-cb7c0b41aff2 req-8f2c2833-2e31-4f0f-8bb6-af5daa3e9770 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] No waiting events found dispatching network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:52:41 user nova-compute[72809]: WARNING nova.compute.manager [req-a0a23dfb-0f92-4d45-bd55-cb7c0b41aff2 req-8f2c2833-2e31-4f0f-8bb6-af5daa3e9770 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received unexpected event network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 for instance with vm_state active and task_state rescuing.
Aug 09 06:52:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.036s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd82278d-0971-40b4-9cff-17ab9c2fa5de]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f68962b-2302-4382-9c7b-6da03aedfe72]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] SCSI volumes sdf have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e67e9c7-bc7b-4e83-827e-80e734d8892b]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b8d0d1-5f1b-45c3-ab49-15137ab013ec]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c, portal: 172.16.0.220,3260]
Aug 09 06:52:41 user nova-compute[72809]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c, portal: 172.16.0.220,3260] successful.
Aug 09 06:52:41 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4700c1-de66-4d87-9b91-5732fcdb2cd7]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] <== disconnect_volume: return (398ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Start _get_guest_xml network_info=[{"id": "f12bff80-425f-42ba-804d-540ad751f70c", "address": "fa:16:3e:36:6c:27", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12bff80-42", "ovs_interfaceid": "f12bff80-425f-42ba-804d-540ad751f70c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fiKtUFLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '24ba9b41-d0bf-4a84-9f04-bfda9525b154', 'attached_at': '', 'detached_at': '', 'volume_id': '9764e6f5-4af3-437f-82a0-f0becb06d18c', 'serial': '9764e6f5-4af3-437f-82a0-f0becb06d18c'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': None, 'attachment_id': 'b60c8e74-1151-4874-ae16-f4b6a5132259', 'volume_type': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:52:41 user nova-compute[72809]: DEBUG nova.objects.instance [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lazy-loading 'numa_topology' on Instance uuid 24ba9b41-d0bf-4a84-9f04-bfda9525b154 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:52:42 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:52:42 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:52:42 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG nova.objects.instance [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lazy-loading 'vcpu_model' on Instance uuid 24ba9b41-d0bf-4a84-9f04-bfda9525b154 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fiKtUFLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:52:42 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:52:42 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:52:42 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:52:42 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:52:42 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 06:52:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ba17d0-69ca-487e-bd37-39f1e3d8b236]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 06:52:42 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3300ef-6f7e-48f8-b075-25cb9febf216]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c] added
Aug 09 06:52:42 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac289a4-6a93-48c8-b85e-2d8346d82463]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[489fda94-b674-44f7-a9f9-e6539f4a8d64]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fiKtUFLG {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fiKtUFLG" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc36724-5f46-40d4-931b-216b4b7e65be]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fiKtUFLG'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[714a580d-5df1-4546-b816-0843f798527d]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ab5a4a-7190-42af-bcd0-e730f90dffd8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:52:42 user nova-compute[72809]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:52:42 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:52:42 user nova-compute[72809]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:52:42 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce8b2c4-4b2f-46a6-808f-896d76e307ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c, portal: 172.16.0.220,3260]
Aug 09 06:52:42 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c, portal: 172.16.0.220,3260] successful.
Aug 09 06:52:42 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c23c26-714a-4da9-8d78-4d2e402d6d0a]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5626a49f-81e6-4175-8c1b-317308a5c386]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:52:42 user nova-compute[72809]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:52:42 user nova-compute[72809]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:52:42 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:52:42 user nova-compute[72809]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:52:42 user nova-compute[72809]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:52:42 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] HCTL ('35', '-', '-', 0) found on session 12 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[73eafdcd-3fc3-4188-832d-0f6df551f298]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Searching for a device in session 12 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fiKtUFLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 06:52:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:43 user nova-compute[72809]: DEBUG nova.compute.manager [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Stashing vm_state: active {{(pid=72809) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 09 06:52:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:43 user nova-compute[72809]: DEBUG nova.objects.instance [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lazy-loading 'pci_requests' on Instance uuid 15dda080-3487-4316-ab7b-f7185f0a4519 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:52:43 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 06:52:43 user nova-compute[72809]: INFO nova.compute.claims [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Claim successful on node user
Aug 09 06:52:43 user nova-compute[72809]: DEBUG nova.objects.instance [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lazy-loading 'resources' on Instance uuid 15dda080-3487-4316-ab7b-f7185f0a4519 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:52:43 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:52:43 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23430356633636163', 'path': '/dev/sdd'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:52:43 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430356633636163', 'path': '/dev/sdd'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 06:52:43 user nova-compute[72809]: DEBUG nova.objects.instance [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lazy-loading 'pci_devices' on Instance uuid 15dda080-3487-4316-ab7b-f7185f0a4519 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:52:43 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:48:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-450574580',display_name='tempest-AttachVolumeTestJSON-server-450574580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-450574580',id=2,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDJ0cgVVGdxmBusvy2LpBlTCELREPHX0PiRGBl4xUaShS+GxBoB6howy4sQdzJp5xGl40sCcx5e/0j2dhekoUvRjUbaKjJ/gVIKho4UvqK2B4IB5h/y1k8THmm8SIXqLw==',key_name='tempest-keypair-1151798744',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:48:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='55a7945f87914776a3f58bda58b7c90c',ramdisk_id='',reservation_id='r-0e3nfuh3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1328011883',owner_user_name='tempest-AttachVolumeTestJSON-1328011883-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:50:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87785e8362a14385a951638f4d7cf817',uuid=24ba9b41-d0bf-4a84-9f04-bfda9525b154,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f12bff80-425f-42ba-804d-540ad751f70c", "address": "fa:16:3e:36:6c:27", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12bff80-42", "ovs_interfaceid": "f12bff80-425f-42ba-804d-540ad751f70c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:52:43 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Converting VIF {"id": "f12bff80-425f-42ba-804d-540ad751f70c", "address": "fa:16:3e:36:6c:27", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12bff80-42", "ovs_interfaceid": "f12bff80-425f-42ba-804d-540ad751f70c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:52:43 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:6c:27,bridge_name='br-int',has_traffic_filtering=True,id=f12bff80-425f-42ba-804d-540ad751f70c,network=Network(3430cb1f-9729-4613-bc8b-0fcdafd88198),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12bff80-42') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:52:43 user nova-compute[72809]: DEBUG nova.objects.instance [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lazy-loading 'pci_devices' on Instance uuid 24ba9b41-d0bf-4a84-9f04-bfda9525b154 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:52:43 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:52:43 user nova-compute[72809]:   <uuid>24ba9b41-d0bf-4a84-9f04-bfda9525b154</uuid>
Aug 09 06:52:43 user nova-compute[72809]:   <name>instance-00000002</name>
Aug 09 06:52:43 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:52:43 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:52:43 user nova-compute[72809]:   <metadata>
Aug 09 06:52:43 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:52:43 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:52:43 user nova-compute[72809]:       <nova:name>tempest-AttachVolumeTestJSON-server-450574580</nova:name>
Aug 09 06:52:43 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:52:42</nova:creationTime>
Aug 09 06:52:43 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:52:43 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:52:43 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:52:43 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:52:43 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:52:43 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:52:43 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:52:43 user nova-compute[72809]:       <nova:owner>
Aug 09 06:52:43 user nova-compute[72809]:         <nova:user uuid="87785e8362a14385a951638f4d7cf817">tempest-AttachVolumeTestJSON-1328011883-project-member</nova:user>
Aug 09 06:52:43 user nova-compute[72809]:         <nova:project uuid="55a7945f87914776a3f58bda58b7c90c">tempest-AttachVolumeTestJSON-1328011883</nova:project>
Aug 09 06:52:43 user nova-compute[72809]:       </nova:owner>
Aug 09 06:52:43 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:52:43 user nova-compute[72809]:       <nova:ports>
Aug 09 06:52:43 user nova-compute[72809]:         <nova:port uuid="f12bff80-425f-42ba-804d-540ad751f70c">
Aug 09 06:52:43 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 06:52:43 user nova-compute[72809]:         </nova:port>
Aug 09 06:52:43 user nova-compute[72809]:       </nova:ports>
Aug 09 06:52:43 user nova-compute[72809]:     </nova:instance>
Aug 09 06:52:43 user nova-compute[72809]:   </metadata>
Aug 09 06:52:43 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:52:43 user nova-compute[72809]:     <system>
Aug 09 06:52:43 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:52:43 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:52:43 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:52:43 user nova-compute[72809]:       <entry name="serial">24ba9b41-d0bf-4a84-9f04-bfda9525b154</entry>
Aug 09 06:52:43 user nova-compute[72809]:       <entry name="uuid">24ba9b41-d0bf-4a84-9f04-bfda9525b154</entry>
Aug 09 06:52:43 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:52:43 user nova-compute[72809]:     </system>
Aug 09 06:52:43 user nova-compute[72809]:   </sysinfo>
Aug 09 06:52:43 user nova-compute[72809]:   <os>
Aug 09 06:52:43 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:52:43 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 06:52:43 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:52:43 user nova-compute[72809]:   </os>
Aug 09 06:52:43 user nova-compute[72809]:   <features>
Aug 09 06:52:43 user nova-compute[72809]:     <acpi/>
Aug 09 06:52:43 user nova-compute[72809]:     <apic/>
Aug 09 06:52:43 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:52:43 user nova-compute[72809]:   </features>
Aug 09 06:52:43 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:52:43 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:52:43 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:52:43 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:52:43 user nova-compute[72809]:   </clock>
Aug 09 06:52:43 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:52:43 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:52:43 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:52:43 user nova-compute[72809]:   </cpu>
Aug 09 06:52:43 user nova-compute[72809]:   <devices>
Aug 09 06:52:43 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:52:43 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:52:43 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk"/>
Aug 09 06:52:43 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:52:43 user nova-compute[72809]:     </disk>
Aug 09 06:52:43 user nova-compute[72809]:     <disk type="block" device="disk">
Aug 09 06:52:43 user nova-compute[72809]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:52:43 user nova-compute[72809]:       <source dev="/dev/sdd"/>
Aug 09 06:52:43 user nova-compute[72809]:       <target dev="vdb" bus="virtio"/>
Aug 09 06:52:43 user nova-compute[72809]:       <serial>9764e6f5-4af3-437f-82a0-f0becb06d18c</serial>
Aug 09 06:52:43 user nova-compute[72809]:     </disk>
Aug 09 06:52:43 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:52:43 user nova-compute[72809]:       <mac address="fa:16:3e:36:6c:27"/>
Aug 09 06:52:43 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:52:43 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:52:43 user nova-compute[72809]:       <target dev="tapf12bff80-42"/>
Aug 09 06:52:43 user nova-compute[72809]:     </interface>
Aug 09 06:52:43 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:52:43 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/console.log" append="off"/>
Aug 09 06:52:43 user nova-compute[72809]:     </serial>
Aug 09 06:52:43 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:52:43 user nova-compute[72809]:     <video>
Aug 09 06:52:43 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:52:43 user nova-compute[72809]:     </video>
Aug 09 06:52:43 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:52:43 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:52:43 user nova-compute[72809]:     </rng>
Aug 09 06:52:43 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:52:43 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:52:43 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:52:43 user nova-compute[72809]:     </memballoon>
Aug 09 06:52:43 user nova-compute[72809]:   </devices>
Aug 09 06:52:43 user nova-compute[72809]: </domain>
Aug 09 06:52:43 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:52:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:43 user nova-compute[72809]: INFO nova.compute.resource_tracker [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Updating resource usage from migration 8c283718-c3fd-4750-866b-935bf3a6380a
Aug 09 06:52:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:43 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 06:52:43 user nova-compute[72809]: DEBUG nova.objects.instance [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lazy-loading 'trusted_certs' on Instance uuid 24ba9b41-d0bf-4a84-9f04-bfda9525b154 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:52:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:43 user nova-compute[72809]: DEBUG nova.compute.manager [req-f99d464d-083e-425b-ab34-ec45d9cc371d req-e0c40b78-26ef-4bd1-9ca0-d9d1d34a7c45 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received event network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:52:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f99d464d-083e-425b-ab34-ec45d9cc371d req-e0c40b78-26ef-4bd1-9ca0-d9d1d34a7c45 service nova] Acquiring lock "3640991e-8a5b-4674-af81-3117d4269a68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f99d464d-083e-425b-ab34-ec45d9cc371d req-e0c40b78-26ef-4bd1-9ca0-d9d1d34a7c45 service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f99d464d-083e-425b-ab34-ec45d9cc371d req-e0c40b78-26ef-4bd1-9ca0-d9d1d34a7c45 service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:43 user nova-compute[72809]: DEBUG nova.compute.manager [req-f99d464d-083e-425b-ab34-ec45d9cc371d req-e0c40b78-26ef-4bd1-9ca0-d9d1d34a7c45 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] No waiting events found dispatching network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:52:43 user nova-compute[72809]: WARNING nova.compute.manager [req-f99d464d-083e-425b-ab34-ec45d9cc371d req-e0c40b78-26ef-4bd1-9ca0-d9d1d34a7c45 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received unexpected event network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 for instance with vm_state active and task_state rescuing.
Aug 09 06:52:43 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.143s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Checking if we can resize image /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Removed pending event for 3640991e-8a5b-4674-af81-3117d4269a68 due to event {{(pid=72809) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563964.0561054, 3640991e-8a5b-4674-af81-3117d4269a68 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:52:44 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] VM Resumed (Lifecycle Event)
Aug 09 06:52:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.716s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:44 user nova-compute[72809]: INFO nova.compute.manager [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Migrating
Aug 09 06:52:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG nova.compute.manager [None req-3df4f017-1d0e-480b-83e4-ee1acc8f6ece tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:52:44 user nova-compute[72809]: INFO nova.compute.rpcapi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 09 06:52:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Cannot resize image /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG nova.objects.instance [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lazy-loading 'migration_context' on Instance uuid 24ba9b41-d0bf-4a84-9f04-bfda9525b154 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquiring lock "refresh_cache-15dda080-3487-4316-ab7b-f7185f0a4519" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquired lock "refresh_cache-15dda080-3487-4316-ab7b-f7185f0a4519" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG nova.network.neutron [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:48:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-450574580',display_name='tempest-AttachVolumeTestJSON-server-450574580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-450574580',id=2,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDJ0cgVVGdxmBusvy2LpBlTCELREPHX0PiRGBl4xUaShS+GxBoB6howy4sQdzJp5xGl40sCcx5e/0j2dhekoUvRjUbaKjJ/gVIKho4UvqK2B4IB5h/y1k8THmm8SIXqLw==',key_name='tempest-keypair-1151798744',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:48:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='55a7945f87914776a3f58bda58b7c90c',ramdisk_id='',reservation_id='r-0e3nfuh3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1328011883',owner_user_name='tempest-AttachVolumeTestJSON-1328011883-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:50:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87785e8362a14385a951638f4d7cf817',uuid=24ba9b41-d0bf-4a84-9f04-bfda9525b154,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f12bff80-425f-42ba-804d-540ad751f70c", "address": "fa:16:3e:36:6c:27", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12bff80-42", "ovs_interfaceid": "f12bff80-425f-42ba-804d-540ad751f70c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Converting VIF {"id": "f12bff80-425f-42ba-804d-540ad751f70c", "address": "fa:16:3e:36:6c:27", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12bff80-42", "ovs_interfaceid": "f12bff80-425f-42ba-804d-540ad751f70c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:6c:27,bridge_name='br-int',has_traffic_filtering=True,id=f12bff80-425f-42ba-804d-540ad751f70c,network=Network(3430cb1f-9729-4613-bc8b-0fcdafd88198),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12bff80-42') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG os_vif [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:6c:27,bridge_name='br-int',has_traffic_filtering=True,id=f12bff80-425f-42ba-804d-540ad751f70c,network=Network(3430cb1f-9729-4613-bc8b-0fcdafd88198),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12bff80-42') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf12bff80-42, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf12bff80-42, col_values=(('external_ids', {'iface-id': 'f12bff80-425f-42ba-804d-540ad751f70c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:6c:27', 'vm-uuid': '24ba9b41-d0bf-4a84-9f04-bfda9525b154'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:52:44 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 06:52:44 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563964.0577936, 3640991e-8a5b-4674-af81-3117d4269a68 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:52:44 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] VM Started (Lifecycle Event)
Aug 09 06:52:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:44 user nova-compute[72809]: INFO os_vif [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:6c:27,bridge_name='br-int',has_traffic_filtering=True,id=f12bff80-425f-42ba-804d-540ad751f70c,network=Network(3430cb1f-9729-4613-bc8b-0fcdafd88198),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12bff80-42')
Aug 09 06:52:44 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG nova.network.neutron [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Updating instance_info_cache with network_info: [{"id": "6efe1803-2ae3-490f-8791-c2ba35919f09", "address": "fa:16:3e:a7:75:9f", "network": {"id": "aae92e96-18c4-419a-b1b0-5ab55d8f26c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1926005183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52fb0421f625467a8205b8000a6dcee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efe1803-2a", "ovs_interfaceid": "6efe1803-2ae3-490f-8791-c2ba35919f09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Releasing lock "refresh_cache-15dda080-3487-4316-ab7b-f7185f0a4519" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Starting migrate_disk_and_power_off {{(pid=72809) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:45 user nova-compute[72809]: DEBUG nova.compute.manager [req-51581164-318f-4278-9c9a-bcebed68bf1c req-dba7cf0e-2864-413f-8f4d-d6c3563f5d6e service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Received event network-vif-unplugged-6efe1803-2ae3-490f-8791-c2ba35919f09 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:52:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-51581164-318f-4278-9c9a-bcebed68bf1c req-dba7cf0e-2864-413f-8f4d-d6c3563f5d6e service nova] Acquiring lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-51581164-318f-4278-9c9a-bcebed68bf1c req-dba7cf0e-2864-413f-8f4d-d6c3563f5d6e service nova] Lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-51581164-318f-4278-9c9a-bcebed68bf1c req-dba7cf0e-2864-413f-8f4d-d6c3563f5d6e service nova] Lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:45 user nova-compute[72809]: DEBUG nova.compute.manager [req-51581164-318f-4278-9c9a-bcebed68bf1c req-dba7cf0e-2864-413f-8f4d-d6c3563f5d6e service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] No waiting events found dispatching network-vif-unplugged-6efe1803-2ae3-490f-8791-c2ba35919f09 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:52:45 user nova-compute[72809]: WARNING nova.compute.manager [req-51581164-318f-4278-9c9a-bcebed68bf1c req-dba7cf0e-2864-413f-8f4d-d6c3563f5d6e service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Received unexpected event network-vif-unplugged-6efe1803-2ae3-490f-8791-c2ba35919f09 for instance with vm_state active and task_state resize_migrating.
Aug 09 06:52:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:45 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Instance destroyed successfully.
Aug 09 06:52:45 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:48:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1848436274',display_name='tempest-ServerActionsTestOtherB-server-1848436274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1848436274',id=4,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzddBZQV6rBoKhUSr/KZYr11ADyq1HDaJHBbKwm5pCectYOG8Y/A3xcUayq6O8xK7rSLI08X+2Hg8J2DtxIR/GKq1CHmG5GQromz7rdkcwdeRGHWTQ/2HdiKGS29Oa5Sg==',key_name='tempest-keypair-830185710',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:48:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='52fb0421f625467a8205b8000a6dcee5',ramdisk_id='',reservation_id='r-iw1w1c5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1112762044',owner_user_name='tempest-ServerActionsTestOtherB-1112762044-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:52:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0347074764734e2a8ca3f580efcb1272',uuid=15dda080-3487-4316-ab7b-f7185f0a4519,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6efe1803-2ae3-490f-8791-c2ba35919f09", "address": "fa:16:3e:a7:75:9f", "network": {"id": "aae92e96-18c4-419a-b1b0-5ab55d8f26c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1926005183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1926005183-network", "vif_mac": "fa:16:3e:a7:75:9f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52fb0421f625467a8205b8000a6dcee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efe1803-2a", "ovs_interfaceid": "6efe1803-2ae3-490f-8791-c2ba35919f09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:52:45 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Converting VIF {"id": "6efe1803-2ae3-490f-8791-c2ba35919f09", "address": "fa:16:3e:a7:75:9f", "network": {"id": "aae92e96-18c4-419a-b1b0-5ab55d8f26c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1926005183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1926005183-network", "vif_mac": "fa:16:3e:a7:75:9f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52fb0421f625467a8205b8000a6dcee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efe1803-2a", "ovs_interfaceid": "6efe1803-2ae3-490f-8791-c2ba35919f09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:52:45 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:75:9f,bridge_name='br-int',has_traffic_filtering=True,id=6efe1803-2ae3-490f-8791-c2ba35919f09,network=Network(aae92e96-18c4-419a-b1b0-5ab55d8f26c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efe1803-2a') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:52:45 user nova-compute[72809]: DEBUG os_vif [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:75:9f,bridge_name='br-int',has_traffic_filtering=True,id=6efe1803-2ae3-490f-8791-c2ba35919f09,network=Network(aae92e96-18c4-419a-b1b0-5ab55d8f26c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efe1803-2a') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6efe1803-2a, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:46 user nova-compute[72809]: INFO os_vif [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:75:9f,bridge_name='br-int',has_traffic_filtering=True,id=6efe1803-2ae3-490f-8791-c2ba35919f09,network=Network(aae92e96-18c4-419a-b1b0-5ab55d8f26c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efe1803-2a')
Aug 09 06:52:46 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMtUvsXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:52:46 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:52:46 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68212bb-2a65-4bd8-b5b5-373d17c53d49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f364151c-3fe6-4df3-8c71-b1a004129dbf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:52:46 user nova-compute[72809]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:52:46 user nova-compute[72809]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:52:46 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:52:46 user nova-compute[72809]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:52:46 user nova-compute[72809]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:52:46 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc1586f5510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf'): ({'sdc'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Removing single pathed devices sdc {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce08e52-295d-4fb0-b8ad-1ca7d98e8747]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b899ce-d53d-4046-918a-ecc30b9a2b99]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Flushing IO for device /dev/sdc {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[127567ed-9ebc-4fea-af69-1a3fd6450530]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.099s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bce41d-769a-4ea9-bdef-083ee2037122]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] SCSI volumes sdc have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa25bb5-2dd9-4647-af69-e6b7d9c7e660]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG nova.compute.manager [req-fe332ff2-19dc-4799-965f-622c726d0786 req-f64a3773-c77c-43d7-9119-bae2267fba66 service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Received event network-vif-plugged-f12bff80-425f-42ba-804d-540ad751f70c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-fe332ff2-19dc-4799-965f-622c726d0786 req-f64a3773-c77c-43d7-9119-bae2267fba66 service nova] Acquiring lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-fe332ff2-19dc-4799-965f-622c726d0786 req-f64a3773-c77c-43d7-9119-bae2267fba66 service nova] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-fe332ff2-19dc-4799-965f-622c726d0786 req-f64a3773-c77c-43d7-9119-bae2267fba66 service nova] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG nova.compute.manager [req-fe332ff2-19dc-4799-965f-622c726d0786 req-f64a3773-c77c-43d7-9119-bae2267fba66 service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] No waiting events found dispatching network-vif-plugged-f12bff80-425f-42ba-804d-540ad751f70c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:52:46 user nova-compute[72809]: WARNING nova.compute.manager [req-fe332ff2-19dc-4799-965f-622c726d0786 req-f64a3773-c77c-43d7-9119-bae2267fba66 service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Received unexpected event network-vif-plugged-f12bff80-425f-42ba-804d-540ad751f70c for instance with vm_state stopped and task_state powering-on.
Aug 09 06:52:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --logout" returned: 0 in 0.122s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e66d92d-9cdd-4f08-a74e-962e179cfff6]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf, portal: 172.16.0.220,3260]
Aug 09 06:52:46 user nova-compute[72809]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf, portal: 172.16.0.220,3260] successful.
Aug 09 06:52:46 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3022fdb-3520-4720-95bb-3183828256be]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.450s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] <== disconnect_volume: return (452ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:47 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 06:52:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519_resize/disk /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:47 user nova-compute[72809]: DEBUG nova.compute.manager [req-ad4dce95-0876-4a36-94c4-1d6f94ffed46 req-c179509c-5709-4b87-b7e3-0b9b6c49ee5d service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Received event network-vif-plugged-6efe1803-2ae3-490f-8791-c2ba35919f09 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:52:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ad4dce95-0876-4a36-94c4-1d6f94ffed46 req-c179509c-5709-4b87-b7e3-0b9b6c49ee5d service nova] Acquiring lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ad4dce95-0876-4a36-94c4-1d6f94ffed46 req-c179509c-5709-4b87-b7e3-0b9b6c49ee5d service nova] Lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ad4dce95-0876-4a36-94c4-1d6f94ffed46 req-c179509c-5709-4b87-b7e3-0b9b6c49ee5d service nova] Lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:47 user nova-compute[72809]: DEBUG nova.compute.manager [req-ad4dce95-0876-4a36-94c4-1d6f94ffed46 req-c179509c-5709-4b87-b7e3-0b9b6c49ee5d service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] No waiting events found dispatching network-vif-plugged-6efe1803-2ae3-490f-8791-c2ba35919f09 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:52:47 user nova-compute[72809]: WARNING nova.compute.manager [req-ad4dce95-0876-4a36-94c4-1d6f94ffed46 req-c179509c-5709-4b87-b7e3-0b9b6c49ee5d service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Received unexpected event network-vif-plugged-6efe1803-2ae3-490f-8791-c2ba35919f09 for instance with vm_state active and task_state resize_migrating.
Aug 09 06:52:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] CMD "cp -r /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519_resize/disk /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk" returned: 0 in 0.476s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519_resize/disk.info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk.info {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] CMD "cp -r /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519_resize/disk.info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk.info" returned: 0 in 0.039s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:48 user nova-compute[72809]: DEBUG nova.compute.manager [req-2367c653-e1ae-419c-8b1b-1069f18c07e4 req-aaf49e39-b067-4477-8429-0e9c14b0da42 service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Received event network-vif-plugged-f12bff80-425f-42ba-804d-540ad751f70c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:52:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2367c653-e1ae-419c-8b1b-1069f18c07e4 req-aaf49e39-b067-4477-8429-0e9c14b0da42 service nova] Acquiring lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2367c653-e1ae-419c-8b1b-1069f18c07e4 req-aaf49e39-b067-4477-8429-0e9c14b0da42 service nova] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2367c653-e1ae-419c-8b1b-1069f18c07e4 req-aaf49e39-b067-4477-8429-0e9c14b0da42 service nova] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:48 user nova-compute[72809]: DEBUG nova.compute.manager [req-2367c653-e1ae-419c-8b1b-1069f18c07e4 req-aaf49e39-b067-4477-8429-0e9c14b0da42 service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] No waiting events found dispatching network-vif-plugged-f12bff80-425f-42ba-804d-540ad751f70c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:52:48 user nova-compute[72809]: WARNING nova.compute.manager [req-2367c653-e1ae-419c-8b1b-1069f18c07e4 req-aaf49e39-b067-4477-8429-0e9c14b0da42 service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Received unexpected event network-vif-plugged-f12bff80-425f-42ba-804d-540ad751f70c for instance with vm_state stopped and task_state powering-on.
Aug 09 06:52:48 user nova-compute[72809]: DEBUG nova.network.neutron [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Port 6efe1803-2ae3-490f-8791-c2ba35919f09 binding to destination host user is already ACTIVE {{(pid=72809) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 09 06:52:48 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563968.822915, 24ba9b41-d0bf-4a84-9f04-bfda9525b154 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:52:48 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] VM Resumed (Lifecycle Event)
Aug 09 06:52:48 user nova-compute[72809]: DEBUG nova.compute.manager [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:52:48 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Instance rebooted successfully.
Aug 09 06:52:48 user nova-compute[72809]: DEBUG nova.compute.manager [None req-0ca2a217-dc5f-407a-8cb7-f7418ddfced9 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:52:48 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:52:48 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:52:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquiring lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:48 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 09 06:52:48 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563968.825728, 24ba9b41-d0bf-4a84-9f04-bfda9525b154 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:52:48 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] VM Started (Lifecycle Event)
Aug 09 06:52:48 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:52:49 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:52:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquiring lock "refresh_cache-15dda080-3487-4316-ab7b-f7185f0a4519" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:52:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquired lock "refresh_cache-15dda080-3487-4316-ab7b-f7185f0a4519" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:52:49 user nova-compute[72809]: DEBUG nova.network.neutron [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:52:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Acquiring lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:49 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 06:52:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:49 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 06:52:49 user nova-compute[72809]: INFO nova.compute.claims [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Claim successful on node user
Aug 09 06:52:49 user nova-compute[72809]: DEBUG nova.network.neutron [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Updating instance_info_cache with network_info: [{"id": "6efe1803-2ae3-490f-8791-c2ba35919f09", "address": "fa:16:3e:a7:75:9f", "network": {"id": "aae92e96-18c4-419a-b1b0-5ab55d8f26c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1926005183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52fb0421f625467a8205b8000a6dcee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efe1803-2a", "ovs_interfaceid": "6efe1803-2ae3-490f-8791-c2ba35919f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:52:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Releasing lock "refresh_cache-15dda080-3487-4316-ab7b-f7185f0a4519" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:52:49 user nova-compute[72809]: DEBUG os_brick.utils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:52:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:49 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:52:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:49 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a745038-09ed-44f0-8d07-8cc5828051d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:49 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:52:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:49 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2618b5-3e70-46ad-92a1-2f9dd3f2e0e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.601s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:49 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 06:52:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:49 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4162e4b6-8fe1-45e0-a6c7-eb2acc4f9139]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:49 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54e7b96-0497-4ff9-af39-3cbe14a6b84d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:52:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 06:52:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:52:50 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 06:52:50 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86f030d-1b7b-44ac-9d4d-d8b64582e3b4]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:52:50 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 06:52:50 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 06:52:50 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 06:52:50 user nova-compute[72809]: DEBUG os_brick.utils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:52:50 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 06:52:50 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 06:52:50 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 06:52:50 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 06:52:50 user nova-compute[72809]: DEBUG nova.policy [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7924f8e3d85440b9e826c8c33d3f0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f46d46622964063ba2425358469a36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 06:52:50 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 06:52:50 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 06:52:50 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Creating image(s)
Aug 09 06:52:50 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Acquiring lock "/opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:50 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lock "/opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:50 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lock "/opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.187s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:50 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:50 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.172s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/disk 1073741824" returned: 0 in 0.051s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:50 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.151s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:50 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 06:52:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:51 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Cannot resize image /opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 06:52:51 user nova-compute[72809]: DEBUG nova.objects.instance [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lazy-loading 'migration_context' on Instance uuid c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:52:51 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Successfully created port: 947db6ff-ed42-4aca-a543-a929517ae8e4 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:52:51 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 06:52:51 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Ensure instance console log exists: /opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 06:52:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Successfully updated port: 947db6ff-ed42-4aca-a543-a929517ae8e4 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Acquiring lock "refresh_cache-c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Acquired lock "refresh_cache-c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.compute.manager [req-a2fa404f-d1b2-4d5d-83eb-b2369db987e7 req-ea6e6ba6-d2ac-447b-b4d2-1437eba42b4f service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Received event network-changed-947db6ff-ed42-4aca-a543-a929517ae8e4 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.compute.manager [req-a2fa404f-d1b2-4d5d-83eb-b2369db987e7 req-ea6e6ba6-d2ac-447b-b4d2-1437eba42b4f service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Refreshing instance network info cache due to event network-changed-947db6ff-ed42-4aca-a543-a929517ae8e4. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a2fa404f-d1b2-4d5d-83eb-b2369db987e7 req-ea6e6ba6-d2ac-447b-b4d2-1437eba42b4f service nova] Acquiring lock "refresh_cache-c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Updating instance_info_cache with network_info: [{"id": "947db6ff-ed42-4aca-a543-a929517ae8e4", "address": "fa:16:3e:5d:13:2e", "network": {"id": "1e8ee49b-483d-4c93-839e-c0e80a98012f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1381031589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f46d46622964063ba2425358469a36f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap947db6ff-ed", "ovs_interfaceid": "947db6ff-ed42-4aca-a543-a929517ae8e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Releasing lock "refresh_cache-c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Instance network_info: |[{"id": "947db6ff-ed42-4aca-a543-a929517ae8e4", "address": "fa:16:3e:5d:13:2e", "network": {"id": "1e8ee49b-483d-4c93-839e-c0e80a98012f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1381031589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f46d46622964063ba2425358469a36f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap947db6ff-ed", "ovs_interfaceid": "947db6ff-ed42-4aca-a543-a929517ae8e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a2fa404f-d1b2-4d5d-83eb-b2369db987e7 req-ea6e6ba6-d2ac-447b-b4d2-1437eba42b4f service nova] Acquired lock "refresh_cache-c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.network.neutron [req-a2fa404f-d1b2-4d5d-83eb-b2369db987e7 req-ea6e6ba6-d2ac-447b-b4d2-1437eba42b4f service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Refreshing network info cache for port 947db6ff-ed42-4aca-a543-a929517ae8e4 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Start _get_guest_xml network_info=[{"id": "947db6ff-ed42-4aca-a543-a929517ae8e4", "address": "fa:16:3e:5d:13:2e", "network": {"id": "1e8ee49b-483d-4c93-839e-c0e80a98012f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1381031589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f46d46622964063ba2425358469a36f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap947db6ff-ed", "ovs_interfaceid": "947db6ff-ed42-4aca-a543-a929517ae8e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:52:52 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:52:52 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:52:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1988221204',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1988221204',id=14,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPK9vq6/OkHd2yVdt3nXYH448++2AjnbM8TBYy+YeBzYamc/s5ulP19NzFTO2SUzL2nV3SSIjRSpQ5e91AAsiRiFQ7Uv2icWJyZYAAM4/eghMaXNHw3fgBL4murRC+Qesw==',key_name='tempest-keypair-387388256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f46d46622964063ba2425358469a36f',ramdisk_id='',reservation_id='r-8bvspqp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-722644131',owner_user_name='tempest-TaggedAttachmentsTest-722644131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:52:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7924f8e3d85440b9e826c8c33d3f0dc',uuid=c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "947db6ff-ed42-4aca-a543-a929517ae8e4", "address": "fa:16:3e:5d:13:2e", "network": {"id": "1e8ee49b-483d-4c93-839e-c0e80a98012f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1381031589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f46d46622964063ba2425358469a36f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap947db6ff-ed", "ovs_interfaceid": "947db6ff-ed42-4aca-a543-a929517ae8e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Converting VIF {"id": "947db6ff-ed42-4aca-a543-a929517ae8e4", "address": "fa:16:3e:5d:13:2e", "network": {"id": "1e8ee49b-483d-4c93-839e-c0e80a98012f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1381031589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f46d46622964063ba2425358469a36f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap947db6ff-ed", "ovs_interfaceid": "947db6ff-ed42-4aca-a543-a929517ae8e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:13:2e,bridge_name='br-int',has_traffic_filtering=True,id=947db6ff-ed42-4aca-a543-a929517ae8e4,network=Network(1e8ee49b-483d-4c93-839e-c0e80a98012f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap947db6ff-ed') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.objects.instance [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lazy-loading 'pci_devices' on Instance uuid c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:52:52 user nova-compute[72809]:   <uuid>c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed</uuid>
Aug 09 06:52:52 user nova-compute[72809]:   <name>instance-0000000e</name>
Aug 09 06:52:52 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:52:52 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:52:52 user nova-compute[72809]:   <metadata>
Aug 09 06:52:52 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:52:52 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:52:52 user nova-compute[72809]:       <nova:name>tempest-device-tagging-server-1988221204</nova:name>
Aug 09 06:52:52 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:52:52</nova:creationTime>
Aug 09 06:52:52 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:52:52 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:52:52 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:52:52 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:52:52 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:52:52 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:52:52 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:52:52 user nova-compute[72809]:       <nova:owner>
Aug 09 06:52:52 user nova-compute[72809]:         <nova:user uuid="c7924f8e3d85440b9e826c8c33d3f0dc">tempest-TaggedAttachmentsTest-722644131-project-member</nova:user>
Aug 09 06:52:52 user nova-compute[72809]:         <nova:project uuid="8f46d46622964063ba2425358469a36f">tempest-TaggedAttachmentsTest-722644131</nova:project>
Aug 09 06:52:52 user nova-compute[72809]:       </nova:owner>
Aug 09 06:52:52 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:52:52 user nova-compute[72809]:       <nova:ports>
Aug 09 06:52:52 user nova-compute[72809]:         <nova:port uuid="947db6ff-ed42-4aca-a543-a929517ae8e4">
Aug 09 06:52:52 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 06:52:52 user nova-compute[72809]:         </nova:port>
Aug 09 06:52:52 user nova-compute[72809]:       </nova:ports>
Aug 09 06:52:52 user nova-compute[72809]:     </nova:instance>
Aug 09 06:52:52 user nova-compute[72809]:   </metadata>
Aug 09 06:52:52 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:52:52 user nova-compute[72809]:     <system>
Aug 09 06:52:52 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:52:52 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:52:52 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:52:52 user nova-compute[72809]:       <entry name="serial">c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed</entry>
Aug 09 06:52:52 user nova-compute[72809]:       <entry name="uuid">c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed</entry>
Aug 09 06:52:52 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:52:52 user nova-compute[72809]:     </system>
Aug 09 06:52:52 user nova-compute[72809]:   </sysinfo>
Aug 09 06:52:52 user nova-compute[72809]:   <os>
Aug 09 06:52:52 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:52:52 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 06:52:52 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:52:52 user nova-compute[72809]:   </os>
Aug 09 06:52:52 user nova-compute[72809]:   <features>
Aug 09 06:52:52 user nova-compute[72809]:     <acpi/>
Aug 09 06:52:52 user nova-compute[72809]:     <apic/>
Aug 09 06:52:52 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:52:52 user nova-compute[72809]:   </features>
Aug 09 06:52:52 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:52:52 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:52:52 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:52:52 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:52:52 user nova-compute[72809]:   </clock>
Aug 09 06:52:52 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:52:52 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:52:52 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:52:52 user nova-compute[72809]:   </cpu>
Aug 09 06:52:52 user nova-compute[72809]:   <devices>
Aug 09 06:52:52 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:52:52 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:52:52 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/disk"/>
Aug 09 06:52:52 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:52:52 user nova-compute[72809]:     </disk>
Aug 09 06:52:52 user nova-compute[72809]:     <disk type="file" device="cdrom">
Aug 09 06:52:52 user nova-compute[72809]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 06:52:52 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/disk.config"/>
Aug 09 06:52:52 user nova-compute[72809]:       <target dev="hda" bus="ide"/>
Aug 09 06:52:52 user nova-compute[72809]:     </disk>
Aug 09 06:52:52 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:52:52 user nova-compute[72809]:       <mac address="fa:16:3e:5d:13:2e"/>
Aug 09 06:52:52 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:52:52 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:52:52 user nova-compute[72809]:       <target dev="tap947db6ff-ed"/>
Aug 09 06:52:52 user nova-compute[72809]:     </interface>
Aug 09 06:52:52 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:52:52 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/console.log" append="off"/>
Aug 09 06:52:52 user nova-compute[72809]:     </serial>
Aug 09 06:52:52 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:52:52 user nova-compute[72809]:     <video>
Aug 09 06:52:52 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:52:52 user nova-compute[72809]:     </video>
Aug 09 06:52:52 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:52:52 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:52:52 user nova-compute[72809]:     </rng>
Aug 09 06:52:52 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:52:52 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:52:52 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:52:52 user nova-compute[72809]:     </memballoon>
Aug 09 06:52:52 user nova-compute[72809]:   </devices>
Aug 09 06:52:52 user nova-compute[72809]: </domain>
Aug 09 06:52:52 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:52:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1988221204',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1988221204',id=14,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPK9vq6/OkHd2yVdt3nXYH448++2AjnbM8TBYy+YeBzYamc/s5ulP19NzFTO2SUzL2nV3SSIjRSpQ5e91AAsiRiFQ7Uv2icWJyZYAAM4/eghMaXNHw3fgBL4murRC+Qesw==',key_name='tempest-keypair-387388256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f46d46622964063ba2425358469a36f',ramdisk_id='',reservation_id='r-8bvspqp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-722644131',owner_user_name='tempest-TaggedAttachmentsTest-722644131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:52:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7924f8e3d85440b9e826c8c33d3f0dc',uuid=c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "947db6ff-ed42-4aca-a543-a929517ae8e4", "address": "fa:16:3e:5d:13:2e", "network": {"id": "1e8ee49b-483d-4c93-839e-c0e80a98012f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1381031589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f46d46622964063ba2425358469a36f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap947db6ff-ed", "ovs_interfaceid": "947db6ff-ed42-4aca-a543-a929517ae8e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Converting VIF {"id": "947db6ff-ed42-4aca-a543-a929517ae8e4", "address": "fa:16:3e:5d:13:2e", "network": {"id": "1e8ee49b-483d-4c93-839e-c0e80a98012f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1381031589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f46d46622964063ba2425358469a36f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap947db6ff-ed", "ovs_interfaceid": "947db6ff-ed42-4aca-a543-a929517ae8e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:13:2e,bridge_name='br-int',has_traffic_filtering=True,id=947db6ff-ed42-4aca-a543-a929517ae8e4,network=Network(1e8ee49b-483d-4c93-839e-c0e80a98012f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap947db6ff-ed') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG os_vif [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:13:2e,bridge_name='br-int',has_traffic_filtering=True,id=947db6ff-ed42-4aca-a543-a929517ae8e4,network=Network(1e8ee49b-483d-4c93-839e-c0e80a98012f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap947db6ff-ed') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap947db6ff-ed, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap947db6ff-ed, col_values=(('external_ids', {'iface-id': '947db6ff-ed42-4aca-a543-a929517ae8e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:13:2e', 'vm-uuid': 'c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:52 user nova-compute[72809]: INFO os_vif [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:13:2e,bridge_name='br-int',has_traffic_filtering=True,id=947db6ff-ed42-4aca-a543-a929517ae8e4,network=Network(1e8ee49b-483d-4c93-839e-c0e80a98012f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap947db6ff-ed')
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] No BDM found with device name hda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:52:52 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] No VIF found with MAC fa:16:3e:5d:13:2e, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:52:52 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Using config drive
Aug 09 06:52:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:53 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Creating config drive at /opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/disk.config
Aug 09 06:52:53 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpk0b5_m6n {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:52:53 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpk0b5_m6n" returned: 0 in 0.063s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:52:53 user nova-compute[72809]: DEBUG nova.network.neutron [req-a2fa404f-d1b2-4d5d-83eb-b2369db987e7 req-ea6e6ba6-d2ac-447b-b4d2-1437eba42b4f service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Updated VIF entry in instance network info cache for port 947db6ff-ed42-4aca-a543-a929517ae8e4. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:52:53 user nova-compute[72809]: DEBUG nova.network.neutron [req-a2fa404f-d1b2-4d5d-83eb-b2369db987e7 req-ea6e6ba6-d2ac-447b-b4d2-1437eba42b4f service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Updating instance_info_cache with network_info: [{"id": "947db6ff-ed42-4aca-a543-a929517ae8e4", "address": "fa:16:3e:5d:13:2e", "network": {"id": "1e8ee49b-483d-4c93-839e-c0e80a98012f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1381031589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f46d46622964063ba2425358469a36f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap947db6ff-ed", "ovs_interfaceid": "947db6ff-ed42-4aca-a543-a929517ae8e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:52:53 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a2fa404f-d1b2-4d5d-83eb-b2369db987e7 req-ea6e6ba6-d2ac-447b-b4d2-1437eba42b4f service nova] Releasing lock "refresh_cache-c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:52:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:55 user nova-compute[72809]: DEBUG nova.compute.manager [req-aee39ab7-26b9-4aa1-b294-44b385277315 req-494c74dd-fb24-462d-bc21-35dd4c9aeccb service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Received event network-vif-plugged-947db6ff-ed42-4aca-a543-a929517ae8e4 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:52:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-aee39ab7-26b9-4aa1-b294-44b385277315 req-494c74dd-fb24-462d-bc21-35dd4c9aeccb service nova] Acquiring lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-aee39ab7-26b9-4aa1-b294-44b385277315 req-494c74dd-fb24-462d-bc21-35dd4c9aeccb service nova] Lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-aee39ab7-26b9-4aa1-b294-44b385277315 req-494c74dd-fb24-462d-bc21-35dd4c9aeccb service nova] Lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:55 user nova-compute[72809]: DEBUG nova.compute.manager [req-aee39ab7-26b9-4aa1-b294-44b385277315 req-494c74dd-fb24-462d-bc21-35dd4c9aeccb service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] No waiting events found dispatching network-vif-plugged-947db6ff-ed42-4aca-a543-a929517ae8e4 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:52:55 user nova-compute[72809]: WARNING nova.compute.manager [req-aee39ab7-26b9-4aa1-b294-44b385277315 req-494c74dd-fb24-462d-bc21-35dd4c9aeccb service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Received unexpected event network-vif-plugged-947db6ff-ed42-4aca-a543-a929517ae8e4 for instance with vm_state building and task_state spawning.
Aug 09 06:52:55 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:55 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:57 user nova-compute[72809]: DEBUG nova.compute.manager [req-b0798add-fc40-46cd-ad3e-6753ce662cb5 req-2e83faf4-409f-458d-a6bc-5536031d4e18 service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Received event network-vif-plugged-947db6ff-ed42-4aca-a543-a929517ae8e4 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:52:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b0798add-fc40-46cd-ad3e-6753ce662cb5 req-2e83faf4-409f-458d-a6bc-5536031d4e18 service nova] Acquiring lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:52:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b0798add-fc40-46cd-ad3e-6753ce662cb5 req-2e83faf4-409f-458d-a6bc-5536031d4e18 service nova] Lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:52:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b0798add-fc40-46cd-ad3e-6753ce662cb5 req-2e83faf4-409f-458d-a6bc-5536031d4e18 service nova] Lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:57 user nova-compute[72809]: DEBUG nova.compute.manager [req-b0798add-fc40-46cd-ad3e-6753ce662cb5 req-2e83faf4-409f-458d-a6bc-5536031d4e18 service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] No waiting events found dispatching network-vif-plugged-947db6ff-ed42-4aca-a543-a929517ae8e4 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:52:57 user nova-compute[72809]: WARNING nova.compute.manager [req-b0798add-fc40-46cd-ad3e-6753ce662cb5 req-2e83faf4-409f-458d-a6bc-5536031d4e18 service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Received unexpected event network-vif-plugged-947db6ff-ed42-4aca-a543-a929517ae8e4 for instance with vm_state building and task_state spawning.
Aug 09 06:52:57 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563977.3446376, c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:52:57 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] VM Resumed (Lifecycle Event)
Aug 09 06:52:57 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:52:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 06:52:57 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Instance spawned successfully.
Aug 09 06:52:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 06:52:57 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:52:57 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:52:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:52:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:52:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:52:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:52:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:52:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:52:57 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:52:57 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563977.3449786, c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:52:57 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] VM Started (Lifecycle Event)
Aug 09 06:52:57 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:52:57 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:52:57 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:52:57 user nova-compute[72809]: INFO nova.compute.manager [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Took 7.22 seconds to spawn the instance on the hypervisor.
Aug 09 06:52:57 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:52:57 user nova-compute[72809]: INFO nova.compute.manager [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Took 8.37 seconds to build instance.
Aug 09 06:52:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ab0c39ef-6555-4e54-8de9-53cb1ce10a90 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.491s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:52:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:52:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:00 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Starting finish_migration {{(pid=72809) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 09 06:53:00 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Instance directory exists: not creating {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 06:53:00 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Creating image(s)
Aug 09 06:53:00 user nova-compute[72809]: DEBUG nova.objects.instance [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lazy-loading 'trusted_certs' on Instance uuid 15dda080-3487-4316-ab7b-f7185f0a4519 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:53:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.179s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:00 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Checking if we can resize image /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk. size=21474836480 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 06:53:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691563965.9696686, 15dda080-3487-4316-ab7b-f7185f0a4519 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:53:01 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] VM Stopped (Lifecycle Event)
Aug 09 06:53:01 user nova-compute[72809]: DEBUG nova.compute.manager [None req-8d79a44d-5b23-4a99-8e25-75ac3f3da51a None None] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG nova.compute.manager [None req-8d79a44d-5b23-4a99-8e25-75ac3f3da51a None None] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:53:01 user nova-compute[72809]: INFO nova.compute.manager [None req-8d79a44d-5b23-4a99-8e25-75ac3f3da51a None None] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk 21474836480 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk 21474836480" returned: 0 in 0.085s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Did not create local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Ensure instance console log exists: /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Start _get_guest_xml network_info=[{"id": "6efe1803-2ae3-490f-8791-c2ba35919f09", "address": "fa:16:3e:a7:75:9f", "network": {"id": "aae92e96-18c4-419a-b1b0-5ab55d8f26c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1926005183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1926005183-network", "vif_mac": "fa:16:3e:a7:75:9f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52fb0421f625467a8205b8000a6dcee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efe1803-2a", "ovs_interfaceid": "6efe1803-2ae3-490f-8791-c2ba35919f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMtUvsXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '15dda080-3487-4316-ab7b-f7185f0a4519', 'attached_at': '2023-08-09T06:53:01.000000', 'detached_at': '', 'volume_id': '521a87a6-3612-4fe2-ba75-ffa77601e8bf', 'serial': '521a87a6-3612-4fe2-ba75-ffa77601e8bf'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': None, 'attachment_id': '8fac4b94-b677-4064-aaf8-97a932d17d54', 'volume_type': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:53:01 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:53:01 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:53:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG nova.objects.instance [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lazy-loading 'vcpu_model' on Instance uuid 15dda080-3487-4316-ab7b-f7185f0a4519 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMtUvsXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:53:01 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:53:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:53:01 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:53:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:53:01 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb620791-ddbf-4a2a-b05c-2b0e66de9182]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 06:53:01 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[56673771-160d-48de-bcf8-ee517462586d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf] added
Aug 09 06:53:01 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.136s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a5609d-1752-450d-aad5-fe6957ed3e71]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ae7255-efd9-4b14-adb5-dc3881970789]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zMtUvsXI {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zMtUvsXI" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb783a0-2584-4f24-8304-1a886690e2e6]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zMtUvsXI'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[afec1f09-9ab3-4e38-a65f-60591c79e2a7]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0744771b-5129-4102-a0a9-639712dcbab0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:53:01 user nova-compute[72809]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:53:01 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:53:01 user nova-compute[72809]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:53:01 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73159e9-7d70-4b11-85ea-19921a8883cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf, portal: 172.16.0.220,3260]
Aug 09 06:53:01 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf, portal: 172.16.0.220,3260] successful.
Aug 09 06:53:01 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa075a5-314f-4fc4-9a6e-63c4c82a7f61]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ae62d6-da15-4fe6-9173-a8ac5356397a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:53:01 user nova-compute[72809]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:53:01 user nova-compute[72809]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:53:01 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:53:01 user nova-compute[72809]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:53:01 user nova-compute[72809]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:53:01 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.441s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] HCTL ('34', '-', '-', 0) found on session 13 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0fa591-8251-4b6e-ae49-f678c380eb8c]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 06:53:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMtUvsXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 06:53:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:02 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.484s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:53:02 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] <== connect_volume: return (1486ms) {'type': 'block', 'scsi_wwn': '26334623733663261', 'path': '/dev/sdc'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:53:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334623733663261', 'path': '/dev/sdc'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 06:53:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:48:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1848436274',display_name='tempest-ServerActionsTestOtherB-server-1848436274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1848436274',id=4,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzddBZQV6rBoKhUSr/KZYr11ADyq1HDaJHBbKwm5pCectYOG8Y/A3xcUayq6O8xK7rSLI08X+2Hg8J2DtxIR/GKq1CHmG5GQromz7rdkcwdeRGHWTQ/2HdiKGS29Oa5Sg==',key_name='tempest-keypair-830185710',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:48:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='52fb0421f625467a8205b8000a6dcee5',ramdisk_id='',reservation_id='r-iw1w1c5y',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1112762044',owner_user_name='tempest-ServerActionsTestOtherB-1112762044-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:52:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0347074764734e2a8ca3f580efcb1272',uuid=15dda080-3487-4316-ab7b-f7185f0a4519,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6efe1803-2ae3-490f-8791-c2ba35919f09", "address": "fa:16:3e:a7:75:9f", "network": {"id": "aae92e96-18c4-419a-b1b0-5ab55d8f26c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1926005183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1926005183-network", "vif_mac": "fa:16:3e:a7:75:9f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52fb0421f625467a8205b8000a6dcee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efe1803-2a", "ovs_interfaceid": "6efe1803-2ae3-490f-8791-c2ba35919f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:53:02 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Converting VIF {"id": "6efe1803-2ae3-490f-8791-c2ba35919f09", "address": "fa:16:3e:a7:75:9f", "network": {"id": "aae92e96-18c4-419a-b1b0-5ab55d8f26c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1926005183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1926005183-network", "vif_mac": "fa:16:3e:a7:75:9f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52fb0421f625467a8205b8000a6dcee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efe1803-2a", "ovs_interfaceid": "6efe1803-2ae3-490f-8791-c2ba35919f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:53:02 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:75:9f,bridge_name='br-int',has_traffic_filtering=True,id=6efe1803-2ae3-490f-8791-c2ba35919f09,network=Network(aae92e96-18c4-419a-b1b0-5ab55d8f26c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efe1803-2a') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:53:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:53:02 user nova-compute[72809]:   <uuid>15dda080-3487-4316-ab7b-f7185f0a4519</uuid>
Aug 09 06:53:02 user nova-compute[72809]:   <name>instance-00000004</name>
Aug 09 06:53:02 user nova-compute[72809]:   <memory>2097152</memory>
Aug 09 06:53:02 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:53:02 user nova-compute[72809]:   <metadata>
Aug 09 06:53:02 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:53:02 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:53:02 user nova-compute[72809]:       <nova:name>tempest-ServerActionsTestOtherB-server-1848436274</nova:name>
Aug 09 06:53:02 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:53:01</nova:creationTime>
Aug 09 06:53:02 user nova-compute[72809]:       <nova:flavor name="m1.small">
Aug 09 06:53:02 user nova-compute[72809]:         <nova:memory>2048</nova:memory>
Aug 09 06:53:02 user nova-compute[72809]:         <nova:disk>20</nova:disk>
Aug 09 06:53:02 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:53:02 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:53:02 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:53:02 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:53:02 user nova-compute[72809]:       <nova:owner>
Aug 09 06:53:02 user nova-compute[72809]:         <nova:user uuid="0347074764734e2a8ca3f580efcb1272">tempest-ServerActionsTestOtherB-1112762044-project-member</nova:user>
Aug 09 06:53:02 user nova-compute[72809]:         <nova:project uuid="52fb0421f625467a8205b8000a6dcee5">tempest-ServerActionsTestOtherB-1112762044</nova:project>
Aug 09 06:53:02 user nova-compute[72809]:       </nova:owner>
Aug 09 06:53:02 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:53:02 user nova-compute[72809]:       <nova:ports>
Aug 09 06:53:02 user nova-compute[72809]:         <nova:port uuid="6efe1803-2ae3-490f-8791-c2ba35919f09">
Aug 09 06:53:02 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 06:53:02 user nova-compute[72809]:         </nova:port>
Aug 09 06:53:02 user nova-compute[72809]:       </nova:ports>
Aug 09 06:53:02 user nova-compute[72809]:     </nova:instance>
Aug 09 06:53:02 user nova-compute[72809]:   </metadata>
Aug 09 06:53:02 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:53:02 user nova-compute[72809]:     <system>
Aug 09 06:53:02 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:53:02 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:53:02 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:53:02 user nova-compute[72809]:       <entry name="serial">15dda080-3487-4316-ab7b-f7185f0a4519</entry>
Aug 09 06:53:02 user nova-compute[72809]:       <entry name="uuid">15dda080-3487-4316-ab7b-f7185f0a4519</entry>
Aug 09 06:53:02 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:53:02 user nova-compute[72809]:     </system>
Aug 09 06:53:02 user nova-compute[72809]:   </sysinfo>
Aug 09 06:53:02 user nova-compute[72809]:   <os>
Aug 09 06:53:02 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:53:02 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 06:53:02 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:53:02 user nova-compute[72809]:   </os>
Aug 09 06:53:02 user nova-compute[72809]:   <features>
Aug 09 06:53:02 user nova-compute[72809]:     <acpi/>
Aug 09 06:53:02 user nova-compute[72809]:     <apic/>
Aug 09 06:53:02 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:53:02 user nova-compute[72809]:   </features>
Aug 09 06:53:02 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:53:02 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:53:02 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:53:02 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:53:02 user nova-compute[72809]:   </clock>
Aug 09 06:53:02 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:53:02 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:53:02 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:53:02 user nova-compute[72809]:   </cpu>
Aug 09 06:53:02 user nova-compute[72809]:   <devices>
Aug 09 06:53:02 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:53:02 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:53:02 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk"/>
Aug 09 06:53:02 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:53:02 user nova-compute[72809]:     </disk>
Aug 09 06:53:02 user nova-compute[72809]:     <disk type="block" device="disk">
Aug 09 06:53:02 user nova-compute[72809]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:53:02 user nova-compute[72809]:       <source dev="/dev/sdc"/>
Aug 09 06:53:02 user nova-compute[72809]:       <target dev="vdb" bus="virtio"/>
Aug 09 06:53:02 user nova-compute[72809]:       <serial>521a87a6-3612-4fe2-ba75-ffa77601e8bf</serial>
Aug 09 06:53:02 user nova-compute[72809]:     </disk>
Aug 09 06:53:02 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:53:02 user nova-compute[72809]:       <mac address="fa:16:3e:a7:75:9f"/>
Aug 09 06:53:02 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:53:02 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:53:02 user nova-compute[72809]:       <target dev="tap6efe1803-2a"/>
Aug 09 06:53:02 user nova-compute[72809]:     </interface>
Aug 09 06:53:02 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:53:02 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/console.log" append="off"/>
Aug 09 06:53:02 user nova-compute[72809]:     </serial>
Aug 09 06:53:02 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:53:02 user nova-compute[72809]:     <video>
Aug 09 06:53:02 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:53:02 user nova-compute[72809]:     </video>
Aug 09 06:53:02 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:53:02 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:53:02 user nova-compute[72809]:     </rng>
Aug 09 06:53:02 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:53:02 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:53:02 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:53:02 user nova-compute[72809]:     </memballoon>
Aug 09 06:53:02 user nova-compute[72809]:   </devices>
Aug 09 06:53:02 user nova-compute[72809]: </domain>
Aug 09 06:53:02 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:53:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:48:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1848436274',display_name='tempest-ServerActionsTestOtherB-server-1848436274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1848436274',id=4,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzddBZQV6rBoKhUSr/KZYr11ADyq1HDaJHBbKwm5pCectYOG8Y/A3xcUayq6O8xK7rSLI08X+2Hg8J2DtxIR/GKq1CHmG5GQromz7rdkcwdeRGHWTQ/2HdiKGS29Oa5Sg==',key_name='tempest-keypair-830185710',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:48:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='52fb0421f625467a8205b8000a6dcee5',ramdisk_id='',reservation_id='r-iw1w1c5y',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1112762044',owner_user_name='tempest-ServerActionsTestOtherB-1112762044-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:52:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0347074764734e2a8ca3f580efcb1272',uuid=15dda080-3487-4316-ab7b-f7185f0a4519,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6efe1803-2ae3-490f-8791-c2ba35919f09", "address": "fa:16:3e:a7:75:9f", "network": {"id": "aae92e96-18c4-419a-b1b0-5ab55d8f26c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1926005183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1926005183-network", "vif_mac": "fa:16:3e:a7:75:9f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52fb0421f625467a8205b8000a6dcee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efe1803-2a", "ovs_interfaceid": "6efe1803-2ae3-490f-8791-c2ba35919f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:53:02 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Converting VIF {"id": "6efe1803-2ae3-490f-8791-c2ba35919f09", "address": "fa:16:3e:a7:75:9f", "network": {"id": "aae92e96-18c4-419a-b1b0-5ab55d8f26c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1926005183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1926005183-network", "vif_mac": "fa:16:3e:a7:75:9f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52fb0421f625467a8205b8000a6dcee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efe1803-2a", "ovs_interfaceid": "6efe1803-2ae3-490f-8791-c2ba35919f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:53:02 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:75:9f,bridge_name='br-int',has_traffic_filtering=True,id=6efe1803-2ae3-490f-8791-c2ba35919f09,network=Network(aae92e96-18c4-419a-b1b0-5ab55d8f26c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efe1803-2a') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:53:02 user nova-compute[72809]: DEBUG os_vif [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:75:9f,bridge_name='br-int',has_traffic_filtering=True,id=6efe1803-2ae3-490f-8791-c2ba35919f09,network=Network(aae92e96-18c4-419a-b1b0-5ab55d8f26c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efe1803-2a') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:53:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:53:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:53:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6efe1803-2a, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:53:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6efe1803-2a, col_values=(('external_ids', {'iface-id': '6efe1803-2ae3-490f-8791-c2ba35919f09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:75:9f', 'vm-uuid': '15dda080-3487-4316-ab7b-f7185f0a4519'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:53:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:53:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:02 user nova-compute[72809]: INFO os_vif [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:75:9f,bridge_name='br-int',has_traffic_filtering=True,id=6efe1803-2ae3-490f-8791-c2ba35919f09,network=Network(aae92e96-18c4-419a-b1b0-5ab55d8f26c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efe1803-2a')
Aug 09 06:53:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:53:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:53:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] No VIF found with MAC fa:16:3e:a7:75:9f, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:53:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Acquiring lock "1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:53:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lock "1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:53:04 user nova-compute[72809]: DEBUG nova.compute.manager [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 06:53:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:53:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:53:04 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 06:53:04 user nova-compute[72809]: INFO nova.compute.claims [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Claim successful on node user
Aug 09 06:53:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:05 user nova-compute[72809]: DEBUG nova.compute.manager [req-2f18bd88-5e69-4b71-8eae-e413b2dbcabc req-f054e501-f775-4a3c-b57f-7a42e2a6c416 service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Received event network-vif-plugged-6efe1803-2ae3-490f-8791-c2ba35919f09 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:53:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2f18bd88-5e69-4b71-8eae-e413b2dbcabc req-f054e501-f775-4a3c-b57f-7a42e2a6c416 service nova] Acquiring lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:53:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2f18bd88-5e69-4b71-8eae-e413b2dbcabc req-f054e501-f775-4a3c-b57f-7a42e2a6c416 service nova] Lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:53:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2f18bd88-5e69-4b71-8eae-e413b2dbcabc req-f054e501-f775-4a3c-b57f-7a42e2a6c416 service nova] Lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:53:05 user nova-compute[72809]: DEBUG nova.compute.manager [req-2f18bd88-5e69-4b71-8eae-e413b2dbcabc req-f054e501-f775-4a3c-b57f-7a42e2a6c416 service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] No waiting events found dispatching network-vif-plugged-6efe1803-2ae3-490f-8791-c2ba35919f09 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:53:05 user nova-compute[72809]: WARNING nova.compute.manager [req-2f18bd88-5e69-4b71-8eae-e413b2dbcabc req-f054e501-f775-4a3c-b57f-7a42e2a6c416 service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Received unexpected event network-vif-plugged-6efe1803-2ae3-490f-8791-c2ba35919f09 for instance with vm_state active and task_state resize_finish.
Aug 09 06:53:05 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:53:05 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:53:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.806s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:53:05 user nova-compute[72809]: DEBUG nova.compute.manager [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 06:53:05 user nova-compute[72809]: DEBUG nova.compute.manager [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 06:53:05 user nova-compute[72809]: DEBUG nova.network.neutron [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 06:53:05 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 06:53:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:05 user nova-compute[72809]: DEBUG nova.compute.manager [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 06:53:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:05 user nova-compute[72809]: DEBUG nova.policy [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f0a431477454b8aa0006b5d06cd53b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7448d7b10a924d5cbd60f6276224a8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 06:53:05 user nova-compute[72809]: DEBUG nova.compute.manager [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 06:53:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 06:53:05 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Creating image(s)
Aug 09 06:53:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:53:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lock "/opt/stack/data/nova/instances/1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:53:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lock "/opt/stack/data/nova/instances/1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:53:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.147s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:53:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:53:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.183s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8/disk 1073741824" returned: 0 in 0.083s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:53:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.170s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:06 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 06:53:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:06 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Cannot resize image /opt/stack/data/nova/instances/1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 06:53:06 user nova-compute[72809]: DEBUG nova.objects.instance [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lazy-loading 'migration_context' on Instance uuid 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:53:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 06:53:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Ensure instance console log exists: /opt/stack/data/nova/instances/1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 06:53:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:53:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:53:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:53:06 user nova-compute[72809]: DEBUG nova.network.neutron [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Successfully created port: be2444ce-562d-44c8-9707-4908e0f8cc4a {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:53:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-6e1f72b1-cd69-469d-8163-dcce10175020 req-b9ac8fc2-0407-4944-8aa4-bf304ae3d6bd service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Received event network-vif-plugged-6efe1803-2ae3-490f-8791-c2ba35919f09 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:53:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6e1f72b1-cd69-469d-8163-dcce10175020 req-b9ac8fc2-0407-4944-8aa4-bf304ae3d6bd service nova] Acquiring lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:53:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6e1f72b1-cd69-469d-8163-dcce10175020 req-b9ac8fc2-0407-4944-8aa4-bf304ae3d6bd service nova] Lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:53:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6e1f72b1-cd69-469d-8163-dcce10175020 req-b9ac8fc2-0407-4944-8aa4-bf304ae3d6bd service nova] Lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:53:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-6e1f72b1-cd69-469d-8163-dcce10175020 req-b9ac8fc2-0407-4944-8aa4-bf304ae3d6bd service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] No waiting events found dispatching network-vif-plugged-6efe1803-2ae3-490f-8791-c2ba35919f09 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:53:07 user nova-compute[72809]: WARNING nova.compute.manager [req-6e1f72b1-cd69-469d-8163-dcce10175020 req-b9ac8fc2-0407-4944-8aa4-bf304ae3d6bd service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Received unexpected event network-vif-plugged-6efe1803-2ae3-490f-8791-c2ba35919f09 for instance with vm_state active and task_state resize_finish.
Aug 09 06:53:07 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563987.289786, 15dda080-3487-4316-ab7b-f7185f0a4519 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:53:07 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] VM Resumed (Lifecycle Event)
Aug 09 06:53:07 user nova-compute[72809]: DEBUG nova.compute.manager [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:53:07 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Instance running successfully.
Aug 09 06:53:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Failed to set time: agent not configured {{(pid=72809) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 09 06:53:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a65d206d-f2f4-49f2-a0f1-748f655f98c8 tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] finish_migration finished successfully. {{(pid=72809) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 09 06:53:07 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:53:07 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:53:07 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 06:53:07 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563987.2958813, 15dda080-3487-4316-ab7b-f7185f0a4519 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:53:07 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] VM Started (Lifecycle Event)
Aug 09 06:53:07 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:53:07 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:53:07 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 06:53:07 user nova-compute[72809]: DEBUG nova.network.neutron [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Successfully updated port: be2444ce-562d-44c8-9707-4908e0f8cc4a {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:53:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Acquiring lock "refresh_cache-1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:53:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Acquired lock "refresh_cache-1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:53:07 user nova-compute[72809]: DEBUG nova.network.neutron [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:53:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-66f98937-b062-456a-a4d2-310682c7b6bb req-f8ece314-4924-4bd3-b11d-d1a7bd72b6b3 service nova] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Received event network-changed-be2444ce-562d-44c8-9707-4908e0f8cc4a {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:53:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-66f98937-b062-456a-a4d2-310682c7b6bb req-f8ece314-4924-4bd3-b11d-d1a7bd72b6b3 service nova] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Refreshing instance network info cache due to event network-changed-be2444ce-562d-44c8-9707-4908e0f8cc4a. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:53:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-66f98937-b062-456a-a4d2-310682c7b6bb req-f8ece314-4924-4bd3-b11d-d1a7bd72b6b3 service nova] Acquiring lock "refresh_cache-1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:53:07 user nova-compute[72809]: DEBUG nova.network.neutron [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:53:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG nova.network.neutron [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Updating instance_info_cache with network_info: [{"id": "be2444ce-562d-44c8-9707-4908e0f8cc4a", "address": "fa:16:3e:6b:40:c4", "network": {"id": "66bd3e40-f19b-4145-baaf-8eab9760324a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1038504284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7448d7b10a924d5cbd60f6276224a8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe2444ce-56", "ovs_interfaceid": "be2444ce-562d-44c8-9707-4908e0f8cc4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Releasing lock "refresh_cache-1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG nova.compute.manager [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Instance network_info: |[{"id": "be2444ce-562d-44c8-9707-4908e0f8cc4a", "address": "fa:16:3e:6b:40:c4", "network": {"id": "66bd3e40-f19b-4145-baaf-8eab9760324a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1038504284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7448d7b10a924d5cbd60f6276224a8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe2444ce-56", "ovs_interfaceid": "be2444ce-562d-44c8-9707-4908e0f8cc4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-66f98937-b062-456a-a4d2-310682c7b6bb req-f8ece314-4924-4bd3-b11d-d1a7bd72b6b3 service nova] Acquired lock "refresh_cache-1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG nova.network.neutron [req-66f98937-b062-456a-a4d2-310682c7b6bb req-f8ece314-4924-4bd3-b11d-d1a7bd72b6b3 service nova] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Refreshing network info cache for port be2444ce-562d-44c8-9707-4908e0f8cc4a {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Start _get_guest_xml network_info=[{"id": "be2444ce-562d-44c8-9707-4908e0f8cc4a", "address": "fa:16:3e:6b:40:c4", "network": {"id": "66bd3e40-f19b-4145-baaf-8eab9760324a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1038504284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7448d7b10a924d5cbd60f6276224a8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe2444ce-56", "ovs_interfaceid": "be2444ce-562d-44c8-9707-4908e0f8cc4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:53:08 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:53:08 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:53:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:53:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1530198571',display_name='tempest-VolumesActionsTest-instance-1530198571',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1530198571',id=15,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7448d7b10a924d5cbd60f6276224a8cc',ramdisk_id='',reservation_id='r-yhg16q1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-812095692',owner_user_name='tempest-VolumesActionsTest-812095692-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:53:06Z,user_data=None,user_id='4f0a431477454b8aa0006b5d06cd53b2',uuid=1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be2444ce-562d-44c8-9707-4908e0f8cc4a", "address": "fa:16:3e:6b:40:c4", "network": {"id": "66bd3e40-f19b-4145-baaf-8eab9760324a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1038504284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7448d7b10a924d5cbd60f6276224a8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe2444ce-56", "ovs_interfaceid": "be2444ce-562d-44c8-9707-4908e0f8cc4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Converting VIF {"id": "be2444ce-562d-44c8-9707-4908e0f8cc4a", "address": "fa:16:3e:6b:40:c4", "network": {"id": "66bd3e40-f19b-4145-baaf-8eab9760324a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1038504284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7448d7b10a924d5cbd60f6276224a8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe2444ce-56", "ovs_interfaceid": "be2444ce-562d-44c8-9707-4908e0f8cc4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:40:c4,bridge_name='br-int',has_traffic_filtering=True,id=be2444ce-562d-44c8-9707-4908e0f8cc4a,network=Network(66bd3e40-f19b-4145-baaf-8eab9760324a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe2444ce-56') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG nova.objects.instance [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:53:08 user nova-compute[72809]:   <uuid>1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8</uuid>
Aug 09 06:53:08 user nova-compute[72809]:   <name>instance-0000000f</name>
Aug 09 06:53:08 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:53:08 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:53:08 user nova-compute[72809]:   <metadata>
Aug 09 06:53:08 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:53:08 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:53:08 user nova-compute[72809]:       <nova:name>tempest-VolumesActionsTest-instance-1530198571</nova:name>
Aug 09 06:53:08 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:53:08</nova:creationTime>
Aug 09 06:53:08 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:53:08 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:53:08 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:53:08 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:53:08 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:53:08 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:53:08 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:53:08 user nova-compute[72809]:       <nova:owner>
Aug 09 06:53:08 user nova-compute[72809]:         <nova:user uuid="4f0a431477454b8aa0006b5d06cd53b2">tempest-VolumesActionsTest-812095692-project-member</nova:user>
Aug 09 06:53:08 user nova-compute[72809]:         <nova:project uuid="7448d7b10a924d5cbd60f6276224a8cc">tempest-VolumesActionsTest-812095692</nova:project>
Aug 09 06:53:08 user nova-compute[72809]:       </nova:owner>
Aug 09 06:53:08 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:53:08 user nova-compute[72809]:       <nova:ports>
Aug 09 06:53:08 user nova-compute[72809]:         <nova:port uuid="be2444ce-562d-44c8-9707-4908e0f8cc4a">
Aug 09 06:53:08 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 06:53:08 user nova-compute[72809]:         </nova:port>
Aug 09 06:53:08 user nova-compute[72809]:       </nova:ports>
Aug 09 06:53:08 user nova-compute[72809]:     </nova:instance>
Aug 09 06:53:08 user nova-compute[72809]:   </metadata>
Aug 09 06:53:08 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:53:08 user nova-compute[72809]:     <system>
Aug 09 06:53:08 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:53:08 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:53:08 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:53:08 user nova-compute[72809]:       <entry name="serial">1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8</entry>
Aug 09 06:53:08 user nova-compute[72809]:       <entry name="uuid">1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8</entry>
Aug 09 06:53:08 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:53:08 user nova-compute[72809]:     </system>
Aug 09 06:53:08 user nova-compute[72809]:   </sysinfo>
Aug 09 06:53:08 user nova-compute[72809]:   <os>
Aug 09 06:53:08 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:53:08 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 06:53:08 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:53:08 user nova-compute[72809]:   </os>
Aug 09 06:53:08 user nova-compute[72809]:   <features>
Aug 09 06:53:08 user nova-compute[72809]:     <acpi/>
Aug 09 06:53:08 user nova-compute[72809]:     <apic/>
Aug 09 06:53:08 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:53:08 user nova-compute[72809]:   </features>
Aug 09 06:53:08 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:53:08 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:53:08 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:53:08 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:53:08 user nova-compute[72809]:   </clock>
Aug 09 06:53:08 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:53:08 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:53:08 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:53:08 user nova-compute[72809]:   </cpu>
Aug 09 06:53:08 user nova-compute[72809]:   <devices>
Aug 09 06:53:08 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:53:08 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:53:08 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8/disk"/>
Aug 09 06:53:08 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:53:08 user nova-compute[72809]:     </disk>
Aug 09 06:53:08 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:53:08 user nova-compute[72809]:       <mac address="fa:16:3e:6b:40:c4"/>
Aug 09 06:53:08 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:53:08 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:53:08 user nova-compute[72809]:       <target dev="tapbe2444ce-56"/>
Aug 09 06:53:08 user nova-compute[72809]:     </interface>
Aug 09 06:53:08 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:53:08 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8/console.log" append="off"/>
Aug 09 06:53:08 user nova-compute[72809]:     </serial>
Aug 09 06:53:08 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:53:08 user nova-compute[72809]:     <video>
Aug 09 06:53:08 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:53:08 user nova-compute[72809]:     </video>
Aug 09 06:53:08 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:53:08 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:53:08 user nova-compute[72809]:     </rng>
Aug 09 06:53:08 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:53:08 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:53:08 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:53:08 user nova-compute[72809]:     </memballoon>
Aug 09 06:53:08 user nova-compute[72809]:   </devices>
Aug 09 06:53:08 user nova-compute[72809]: </domain>
Aug 09 06:53:08 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:53:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1530198571',display_name='tempest-VolumesActionsTest-instance-1530198571',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1530198571',id=15,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7448d7b10a924d5cbd60f6276224a8cc',ramdisk_id='',reservation_id='r-yhg16q1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-812095692',owner_user_name='tempest-VolumesActionsTest-812095692-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:53:06Z,user_data=None,user_id='4f0a431477454b8aa0006b5d06cd53b2',uuid=1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be2444ce-562d-44c8-9707-4908e0f8cc4a", "address": "fa:16:3e:6b:40:c4", "network": {"id": "66bd3e40-f19b-4145-baaf-8eab9760324a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1038504284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7448d7b10a924d5cbd60f6276224a8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe2444ce-56", "ovs_interfaceid": "be2444ce-562d-44c8-9707-4908e0f8cc4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Converting VIF {"id": "be2444ce-562d-44c8-9707-4908e0f8cc4a", "address": "fa:16:3e:6b:40:c4", "network": {"id": "66bd3e40-f19b-4145-baaf-8eab9760324a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1038504284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7448d7b10a924d5cbd60f6276224a8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe2444ce-56", "ovs_interfaceid": "be2444ce-562d-44c8-9707-4908e0f8cc4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:40:c4,bridge_name='br-int',has_traffic_filtering=True,id=be2444ce-562d-44c8-9707-4908e0f8cc4a,network=Network(66bd3e40-f19b-4145-baaf-8eab9760324a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe2444ce-56') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG os_vif [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:40:c4,bridge_name='br-int',has_traffic_filtering=True,id=be2444ce-562d-44c8-9707-4908e0f8cc4a,network=Network(66bd3e40-f19b-4145-baaf-8eab9760324a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe2444ce-56') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe2444ce-56, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbe2444ce-56, col_values=(('external_ids', {'iface-id': 'be2444ce-562d-44c8-9707-4908e0f8cc4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:40:c4', 'vm-uuid': '1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:08 user nova-compute[72809]: INFO os_vif [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:40:c4,bridge_name='br-int',has_traffic_filtering=True,id=be2444ce-562d-44c8-9707-4908e0f8cc4a,network=Network(66bd3e40-f19b-4145-baaf-8eab9760324a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe2444ce-56')
Aug 09 06:53:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] No VIF found with MAC fa:16:3e:6b:40:c4, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG nova.network.neutron [req-66f98937-b062-456a-a4d2-310682c7b6bb req-f8ece314-4924-4bd3-b11d-d1a7bd72b6b3 service nova] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Updated VIF entry in instance network info cache for port be2444ce-562d-44c8-9707-4908e0f8cc4a. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG nova.network.neutron [req-66f98937-b062-456a-a4d2-310682c7b6bb req-f8ece314-4924-4bd3-b11d-d1a7bd72b6b3 service nova] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Updating instance_info_cache with network_info: [{"id": "be2444ce-562d-44c8-9707-4908e0f8cc4a", "address": "fa:16:3e:6b:40:c4", "network": {"id": "66bd3e40-f19b-4145-baaf-8eab9760324a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1038504284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7448d7b10a924d5cbd60f6276224a8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe2444ce-56", "ovs_interfaceid": "be2444ce-562d-44c8-9707-4908e0f8cc4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:53:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-66f98937-b062-456a-a4d2-310682c7b6bb req-f8ece314-4924-4bd3-b11d-d1a7bd72b6b3 service nova] Releasing lock "refresh_cache-1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:53:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:10 user nova-compute[72809]: DEBUG nova.compute.manager [req-db1d5fa1-611a-4ecf-b8b6-3df95ae0ef04 req-ce22d450-0b47-416e-8c5c-01839c3989bb service nova] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Received event network-vif-plugged-be2444ce-562d-44c8-9707-4908e0f8cc4a {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:53:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-db1d5fa1-611a-4ecf-b8b6-3df95ae0ef04 req-ce22d450-0b47-416e-8c5c-01839c3989bb service nova] Acquiring lock "1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:53:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-db1d5fa1-611a-4ecf-b8b6-3df95ae0ef04 req-ce22d450-0b47-416e-8c5c-01839c3989bb service nova] Lock "1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:53:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-db1d5fa1-611a-4ecf-b8b6-3df95ae0ef04 req-ce22d450-0b47-416e-8c5c-01839c3989bb service nova] Lock "1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:53:10 user nova-compute[72809]: DEBUG nova.compute.manager [req-db1d5fa1-611a-4ecf-b8b6-3df95ae0ef04 req-ce22d450-0b47-416e-8c5c-01839c3989bb service nova] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] No waiting events found dispatching network-vif-plugged-be2444ce-562d-44c8-9707-4908e0f8cc4a {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:53:10 user nova-compute[72809]: WARNING nova.compute.manager [req-db1d5fa1-611a-4ecf-b8b6-3df95ae0ef04 req-ce22d450-0b47-416e-8c5c-01839c3989bb service nova] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Received unexpected event network-vif-plugged-be2444ce-562d-44c8-9707-4908e0f8cc4a for instance with vm_state building and task_state spawning.
Aug 09 06:53:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:11 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:11 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:12 user nova-compute[72809]: DEBUG nova.compute.manager [req-38729a50-f20f-4f5c-af81-41be6c450884 req-8c1e7be0-4b53-45a7-90b3-a860047967e9 service nova] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Received event network-vif-plugged-be2444ce-562d-44c8-9707-4908e0f8cc4a {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:53:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-38729a50-f20f-4f5c-af81-41be6c450884 req-8c1e7be0-4b53-45a7-90b3-a860047967e9 service nova] Acquiring lock "1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:53:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-38729a50-f20f-4f5c-af81-41be6c450884 req-8c1e7be0-4b53-45a7-90b3-a860047967e9 service nova] Lock "1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:53:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-38729a50-f20f-4f5c-af81-41be6c450884 req-8c1e7be0-4b53-45a7-90b3-a860047967e9 service nova] Lock "1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:53:12 user nova-compute[72809]: DEBUG nova.compute.manager [req-38729a50-f20f-4f5c-af81-41be6c450884 req-8c1e7be0-4b53-45a7-90b3-a860047967e9 service nova] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] No waiting events found dispatching network-vif-plugged-be2444ce-562d-44c8-9707-4908e0f8cc4a {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:53:12 user nova-compute[72809]: WARNING nova.compute.manager [req-38729a50-f20f-4f5c-af81-41be6c450884 req-8c1e7be0-4b53-45a7-90b3-a860047967e9 service nova] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Received unexpected event network-vif-plugged-be2444ce-562d-44c8-9707-4908e0f8cc4a for instance with vm_state building and task_state spawning.
Aug 09 06:53:12 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563992.77075, 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:53:12 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] VM Resumed (Lifecycle Event)
Aug 09 06:53:12 user nova-compute[72809]: DEBUG nova.compute.manager [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:53:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 06:53:12 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:53:12 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Instance spawned successfully.
Aug 09 06:53:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 06:53:12 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:53:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:53:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:53:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:53:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:53:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:53:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:53:12 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:53:12 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691563992.7732773, 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:53:12 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] VM Started (Lifecycle Event)
Aug 09 06:53:12 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:53:12 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:53:12 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:53:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:12 user nova-compute[72809]: INFO nova.compute.manager [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Took 7.26 seconds to spawn the instance on the hypervisor.
Aug 09 06:53:12 user nova-compute[72809]: DEBUG nova.compute.manager [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:53:13 user nova-compute[72809]: INFO nova.compute.manager [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Took 8.52 seconds to build instance.
Aug 09 06:53:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cfb0a371-e527-4c0a-8006-3b6e66905d6d tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lock "1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.698s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:53:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:26 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:53:27 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:53:27 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:53:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:53:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:53:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:53:27 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 06:53:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 06:53:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 06:53:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 06:53:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb24f48-e72d-4c52-ad10-aae7b37171db/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb24f48-e72d-4c52-ad10-aae7b37171db/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb24f48-e72d-4c52-ad10-aae7b37171db/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb24f48-e72d-4c52-ad10-aae7b37171db/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:31 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:31 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:31 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:31 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:53:31 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:53:31 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=7204MB free_disk=25.416446685791016GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 06:53:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:53:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:53:31 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:32 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Applying migration context for instance 15dda080-3487-4316-ab7b-f7185f0a4519 as it has an incoming, in-progress migration 8c283718-c3fd-4750-866b-935bf3a6380a. Migration status is finished {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 09 06:53:32 user nova-compute[72809]: INFO nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Updating resource usage from migration 8c283718-c3fd-4750-866b-935bf3a6380a
Aug 09 06:53:32 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 24ba9b41-d0bf-4a84-9f04-bfda9525b154 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:53:32 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 3640991e-8a5b-4674-af81-3117d4269a68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:53:32 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance b9b69c9e-f91d-4681-a53b-2f0fc4b13532 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:53:32 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance b64e7169-044c-4d0a-9ee5-f2914f1f5529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:53:32 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance aec0a7ee-69e1-41cf-bfa8-5733bdedd70a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:53:32 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 5fb24f48-e72d-4c52-ad10-aae7b37171db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:53:32 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Migration 8c283718-c3fd-4750-866b-935bf3a6380a is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 09 06:53:32 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 15dda080-3487-4316-ab7b-f7185f0a4519 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:53:32 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:53:32 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:53:32 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 06:53:32 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 06:53:32 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:53:32 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:53:32 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 06:53:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.573s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:53:32 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:33 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:53:33 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 06:53:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-b9b69c9e-f91d-4681-a53b-2f0fc4b13532" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:53:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-b9b69c9e-f91d-4681-a53b-2f0fc4b13532" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:53:33 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 06:53:34 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Updating instance_info_cache with network_info: [{"id": "664d7e69-c8c7-4ee9-980f-f58f8c8871b8", "address": "fa:16:3e:90:04:36", "network": {"id": "aea61157-8f5e-461a-b77e-f5279119bc15", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1060654578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cd7ca02c3254d4b8e5fb9ddf3ec82bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664d7e69-c8", "ovs_interfaceid": "664d7e69-c8c7-4ee9-980f-f58f8c8871b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:53:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-b9b69c9e-f91d-4681-a53b-2f0fc4b13532" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:53:34 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 06:53:34 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:53:34 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:53:34 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:53:34 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:53:34 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 06:53:34 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:53:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "336770eb-4f09-4134-92ef-f96039bf4fa9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:53:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "336770eb-4f09-4134-92ef-f96039bf4fa9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:53:36 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 06:53:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:53:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:53:36 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 06:53:36 user nova-compute[72809]: INFO nova.compute.claims [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Claim successful on node user
Aug 09 06:53:36 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:53:36 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:53:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:53:36 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 06:53:36 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 06:53:36 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 06:53:36 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 06:53:36 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 06:53:37 user nova-compute[72809]: DEBUG nova.policy [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10e067d2b5b7459cadf50b1ed89a8864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da97330281c4d0eba99e485db051973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 06:53:37 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 06:53:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 06:53:37 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Creating image(s)
Aug 09 06:53:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "/opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:53:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "/opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:53:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "/opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:53:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.136s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:53:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:53:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.146s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk 1073741824" returned: 0 in 0.069s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:53:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.162s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:37 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Checking if we can resize image /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 06:53:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:37 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Cannot resize image /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 06:53:37 user nova-compute[72809]: DEBUG nova.objects.instance [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lazy-loading 'migration_context' on Instance uuid 336770eb-4f09-4134-92ef-f96039bf4fa9 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:53:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 06:53:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Ensure instance console log exists: /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 06:53:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:53:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:53:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:53:37 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Successfully created port: 8ac68313-9d94-449d-87e1-9fb135c7bab5 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:53:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:38 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Successfully updated port: 8ac68313-9d94-449d-87e1-9fb135c7bab5 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:53:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "refresh_cache-336770eb-4f09-4134-92ef-f96039bf4fa9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:53:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquired lock "refresh_cache-336770eb-4f09-4134-92ef-f96039bf4fa9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:53:38 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:53:38 user nova-compute[72809]: DEBUG nova.compute.manager [req-9387a907-751e-4921-acd5-d151a2c88710 req-eb133ee0-2501-40a9-b6f0-6160d0a60b60 service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Received event network-changed-8ac68313-9d94-449d-87e1-9fb135c7bab5 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:53:38 user nova-compute[72809]: DEBUG nova.compute.manager [req-9387a907-751e-4921-acd5-d151a2c88710 req-eb133ee0-2501-40a9-b6f0-6160d0a60b60 service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Refreshing instance network info cache due to event network-changed-8ac68313-9d94-449d-87e1-9fb135c7bab5. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:53:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9387a907-751e-4921-acd5-d151a2c88710 req-eb133ee0-2501-40a9-b6f0-6160d0a60b60 service nova] Acquiring lock "refresh_cache-336770eb-4f09-4134-92ef-f96039bf4fa9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:53:38 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Updating instance_info_cache with network_info: [{"id": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "address": "fa:16:3e:b9:56:8d", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac68313-9d", "ovs_interfaceid": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Releasing lock "refresh_cache-336770eb-4f09-4134-92ef-f96039bf4fa9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Instance network_info: |[{"id": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "address": "fa:16:3e:b9:56:8d", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac68313-9d", "ovs_interfaceid": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9387a907-751e-4921-acd5-d151a2c88710 req-eb133ee0-2501-40a9-b6f0-6160d0a60b60 service nova] Acquired lock "refresh_cache-336770eb-4f09-4134-92ef-f96039bf4fa9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG nova.network.neutron [req-9387a907-751e-4921-acd5-d151a2c88710 req-eb133ee0-2501-40a9-b6f0-6160d0a60b60 service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Refreshing network info cache for port 8ac68313-9d94-449d-87e1-9fb135c7bab5 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Start _get_guest_xml network_info=[{"id": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "address": "fa:16:3e:b9:56:8d", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac68313-9d", "ovs_interfaceid": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:53:39 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:53:39 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:53:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:53:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-83451525',display_name='tempest-ServerActionsTestOtherA-server-83451525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-83451525',id=16,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCouL5r1ONNNh4MEm1cE7q85fOqyiHXG74zUMePb7Qx7FM94grlflWjrtC3jQ2LeCgVBOqUmmFTQqcvNJ0pbLdMAdhZ4dM0vJEiMtEgevMXZ2oGhFPDEpbVyaR20DJopHw==',key_name='tempest-keypair-888098152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6da97330281c4d0eba99e485db051973',ramdisk_id='',reservation_id='r-p0mtguey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-118844208',owner_user_name='tempest-ServerActionsTestOtherA-118844208-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:53:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10e067d2b5b7459cadf50b1ed89a8864',uuid=336770eb-4f09-4134-92ef-f96039bf4fa9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "address": "fa:16:3e:b9:56:8d", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac68313-9d", "ovs_interfaceid": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Converting VIF {"id": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "address": "fa:16:3e:b9:56:8d", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac68313-9d", "ovs_interfaceid": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:56:8d,bridge_name='br-int',has_traffic_filtering=True,id=8ac68313-9d94-449d-87e1-9fb135c7bab5,network=Network(0e68e18b-480a-4b6c-b194-39ba1099a4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac68313-9d') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG nova.objects.instance [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lazy-loading 'pci_devices' on Instance uuid 336770eb-4f09-4134-92ef-f96039bf4fa9 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:53:39 user nova-compute[72809]:   <uuid>336770eb-4f09-4134-92ef-f96039bf4fa9</uuid>
Aug 09 06:53:39 user nova-compute[72809]:   <name>instance-00000010</name>
Aug 09 06:53:39 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:53:39 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:53:39 user nova-compute[72809]:   <metadata>
Aug 09 06:53:39 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:53:39 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:53:39 user nova-compute[72809]:       <nova:name>tempest-ServerActionsTestOtherA-server-83451525</nova:name>
Aug 09 06:53:39 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:53:39</nova:creationTime>
Aug 09 06:53:39 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:53:39 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:53:39 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:53:39 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:53:39 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:53:39 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:53:39 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:53:39 user nova-compute[72809]:       <nova:owner>
Aug 09 06:53:39 user nova-compute[72809]:         <nova:user uuid="10e067d2b5b7459cadf50b1ed89a8864">tempest-ServerActionsTestOtherA-118844208-project-member</nova:user>
Aug 09 06:53:39 user nova-compute[72809]:         <nova:project uuid="6da97330281c4d0eba99e485db051973">tempest-ServerActionsTestOtherA-118844208</nova:project>
Aug 09 06:53:39 user nova-compute[72809]:       </nova:owner>
Aug 09 06:53:39 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:53:39 user nova-compute[72809]:       <nova:ports>
Aug 09 06:53:39 user nova-compute[72809]:         <nova:port uuid="8ac68313-9d94-449d-87e1-9fb135c7bab5">
Aug 09 06:53:39 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 06:53:39 user nova-compute[72809]:         </nova:port>
Aug 09 06:53:39 user nova-compute[72809]:       </nova:ports>
Aug 09 06:53:39 user nova-compute[72809]:     </nova:instance>
Aug 09 06:53:39 user nova-compute[72809]:   </metadata>
Aug 09 06:53:39 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:53:39 user nova-compute[72809]:     <system>
Aug 09 06:53:39 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:53:39 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:53:39 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:53:39 user nova-compute[72809]:       <entry name="serial">336770eb-4f09-4134-92ef-f96039bf4fa9</entry>
Aug 09 06:53:39 user nova-compute[72809]:       <entry name="uuid">336770eb-4f09-4134-92ef-f96039bf4fa9</entry>
Aug 09 06:53:39 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:53:39 user nova-compute[72809]:     </system>
Aug 09 06:53:39 user nova-compute[72809]:   </sysinfo>
Aug 09 06:53:39 user nova-compute[72809]:   <os>
Aug 09 06:53:39 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:53:39 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 06:53:39 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:53:39 user nova-compute[72809]:   </os>
Aug 09 06:53:39 user nova-compute[72809]:   <features>
Aug 09 06:53:39 user nova-compute[72809]:     <acpi/>
Aug 09 06:53:39 user nova-compute[72809]:     <apic/>
Aug 09 06:53:39 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:53:39 user nova-compute[72809]:   </features>
Aug 09 06:53:39 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:53:39 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:53:39 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:53:39 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:53:39 user nova-compute[72809]:   </clock>
Aug 09 06:53:39 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:53:39 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:53:39 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:53:39 user nova-compute[72809]:   </cpu>
Aug 09 06:53:39 user nova-compute[72809]:   <devices>
Aug 09 06:53:39 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:53:39 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:53:39 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk"/>
Aug 09 06:53:39 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:53:39 user nova-compute[72809]:     </disk>
Aug 09 06:53:39 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:53:39 user nova-compute[72809]:       <mac address="fa:16:3e:b9:56:8d"/>
Aug 09 06:53:39 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:53:39 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:53:39 user nova-compute[72809]:       <target dev="tap8ac68313-9d"/>
Aug 09 06:53:39 user nova-compute[72809]:     </interface>
Aug 09 06:53:39 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:53:39 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/console.log" append="off"/>
Aug 09 06:53:39 user nova-compute[72809]:     </serial>
Aug 09 06:53:39 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:53:39 user nova-compute[72809]:     <video>
Aug 09 06:53:39 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:53:39 user nova-compute[72809]:     </video>
Aug 09 06:53:39 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:53:39 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:53:39 user nova-compute[72809]:     </rng>
Aug 09 06:53:39 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:53:39 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:53:39 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:53:39 user nova-compute[72809]:     </memballoon>
Aug 09 06:53:39 user nova-compute[72809]:   </devices>
Aug 09 06:53:39 user nova-compute[72809]: </domain>
Aug 09 06:53:39 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:53:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-83451525',display_name='tempest-ServerActionsTestOtherA-server-83451525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-83451525',id=16,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCouL5r1ONNNh4MEm1cE7q85fOqyiHXG74zUMePb7Qx7FM94grlflWjrtC3jQ2LeCgVBOqUmmFTQqcvNJ0pbLdMAdhZ4dM0vJEiMtEgevMXZ2oGhFPDEpbVyaR20DJopHw==',key_name='tempest-keypair-888098152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6da97330281c4d0eba99e485db051973',ramdisk_id='',reservation_id='r-p0mtguey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-118844208',owner_user_name='tempest-ServerActionsTestOtherA-118844208-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:53:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10e067d2b5b7459cadf50b1ed89a8864',uuid=336770eb-4f09-4134-92ef-f96039bf4fa9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "address": "fa:16:3e:b9:56:8d", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac68313-9d", "ovs_interfaceid": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Converting VIF {"id": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "address": "fa:16:3e:b9:56:8d", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac68313-9d", "ovs_interfaceid": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:56:8d,bridge_name='br-int',has_traffic_filtering=True,id=8ac68313-9d94-449d-87e1-9fb135c7bab5,network=Network(0e68e18b-480a-4b6c-b194-39ba1099a4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac68313-9d') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG os_vif [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:56:8d,bridge_name='br-int',has_traffic_filtering=True,id=8ac68313-9d94-449d-87e1-9fb135c7bab5,network=Network(0e68e18b-480a-4b6c-b194-39ba1099a4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac68313-9d') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ac68313-9d, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8ac68313-9d, col_values=(('external_ids', {'iface-id': '8ac68313-9d94-449d-87e1-9fb135c7bab5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:56:8d', 'vm-uuid': '336770eb-4f09-4134-92ef-f96039bf4fa9'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:39 user nova-compute[72809]: INFO os_vif [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:56:8d,bridge_name='br-int',has_traffic_filtering=True,id=8ac68313-9d94-449d-87e1-9fb135c7bab5,network=Network(0e68e18b-480a-4b6c-b194-39ba1099a4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac68313-9d')
Aug 09 06:53:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:53:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] No VIF found with MAC fa:16:3e:b9:56:8d, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:53:40 user nova-compute[72809]: DEBUG nova.network.neutron [req-9387a907-751e-4921-acd5-d151a2c88710 req-eb133ee0-2501-40a9-b6f0-6160d0a60b60 service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Updated VIF entry in instance network info cache for port 8ac68313-9d94-449d-87e1-9fb135c7bab5. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:53:40 user nova-compute[72809]: DEBUG nova.network.neutron [req-9387a907-751e-4921-acd5-d151a2c88710 req-eb133ee0-2501-40a9-b6f0-6160d0a60b60 service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Updating instance_info_cache with network_info: [{"id": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "address": "fa:16:3e:b9:56:8d", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac68313-9d", "ovs_interfaceid": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:53:40 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9387a907-751e-4921-acd5-d151a2c88710 req-eb133ee0-2501-40a9-b6f0-6160d0a60b60 service nova] Releasing lock "refresh_cache-336770eb-4f09-4134-92ef-f96039bf4fa9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:53:40 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:40 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:40 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:40 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:41 user nova-compute[72809]: DEBUG nova.compute.manager [req-f3514902-a8d2-493a-9815-c8ff66beb916 req-9047c415-64b2-4fd4-a5bb-865f2fa9c687 service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Received event network-vif-plugged-8ac68313-9d94-449d-87e1-9fb135c7bab5 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:53:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f3514902-a8d2-493a-9815-c8ff66beb916 req-9047c415-64b2-4fd4-a5bb-865f2fa9c687 service nova] Acquiring lock "336770eb-4f09-4134-92ef-f96039bf4fa9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:53:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f3514902-a8d2-493a-9815-c8ff66beb916 req-9047c415-64b2-4fd4-a5bb-865f2fa9c687 service nova] Lock "336770eb-4f09-4134-92ef-f96039bf4fa9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:53:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f3514902-a8d2-493a-9815-c8ff66beb916 req-9047c415-64b2-4fd4-a5bb-865f2fa9c687 service nova] Lock "336770eb-4f09-4134-92ef-f96039bf4fa9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:53:41 user nova-compute[72809]: DEBUG nova.compute.manager [req-f3514902-a8d2-493a-9815-c8ff66beb916 req-9047c415-64b2-4fd4-a5bb-865f2fa9c687 service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] No waiting events found dispatching network-vif-plugged-8ac68313-9d94-449d-87e1-9fb135c7bab5 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:53:41 user nova-compute[72809]: WARNING nova.compute.manager [req-f3514902-a8d2-493a-9815-c8ff66beb916 req-9047c415-64b2-4fd4-a5bb-865f2fa9c687 service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Received unexpected event network-vif-plugged-8ac68313-9d94-449d-87e1-9fb135c7bab5 for instance with vm_state building and task_state spawning.
Aug 09 06:53:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:42 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:53:42 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 06:53:42 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564022.9807534, 336770eb-4f09-4134-92ef-f96039bf4fa9 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:53:42 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] VM Resumed (Lifecycle Event)
Aug 09 06:53:42 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Instance spawned successfully.
Aug 09 06:53:42 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 06:53:43 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:53:43 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:53:43 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:53:43 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:53:43 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:53:43 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:53:43 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:53:43 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:53:43 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:53:43 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564022.9817467, 336770eb-4f09-4134-92ef-f96039bf4fa9 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:53:43 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] VM Started (Lifecycle Event)
Aug 09 06:53:43 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:53:43 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:53:43 user nova-compute[72809]: DEBUG nova.compute.manager [req-110835e6-ab70-4cd4-85b1-840a31410a11 req-0dc3153a-debe-483e-a45b-0e8f1a14111e service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Received event network-vif-plugged-8ac68313-9d94-449d-87e1-9fb135c7bab5 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:53:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-110835e6-ab70-4cd4-85b1-840a31410a11 req-0dc3153a-debe-483e-a45b-0e8f1a14111e service nova] Acquiring lock "336770eb-4f09-4134-92ef-f96039bf4fa9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:53:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-110835e6-ab70-4cd4-85b1-840a31410a11 req-0dc3153a-debe-483e-a45b-0e8f1a14111e service nova] Lock "336770eb-4f09-4134-92ef-f96039bf4fa9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:53:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-110835e6-ab70-4cd4-85b1-840a31410a11 req-0dc3153a-debe-483e-a45b-0e8f1a14111e service nova] Lock "336770eb-4f09-4134-92ef-f96039bf4fa9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:53:43 user nova-compute[72809]: DEBUG nova.compute.manager [req-110835e6-ab70-4cd4-85b1-840a31410a11 req-0dc3153a-debe-483e-a45b-0e8f1a14111e service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] No waiting events found dispatching network-vif-plugged-8ac68313-9d94-449d-87e1-9fb135c7bab5 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:53:43 user nova-compute[72809]: WARNING nova.compute.manager [req-110835e6-ab70-4cd4-85b1-840a31410a11 req-0dc3153a-debe-483e-a45b-0e8f1a14111e service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Received unexpected event network-vif-plugged-8ac68313-9d94-449d-87e1-9fb135c7bab5 for instance with vm_state building and task_state spawning.
Aug 09 06:53:43 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:53:43 user nova-compute[72809]: INFO nova.compute.manager [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Took 6.13 seconds to spawn the instance on the hypervisor.
Aug 09 06:53:43 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:53:43 user nova-compute[72809]: INFO nova.compute.manager [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Took 6.93 seconds to build instance.
Aug 09 06:53:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ad4c72e8-5e6d-474c-add4-446a81bfdedd tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "336770eb-4f09-4134-92ef-f96039bf4fa9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.036s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:53:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:50 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Acquiring lock "f69df9a2-e8ed-4bec-8c01-cd005432a373" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:53:50 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:53:50 user nova-compute[72809]: DEBUG nova.compute.manager [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 06:53:50 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:53:50 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:53:50 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 06:53:50 user nova-compute[72809]: INFO nova.compute.claims [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Claim successful on node user
Aug 09 06:53:51 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:53:51 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:53:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.582s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:53:51 user nova-compute[72809]: DEBUG nova.compute.manager [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 06:53:51 user nova-compute[72809]: DEBUG nova.compute.manager [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 06:53:51 user nova-compute[72809]: DEBUG nova.network.neutron [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 06:53:51 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 06:53:51 user nova-compute[72809]: DEBUG nova.compute.manager [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 06:53:51 user nova-compute[72809]: INFO nova.virt.block_device [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Booting with volume 607e8c3a-2fac-41e7-98b9-f5dec95d58cb at /dev/vda
Aug 09 06:53:51 user nova-compute[72809]: DEBUG os_brick.utils [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:53:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:51 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cc861b-9f23-47d2-89d7-7739d1b000ae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:53:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:51 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a95bf1-d4fb-44eb-94f9-810f79e50e3d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:53:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:51 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36df8da-7699-462d-8ff2-dd25672b661c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:53:51 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5fc68b-9e10-4b15-a10d-28c9d78756dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:53:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:53:51 user nova-compute[72809]: DEBUG nova.policy [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99e1c9eec3e6402482269c9878ac9987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b6463729fb40a7ae708ac0f188263b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 06:53:51 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 06:53:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:53:51 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 06:53:51 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[619d4870-c82c-4714-aef1-25de8222088c]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:53:51 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 06:53:51 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 06:53:51 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 06:53:51 user nova-compute[72809]: DEBUG os_brick.utils [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:53:51 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Updating existing volume attachment record: 3e5d7b3d-5018-40a8-a5a6-a75ded225cc9 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 06:53:51 user nova-compute[72809]: DEBUG nova.compute.manager [req-53f1f23d-52fb-4b73-a271-918b4ef9ece3 req-4a7ef796-2b9b-4fbf-9b82-8c05cd658d76 service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Received event network-changed-b94aa917-6963-4aee-9bc2-15b2720191be {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:53:51 user nova-compute[72809]: DEBUG nova.compute.manager [req-53f1f23d-52fb-4b73-a271-918b4ef9ece3 req-4a7ef796-2b9b-4fbf-9b82-8c05cd658d76 service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Refreshing instance network info cache due to event network-changed-b94aa917-6963-4aee-9bc2-15b2720191be. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:53:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-53f1f23d-52fb-4b73-a271-918b4ef9ece3 req-4a7ef796-2b9b-4fbf-9b82-8c05cd658d76 service nova] Acquiring lock "refresh_cache-aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:53:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-53f1f23d-52fb-4b73-a271-918b4ef9ece3 req-4a7ef796-2b9b-4fbf-9b82-8c05cd658d76 service nova] Acquired lock "refresh_cache-aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:53:51 user nova-compute[72809]: DEBUG nova.network.neutron [req-53f1f23d-52fb-4b73-a271-918b4ef9ece3 req-4a7ef796-2b9b-4fbf-9b82-8c05cd658d76 service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Refreshing network info cache for port b94aa917-6963-4aee-9bc2-15b2720191be {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:53:52 user nova-compute[72809]: DEBUG nova.network.neutron [req-53f1f23d-52fb-4b73-a271-918b4ef9ece3 req-4a7ef796-2b9b-4fbf-9b82-8c05cd658d76 service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Updated VIF entry in instance network info cache for port b94aa917-6963-4aee-9bc2-15b2720191be. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:53:52 user nova-compute[72809]: DEBUG nova.network.neutron [req-53f1f23d-52fb-4b73-a271-918b4ef9ece3 req-4a7ef796-2b9b-4fbf-9b82-8c05cd658d76 service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Updating instance_info_cache with network_info: [{"id": "b94aa917-6963-4aee-9bc2-15b2720191be", "address": "fa:16:3e:5c:5d:c2", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb94aa917-69", "ovs_interfaceid": "b94aa917-6963-4aee-9bc2-15b2720191be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:53:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-53f1f23d-52fb-4b73-a271-918b4ef9ece3 req-4a7ef796-2b9b-4fbf-9b82-8c05cd658d76 service nova] Releasing lock "refresh_cache-aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:53:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:52 user nova-compute[72809]: DEBUG nova.network.neutron [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Successfully created port: a54c2c6b-acf2-43b8-b6cd-314710baa6fb {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:53:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:53 user nova-compute[72809]: DEBUG nova.network.neutron [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Successfully created port: 8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:53:53 user nova-compute[72809]: DEBUG nova.network.neutron [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Successfully created port: 264f2093-5827-43e1-80a4-1a9190478f3f {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:53:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:54 user nova-compute[72809]: DEBUG nova.network.neutron [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Successfully created port: 153083da-b420-4260-ae35-edae5a4d37b8 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:53:55 user nova-compute[72809]: DEBUG nova.network.neutron [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Successfully created port: 6231c01e-c6ec-4103-8899-4cb730945ad0 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:53:56 user nova-compute[72809]: DEBUG nova.network.neutron [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Successfully updated port: a54c2c6b-acf2-43b8-b6cd-314710baa6fb {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:53:56 user nova-compute[72809]: DEBUG nova.compute.manager [req-beffa033-b641-40b3-b236-656690e12e96 req-4b423007-e8e5-4132-9302-eb7b3c3d7d2e service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-changed-a54c2c6b-acf2-43b8-b6cd-314710baa6fb {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:53:56 user nova-compute[72809]: DEBUG nova.compute.manager [req-beffa033-b641-40b3-b236-656690e12e96 req-4b423007-e8e5-4132-9302-eb7b3c3d7d2e service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Refreshing instance network info cache due to event network-changed-a54c2c6b-acf2-43b8-b6cd-314710baa6fb. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:53:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-beffa033-b641-40b3-b236-656690e12e96 req-4b423007-e8e5-4132-9302-eb7b3c3d7d2e service nova] Acquiring lock "refresh_cache-f69df9a2-e8ed-4bec-8c01-cd005432a373" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:53:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-beffa033-b641-40b3-b236-656690e12e96 req-4b423007-e8e5-4132-9302-eb7b3c3d7d2e service nova] Acquired lock "refresh_cache-f69df9a2-e8ed-4bec-8c01-cd005432a373" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:53:56 user nova-compute[72809]: DEBUG nova.network.neutron [req-beffa033-b641-40b3-b236-656690e12e96 req-4b423007-e8e5-4132-9302-eb7b3c3d7d2e service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Refreshing network info cache for port a54c2c6b-acf2-43b8-b6cd-314710baa6fb {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:53:56 user nova-compute[72809]: DEBUG nova.network.neutron [req-beffa033-b641-40b3-b236-656690e12e96 req-4b423007-e8e5-4132-9302-eb7b3c3d7d2e service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:53:56 user nova-compute[72809]: DEBUG nova.network.neutron [req-beffa033-b641-40b3-b236-656690e12e96 req-4b423007-e8e5-4132-9302-eb7b3c3d7d2e service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:53:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-beffa033-b641-40b3-b236-656690e12e96 req-4b423007-e8e5-4132-9302-eb7b3c3d7d2e service nova] Releasing lock "refresh_cache-f69df9a2-e8ed-4bec-8c01-cd005432a373" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:53:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a765779e-9723-49ab-ba10-b3168e32a056 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:53:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a765779e-9723-49ab-ba10-b3168e32a056 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:53:56 user nova-compute[72809]: INFO nova.compute.manager [None req-a765779e-9723-49ab-ba10-b3168e32a056 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Shelving
Aug 09 06:53:56 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:56 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:56 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:57 user nova-compute[72809]: DEBUG nova.compute.manager [req-0d3e6b69-e9dc-4330-938e-78d70697ff39 req-f4645949-3093-43f7-9cec-36cf4de17b1b service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Received event network-vif-unplugged-b94aa917-6963-4aee-9bc2-15b2720191be {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:53:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0d3e6b69-e9dc-4330-938e-78d70697ff39 req-f4645949-3093-43f7-9cec-36cf4de17b1b service nova] Acquiring lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:53:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0d3e6b69-e9dc-4330-938e-78d70697ff39 req-f4645949-3093-43f7-9cec-36cf4de17b1b service nova] Lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:53:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0d3e6b69-e9dc-4330-938e-78d70697ff39 req-f4645949-3093-43f7-9cec-36cf4de17b1b service nova] Lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:53:57 user nova-compute[72809]: DEBUG nova.compute.manager [req-0d3e6b69-e9dc-4330-938e-78d70697ff39 req-f4645949-3093-43f7-9cec-36cf4de17b1b service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] No waiting events found dispatching network-vif-unplugged-b94aa917-6963-4aee-9bc2-15b2720191be {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:53:57 user nova-compute[72809]: WARNING nova.compute.manager [req-0d3e6b69-e9dc-4330-938e-78d70697ff39 req-f4645949-3093-43f7-9cec-36cf4de17b1b service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Received unexpected event network-vif-unplugged-b94aa917-6963-4aee-9bc2-15b2720191be for instance with vm_state active and task_state shelving.
Aug 09 06:53:57 user nova-compute[72809]: DEBUG nova.network.neutron [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Successfully updated port: 1db9e576-a5f0-40ac-8bf6-181eec5c2d85 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:53:57 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Instance destroyed successfully.
Aug 09 06:53:57 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-a765779e-9723-49ab-ba10-b3168e32a056 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Beginning cold snapshot process
Aug 09 06:53:57 user nova-compute[72809]: DEBUG nova.privsep.utils [None req-a765779e-9723-49ab-ba10-b3168e32a056 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72809) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 06:53:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a765779e-9723-49ab-ba10-b3168e32a056 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk /opt/stack/data/nova/instances/snapshots/tmp040jgag9/d8d7427824bc4ad193d93a614cebc66f {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:53:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:53:58 user nova-compute[72809]: DEBUG nova.network.neutron [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Successfully updated port: 4a076857-c138-4c63-955c-e3a9396f825f {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:53:58 user nova-compute[72809]: DEBUG nova.compute.manager [req-a275cd8d-d21e-47c3-89cb-61db472787dc req-68f9162f-4622-46eb-81f7-5000840e12cd service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-changed-1db9e576-a5f0-40ac-8bf6-181eec5c2d85 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:53:58 user nova-compute[72809]: DEBUG nova.compute.manager [req-a275cd8d-d21e-47c3-89cb-61db472787dc req-68f9162f-4622-46eb-81f7-5000840e12cd service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Refreshing instance network info cache due to event network-changed-1db9e576-a5f0-40ac-8bf6-181eec5c2d85. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:53:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a275cd8d-d21e-47c3-89cb-61db472787dc req-68f9162f-4622-46eb-81f7-5000840e12cd service nova] Acquiring lock "refresh_cache-f69df9a2-e8ed-4bec-8c01-cd005432a373" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:53:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a275cd8d-d21e-47c3-89cb-61db472787dc req-68f9162f-4622-46eb-81f7-5000840e12cd service nova] Acquired lock "refresh_cache-f69df9a2-e8ed-4bec-8c01-cd005432a373" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:53:58 user nova-compute[72809]: DEBUG nova.network.neutron [req-a275cd8d-d21e-47c3-89cb-61db472787dc req-68f9162f-4622-46eb-81f7-5000840e12cd service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Refreshing network info cache for port 1db9e576-a5f0-40ac-8bf6-181eec5c2d85 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:53:58 user nova-compute[72809]: DEBUG nova.network.neutron [req-a275cd8d-d21e-47c3-89cb-61db472787dc req-68f9162f-4622-46eb-81f7-5000840e12cd service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:53:58 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a765779e-9723-49ab-ba10-b3168e32a056 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk /opt/stack/data/nova/instances/snapshots/tmp040jgag9/d8d7427824bc4ad193d93a614cebc66f" returned: 0 in 0.976s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:53:58 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-a765779e-9723-49ab-ba10-b3168e32a056 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Snapshot extracted, beginning image upload
Aug 09 06:53:58 user nova-compute[72809]: DEBUG nova.network.neutron [req-a275cd8d-d21e-47c3-89cb-61db472787dc req-68f9162f-4622-46eb-81f7-5000840e12cd service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:53:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a275cd8d-d21e-47c3-89cb-61db472787dc req-68f9162f-4622-46eb-81f7-5000840e12cd service nova] Releasing lock "refresh_cache-f69df9a2-e8ed-4bec-8c01-cd005432a373" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:53:58 user nova-compute[72809]: DEBUG nova.compute.manager [req-a275cd8d-d21e-47c3-89cb-61db472787dc req-68f9162f-4622-46eb-81f7-5000840e12cd service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-changed-4a076857-c138-4c63-955c-e3a9396f825f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:53:58 user nova-compute[72809]: DEBUG nova.compute.manager [req-a275cd8d-d21e-47c3-89cb-61db472787dc req-68f9162f-4622-46eb-81f7-5000840e12cd service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Refreshing instance network info cache due to event network-changed-4a076857-c138-4c63-955c-e3a9396f825f. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:53:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a275cd8d-d21e-47c3-89cb-61db472787dc req-68f9162f-4622-46eb-81f7-5000840e12cd service nova] Acquiring lock "refresh_cache-f69df9a2-e8ed-4bec-8c01-cd005432a373" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:53:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a275cd8d-d21e-47c3-89cb-61db472787dc req-68f9162f-4622-46eb-81f7-5000840e12cd service nova] Acquired lock "refresh_cache-f69df9a2-e8ed-4bec-8c01-cd005432a373" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:53:58 user nova-compute[72809]: DEBUG nova.network.neutron [req-a275cd8d-d21e-47c3-89cb-61db472787dc req-68f9162f-4622-46eb-81f7-5000840e12cd service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Refreshing network info cache for port 4a076857-c138-4c63-955c-e3a9396f825f {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:53:58 user nova-compute[72809]: DEBUG nova.network.neutron [req-a275cd8d-d21e-47c3-89cb-61db472787dc req-68f9162f-4622-46eb-81f7-5000840e12cd service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:53:59 user nova-compute[72809]: DEBUG nova.network.neutron [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Successfully updated port: 8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:53:59 user nova-compute[72809]: DEBUG nova.network.neutron [req-a275cd8d-d21e-47c3-89cb-61db472787dc req-68f9162f-4622-46eb-81f7-5000840e12cd service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:53:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a275cd8d-d21e-47c3-89cb-61db472787dc req-68f9162f-4622-46eb-81f7-5000840e12cd service nova] Releasing lock "refresh_cache-f69df9a2-e8ed-4bec-8c01-cd005432a373" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:53:59 user nova-compute[72809]: DEBUG nova.compute.manager [req-d7333e43-9ebf-4640-9a17-7a40fd7cf4b8 req-67b7754a-8883-43bd-80ef-3f34a3792855 service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Received event network-vif-plugged-b94aa917-6963-4aee-9bc2-15b2720191be {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:53:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d7333e43-9ebf-4640-9a17-7a40fd7cf4b8 req-67b7754a-8883-43bd-80ef-3f34a3792855 service nova] Acquiring lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:53:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d7333e43-9ebf-4640-9a17-7a40fd7cf4b8 req-67b7754a-8883-43bd-80ef-3f34a3792855 service nova] Lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:53:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d7333e43-9ebf-4640-9a17-7a40fd7cf4b8 req-67b7754a-8883-43bd-80ef-3f34a3792855 service nova] Lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:53:59 user nova-compute[72809]: DEBUG nova.compute.manager [req-d7333e43-9ebf-4640-9a17-7a40fd7cf4b8 req-67b7754a-8883-43bd-80ef-3f34a3792855 service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] No waiting events found dispatching network-vif-plugged-b94aa917-6963-4aee-9bc2-15b2720191be {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:53:59 user nova-compute[72809]: WARNING nova.compute.manager [req-d7333e43-9ebf-4640-9a17-7a40fd7cf4b8 req-67b7754a-8883-43bd-80ef-3f34a3792855 service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Received unexpected event network-vif-plugged-b94aa917-6963-4aee-9bc2-15b2720191be for instance with vm_state active and task_state shelving_image_uploading.
Aug 09 06:53:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:00 user nova-compute[72809]: DEBUG nova.network.neutron [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Successfully updated port: 264f2093-5827-43e1-80a4-1a9190478f3f {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:54:00 user nova-compute[72809]: DEBUG nova.compute.manager [req-f7653042-aa7e-4a3b-a538-5d2df2a7ca21 req-80eb64c6-eb4b-4da0-8a0d-af35bac4fd3e service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-changed-8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:00 user nova-compute[72809]: DEBUG nova.compute.manager [req-f7653042-aa7e-4a3b-a538-5d2df2a7ca21 req-80eb64c6-eb4b-4da0-8a0d-af35bac4fd3e service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Refreshing instance network info cache due to event network-changed-8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:54:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f7653042-aa7e-4a3b-a538-5d2df2a7ca21 req-80eb64c6-eb4b-4da0-8a0d-af35bac4fd3e service nova] Acquiring lock "refresh_cache-f69df9a2-e8ed-4bec-8c01-cd005432a373" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:54:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f7653042-aa7e-4a3b-a538-5d2df2a7ca21 req-80eb64c6-eb4b-4da0-8a0d-af35bac4fd3e service nova] Acquired lock "refresh_cache-f69df9a2-e8ed-4bec-8c01-cd005432a373" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:54:00 user nova-compute[72809]: DEBUG nova.network.neutron [req-f7653042-aa7e-4a3b-a538-5d2df2a7ca21 req-80eb64c6-eb4b-4da0-8a0d-af35bac4fd3e service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Refreshing network info cache for port 8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:54:00 user nova-compute[72809]: DEBUG nova.network.neutron [req-f7653042-aa7e-4a3b-a538-5d2df2a7ca21 req-80eb64c6-eb4b-4da0-8a0d-af35bac4fd3e service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:54:00 user nova-compute[72809]: DEBUG nova.network.neutron [req-f7653042-aa7e-4a3b-a538-5d2df2a7ca21 req-80eb64c6-eb4b-4da0-8a0d-af35bac4fd3e service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:54:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f7653042-aa7e-4a3b-a538-5d2df2a7ca21 req-80eb64c6-eb4b-4da0-8a0d-af35bac4fd3e service nova] Releasing lock "refresh_cache-f69df9a2-e8ed-4bec-8c01-cd005432a373" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:54:00 user nova-compute[72809]: DEBUG nova.compute.manager [req-f7653042-aa7e-4a3b-a538-5d2df2a7ca21 req-80eb64c6-eb4b-4da0-8a0d-af35bac4fd3e service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-changed-264f2093-5827-43e1-80a4-1a9190478f3f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:00 user nova-compute[72809]: DEBUG nova.compute.manager [req-f7653042-aa7e-4a3b-a538-5d2df2a7ca21 req-80eb64c6-eb4b-4da0-8a0d-af35bac4fd3e service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Refreshing instance network info cache due to event network-changed-264f2093-5827-43e1-80a4-1a9190478f3f. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:54:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f7653042-aa7e-4a3b-a538-5d2df2a7ca21 req-80eb64c6-eb4b-4da0-8a0d-af35bac4fd3e service nova] Acquiring lock "refresh_cache-f69df9a2-e8ed-4bec-8c01-cd005432a373" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:54:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f7653042-aa7e-4a3b-a538-5d2df2a7ca21 req-80eb64c6-eb4b-4da0-8a0d-af35bac4fd3e service nova] Acquired lock "refresh_cache-f69df9a2-e8ed-4bec-8c01-cd005432a373" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:54:00 user nova-compute[72809]: DEBUG nova.network.neutron [req-f7653042-aa7e-4a3b-a538-5d2df2a7ca21 req-80eb64c6-eb4b-4da0-8a0d-af35bac4fd3e service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Refreshing network info cache for port 264f2093-5827-43e1-80a4-1a9190478f3f {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:54:00 user nova-compute[72809]: DEBUG nova.network.neutron [req-f7653042-aa7e-4a3b-a538-5d2df2a7ca21 req-80eb64c6-eb4b-4da0-8a0d-af35bac4fd3e service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG nova.network.neutron [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Successfully updated port: 153083da-b420-4260-ae35-edae5a4d37b8 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG nova.network.neutron [req-f7653042-aa7e-4a3b-a538-5d2df2a7ca21 req-80eb64c6-eb4b-4da0-8a0d-af35bac4fd3e service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f7653042-aa7e-4a3b-a538-5d2df2a7ca21 req-80eb64c6-eb4b-4da0-8a0d-af35bac4fd3e service nova] Releasing lock "refresh_cache-f69df9a2-e8ed-4bec-8c01-cd005432a373" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:54:01 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-a765779e-9723-49ab-ba10-b3168e32a056 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Snapshot image upload complete
Aug 09 06:54:01 user nova-compute[72809]: DEBUG nova.compute.manager [None req-a765779e-9723-49ab-ba10-b3168e32a056 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:54:01 user nova-compute[72809]: INFO nova.virt.block_device [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Booting with volume f8b0e7d8-187c-44b9-a029-076cfd62a9dd at /dev/vdb
Aug 09 06:54:01 user nova-compute[72809]: INFO nova.compute.manager [None req-a765779e-9723-49ab-ba10-b3168e32a056 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Shelve offloading
Aug 09 06:54:01 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Instance destroyed successfully.
Aug 09 06:54:01 user nova-compute[72809]: DEBUG nova.compute.manager [None req-a765779e-9723-49ab-ba10-b3168e32a056 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a765779e-9723-49ab-ba10-b3168e32a056 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "refresh_cache-aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a765779e-9723-49ab-ba10-b3168e32a056 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquired lock "refresh_cache-aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG nova.network.neutron [None req-a765779e-9723-49ab-ba10-b3168e32a056 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG os_brick.utils [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f7bd6b-10d6-4eb8-a1a3-43a852acb356]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7bdd9a-5aec-4e88-afca-ecf5b8094df2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[688f738e-46c5-4a73-a9a2-9ddd976675bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a7df9f-2064-4f48-9dd2-de6c9562d630]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:54:01 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 06:54:01 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fbb022-422c-4694-a869-4f1c717f441d]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG os_brick.utils [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Updating existing volume attachment record: 559c669a-c85d-4416-96a2-22b6888e69a0 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG nova.network.neutron [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Successfully updated port: 6231c01e-c6ec-4103-8899-4cb730945ad0 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Acquiring lock "refresh_cache-f69df9a2-e8ed-4bec-8c01-cd005432a373" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Acquired lock "refresh_cache-f69df9a2-e8ed-4bec-8c01-cd005432a373" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG nova.network.neutron [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG nova.network.neutron [None req-a765779e-9723-49ab-ba10-b3168e32a056 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Updating instance_info_cache with network_info: [{"id": "b94aa917-6963-4aee-9bc2-15b2720191be", "address": "fa:16:3e:5c:5d:c2", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb94aa917-69", "ovs_interfaceid": "b94aa917-6963-4aee-9bc2-15b2720191be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a765779e-9723-49ab-ba10-b3168e32a056 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Releasing lock "refresh_cache-aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:54:01 user nova-compute[72809]: DEBUG nova.network.neutron [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:54:02 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Instance destroyed successfully.
Aug 09 06:54:02 user nova-compute[72809]: DEBUG nova.objects.instance [None req-a765779e-9723-49ab-ba10-b3168e32a056 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lazy-loading 'resources' on Instance uuid aec0a7ee-69e1-41cf-bfa8-5733bdedd70a {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:54:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-a765779e-9723-49ab-ba10-b3168e32a056 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:51:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-913717240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-913717240',id=12,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOO6sV+Qoal86qtcFU/3EObSR3TULxpC71/EBxvqmfNHUwrVBvM0F3kd7T3Glq1bk7tnZt3sMX+JOAHb7PEDhxWbR125C3wnEZH09gF2FMN71tfa4u3yaGKdWomhubcnMw==',key_name='tempest-keypair-38606939',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:52:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0ec36de19d984ff3a150db4fdd8ce327',ramdisk_id='',reservation_id='r-3i0wy02j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1006961404',owner_user_name='tempest-AttachVolumeShelveTestJSON-1006961404-project-member',shelved_at='2023-08-09T06:54:01.262668',shelved_host='user',shelved_image_id='4241f023-957d-42f4-afec-ae69b622b1a7'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:53:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e51e8a984c724efe966662c14b0dbffc',uuid=aec0a7ee-69e1-41cf-bfa8-5733bdedd70a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "b94aa917-6963-4aee-9bc2-15b2720191be", "address": "fa:16:3e:5c:5d:c2", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb94aa917-69", "ovs_interfaceid": "b94aa917-6963-4aee-9bc2-15b2720191be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:54:02 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-a765779e-9723-49ab-ba10-b3168e32a056 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Converting VIF {"id": "b94aa917-6963-4aee-9bc2-15b2720191be", "address": "fa:16:3e:5c:5d:c2", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb94aa917-69", "ovs_interfaceid": "b94aa917-6963-4aee-9bc2-15b2720191be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:54:02 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-a765779e-9723-49ab-ba10-b3168e32a056 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:5d:c2,bridge_name='br-int',has_traffic_filtering=True,id=b94aa917-6963-4aee-9bc2-15b2720191be,network=Network(39277410-6754-4b40-b1bc-9777841910ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb94aa917-69') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:54:02 user nova-compute[72809]: DEBUG os_vif [None req-a765779e-9723-49ab-ba10-b3168e32a056 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:5d:c2,bridge_name='br-int',has_traffic_filtering=True,id=b94aa917-6963-4aee-9bc2-15b2720191be,network=Network(39277410-6754-4b40-b1bc-9777841910ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb94aa917-69') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:54:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb94aa917-69, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:54:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:54:02 user nova-compute[72809]: INFO os_vif [None req-a765779e-9723-49ab-ba10-b3168e32a056 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:5d:c2,bridge_name='br-int',has_traffic_filtering=True,id=b94aa917-6963-4aee-9bc2-15b2720191be,network=Network(39277410-6754-4b40-b1bc-9777841910ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb94aa917-69')
Aug 09 06:54:02 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-a765779e-9723-49ab-ba10-b3168e32a056 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Deleting instance files /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a_del
Aug 09 06:54:02 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-a765779e-9723-49ab-ba10-b3168e32a056 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Deletion of /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a_del complete
Aug 09 06:54:02 user nova-compute[72809]: DEBUG nova.compute.manager [req-f9a72b49-f7cc-46b0-9f76-358e3232136c req-2760ec9a-3995-4aa7-8149-23625c7058c6 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-changed-153083da-b420-4260-ae35-edae5a4d37b8 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:02 user nova-compute[72809]: DEBUG nova.compute.manager [req-f9a72b49-f7cc-46b0-9f76-358e3232136c req-2760ec9a-3995-4aa7-8149-23625c7058c6 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Refreshing instance network info cache due to event network-changed-153083da-b420-4260-ae35-edae5a4d37b8. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:54:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f9a72b49-f7cc-46b0-9f76-358e3232136c req-2760ec9a-3995-4aa7-8149-23625c7058c6 service nova] Acquiring lock "refresh_cache-f69df9a2-e8ed-4bec-8c01-cd005432a373" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:54:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-38ceae82-4e57-4a0c-a2fa-9300c68dfd05 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Acquiring lock "b9b69c9e-f91d-4681-a53b-2f0fc4b13532" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-38ceae82-4e57-4a0c-a2fa-9300c68dfd05 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Lock "b9b69c9e-f91d-4681-a53b-2f0fc4b13532" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-38ceae82-4e57-4a0c-a2fa-9300c68dfd05 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Acquiring lock "b9b69c9e-f91d-4681-a53b-2f0fc4b13532-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-38ceae82-4e57-4a0c-a2fa-9300c68dfd05 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Lock "b9b69c9e-f91d-4681-a53b-2f0fc4b13532-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-38ceae82-4e57-4a0c-a2fa-9300c68dfd05 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Lock "b9b69c9e-f91d-4681-a53b-2f0fc4b13532-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:02 user nova-compute[72809]: INFO nova.compute.manager [None req-38ceae82-4e57-4a0c-a2fa-9300c68dfd05 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Terminating instance
Aug 09 06:54:02 user nova-compute[72809]: DEBUG nova.compute.manager [None req-38ceae82-4e57-4a0c-a2fa-9300c68dfd05 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 06:54:02 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-a765779e-9723-49ab-ba10-b3168e32a056 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Deleted allocations for instance aec0a7ee-69e1-41cf-bfa8-5733bdedd70a
Aug 09 06:54:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a765779e-9723-49ab-ba10-b3168e32a056 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a765779e-9723-49ab-ba10-b3168e32a056 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:02 user nova-compute[72809]: DEBUG nova.objects.instance [None req-a765779e-9723-49ab-ba10-b3168e32a056 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lazy-loading 'numa_topology' on Instance uuid aec0a7ee-69e1-41cf-bfa8-5733bdedd70a {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:54:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:03 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-a765779e-9723-49ab-ba10-b3168e32a056 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:54:03 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-a765779e-9723-49ab-ba10-b3168e32a056 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:54:03 user nova-compute[72809]: DEBUG nova.compute.manager [req-230ebd4e-d63c-4d9c-b7ae-ed3aa92ecb65 req-67062a05-5f4e-45f1-8ec6-4746d284b933 service nova] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Received event network-vif-unplugged-664d7e69-c8c7-4ee9-980f-f58f8c8871b8 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-230ebd4e-d63c-4d9c-b7ae-ed3aa92ecb65 req-67062a05-5f4e-45f1-8ec6-4746d284b933 service nova] Acquiring lock "b9b69c9e-f91d-4681-a53b-2f0fc4b13532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-230ebd4e-d63c-4d9c-b7ae-ed3aa92ecb65 req-67062a05-5f4e-45f1-8ec6-4746d284b933 service nova] Lock "b9b69c9e-f91d-4681-a53b-2f0fc4b13532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-230ebd4e-d63c-4d9c-b7ae-ed3aa92ecb65 req-67062a05-5f4e-45f1-8ec6-4746d284b933 service nova] Lock "b9b69c9e-f91d-4681-a53b-2f0fc4b13532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:03 user nova-compute[72809]: DEBUG nova.compute.manager [req-230ebd4e-d63c-4d9c-b7ae-ed3aa92ecb65 req-67062a05-5f4e-45f1-8ec6-4746d284b933 service nova] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] No waiting events found dispatching network-vif-unplugged-664d7e69-c8c7-4ee9-980f-f58f8c8871b8 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:03 user nova-compute[72809]: DEBUG nova.compute.manager [req-230ebd4e-d63c-4d9c-b7ae-ed3aa92ecb65 req-67062a05-5f4e-45f1-8ec6-4746d284b933 service nova] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Received event network-vif-unplugged-664d7e69-c8c7-4ee9-980f-f58f8c8871b8 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 06:54:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a765779e-9723-49ab-ba10-b3168e32a056 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.493s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a765779e-9723-49ab-ba10-b3168e32a056 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.448s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:03 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Instance destroyed successfully.
Aug 09 06:54:03 user nova-compute[72809]: DEBUG nova.objects.instance [None req-38ceae82-4e57-4a0c-a2fa-9300c68dfd05 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Lazy-loading 'resources' on Instance uuid b9b69c9e-f91d-4681-a53b-2f0fc4b13532 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:54:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-38ceae82-4e57-4a0c-a2fa-9300c68dfd05 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:48:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-230315055',display_name='tempest-TestVolumeSwap-server-230315055',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-230315055',id=5,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmYwQIbAr3CRq7lDsnCNpDpu83uialt34742XzRyT9KSqAwrc0NRrQ3OvANhiJRZ4qql9TKBemINexgMq3MjiQK3cki+GxvIe3IbWxNHXOLKvM2acO2IvD1gz3kf24F6g==',key_name='tempest-keypair-511862142',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:49:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1cd7ca02c3254d4b8e5fb9ddf3ec82bd',ramdisk_id='',reservation_id='r-vhuq08lo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1821007764',owner_user_name='tempest-TestVolumeSwap-1821007764-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:49:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='692e6ee8bb5145359c5551c151451a02',uuid=b9b69c9e-f91d-4681-a53b-2f0fc4b13532,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "664d7e69-c8c7-4ee9-980f-f58f8c8871b8", "address": "fa:16:3e:90:04:36", "network": {"id": "aea61157-8f5e-461a-b77e-f5279119bc15", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1060654578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cd7ca02c3254d4b8e5fb9ddf3ec82bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664d7e69-c8", "ovs_interfaceid": "664d7e69-c8c7-4ee9-980f-f58f8c8871b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:54:03 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-38ceae82-4e57-4a0c-a2fa-9300c68dfd05 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Converting VIF {"id": "664d7e69-c8c7-4ee9-980f-f58f8c8871b8", "address": "fa:16:3e:90:04:36", "network": {"id": "aea61157-8f5e-461a-b77e-f5279119bc15", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1060654578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cd7ca02c3254d4b8e5fb9ddf3ec82bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664d7e69-c8", "ovs_interfaceid": "664d7e69-c8c7-4ee9-980f-f58f8c8871b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:54:03 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-38ceae82-4e57-4a0c-a2fa-9300c68dfd05 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:04:36,bridge_name='br-int',has_traffic_filtering=True,id=664d7e69-c8c7-4ee9-980f-f58f8c8871b8,network=Network(aea61157-8f5e-461a-b77e-f5279119bc15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap664d7e69-c8') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:54:03 user nova-compute[72809]: DEBUG os_vif [None req-38ceae82-4e57-4a0c-a2fa-9300c68dfd05 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:04:36,bridge_name='br-int',has_traffic_filtering=True,id=664d7e69-c8c7-4ee9-980f-f58f8c8871b8,network=Network(aea61157-8f5e-461a-b77e-f5279119bc15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap664d7e69-c8') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:54:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap664d7e69-c8, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:54:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:54:03 user nova-compute[72809]: INFO os_vif [None req-38ceae82-4e57-4a0c-a2fa-9300c68dfd05 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:04:36,bridge_name='br-int',has_traffic_filtering=True,id=664d7e69-c8c7-4ee9-980f-f58f8c8871b8,network=Network(aea61157-8f5e-461a-b77e-f5279119bc15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap664d7e69-c8')
Aug 09 06:54:03 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-38ceae82-4e57-4a0c-a2fa-9300c68dfd05 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Deleting instance files /opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532_del
Aug 09 06:54:03 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-38ceae82-4e57-4a0c-a2fa-9300c68dfd05 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Deletion of /opt/stack/data/nova/instances/b9b69c9e-f91d-4681-a53b-2f0fc4b13532_del complete
Aug 09 06:54:03 user nova-compute[72809]: INFO nova.compute.manager [None req-38ceae82-4e57-4a0c-a2fa-9300c68dfd05 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 09 06:54:03 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-38ceae82-4e57-4a0c-a2fa-9300c68dfd05 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 06:54:03 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 06:54:03 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 06:54:04 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:54:04 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Took 0.76 seconds to deallocate network for instance.
Aug 09 06:54:04 user nova-compute[72809]: DEBUG nova.network.neutron [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Updating instance_info_cache with network_info: [{"id": "a54c2c6b-acf2-43b8-b6cd-314710baa6fb", "address": "fa:16:3e:68:e2:17", "network": {"id": "8bb81854-eb04-46fe-99b4-dcd0b0f6845f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-129357522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54c2c6b-ac", "ovs_interfaceid": "a54c2c6b-acf2-43b8-b6cd-314710baa6fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1db9e576-a5f0-40ac-8bf6-181eec5c2d85", "address": "fa:16:3e:3b:48:01", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db9e576-a5", "ovs_interfaceid": "1db9e576-a5f0-40ac-8bf6-181eec5c2d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a076857-c138-4c63-955c-e3a9396f825f", "address": "fa:16:3e:51:09:9b", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a076857-c1", "ovs_interfaceid": "4a076857-c138-4c63-955c-e3a9396f825f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773", "address": "fa:16:3e:76:c8:43", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbbcf7b-60", "ovs_interfaceid": "8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "264f2093-5827-43e1-80a4-1a9190478f3f", "address": "fa:16:3e:3c:31:50", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264f2093-58", "ovs_interfaceid": "264f2093-5827-43e1-80a4-1a9190478f3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "153083da-b420-4260-ae35-edae5a4d37b8", "address": "fa:16:3e:2c:4b:aa", "network": {"id": "f6db78c1-51ff-449e-89e2-5b5f3df83e93", "bridge": "br-int", "label": "tempest-device-tagging-net2-538371520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153083da-b4", "ovs_interfaceid": "153083da-b420-4260-ae35-edae5a4d37b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6231c01e-c6ec-4103-8899-4cb730945ad0", "address": "fa:16:3e:ca:40:34", "network": {"id": "f6db78c1-51ff-449e-89e2-5b5f3df83e93", "bridge": "br-int", "label": "tempest-device-tagging-net2-538371520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6231c01e-c6", "ovs_interfaceid": "6231c01e-c6ec-4103-8899-4cb730945ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:54:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Releasing lock "refresh_cache-f69df9a2-e8ed-4bec-8c01-cd005432a373" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:54:04 user nova-compute[72809]: DEBUG nova.compute.manager [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Instance network_info: |[{"id": "a54c2c6b-acf2-43b8-b6cd-314710baa6fb", "address": "fa:16:3e:68:e2:17", "network": {"id": "8bb81854-eb04-46fe-99b4-dcd0b0f6845f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-129357522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54c2c6b-ac", "ovs_interfaceid": "a54c2c6b-acf2-43b8-b6cd-314710baa6fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1db9e576-a5f0-40ac-8bf6-181eec5c2d85", "address": "fa:16:3e:3b:48:01", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db9e576-a5", "ovs_interfaceid": "1db9e576-a5f0-40ac-8bf6-181eec5c2d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a076857-c138-4c63-955c-e3a9396f825f", "address": "fa:16:3e:51:09:9b", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a076857-c1", "ovs_interfaceid": "4a076857-c138-4c63-955c-e3a9396f825f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773", "address": "fa:16:3e:76:c8:43", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbbcf7b-60", "ovs_interfaceid": "8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "264f2093-5827-43e1-80a4-1a9190478f3f", "address": "fa:16:3e:3c:31:50", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264f2093-58", "ovs_interfaceid": "264f2093-5827-43e1-80a4-1a9190478f3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "153083da-b420-4260-ae35-edae5a4d37b8", "address": "fa:16:3e:2c:4b:aa", "network": {"id": "f6db78c1-51ff-449e-89e2-5b5f3df83e93", "bridge": "br-int", "label": "tempest-device-tagging-net2-538371520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153083da-b4", "ovs_interfaceid": "153083da-b420-4260-ae35-edae5a4d37b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6231c01e-c6ec-4103-8899-4cb730945ad0", "address": "fa:16:3e:ca:40:34", "network": {"id": "f6db78c1-51ff-449e-89e2-5b5f3df83e93", "bridge": "br-int", "label": "tempest-device-tagging-net2-538371520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6231c01e-c6", "ovs_interfaceid": "6231c01e-c6ec-4103-8899-4cb730945ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 06:54:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f9a72b49-f7cc-46b0-9f76-358e3232136c req-2760ec9a-3995-4aa7-8149-23625c7058c6 service nova] Acquired lock "refresh_cache-f69df9a2-e8ed-4bec-8c01-cd005432a373" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:54:04 user nova-compute[72809]: DEBUG nova.network.neutron [req-f9a72b49-f7cc-46b0-9f76-358e3232136c req-2760ec9a-3995-4aa7-8149-23625c7058c6 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Refreshing network info cache for port 153083da-b420-4260-ae35-edae5a4d37b8 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:54:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-38ceae82-4e57-4a0c-a2fa-9300c68dfd05 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-38ceae82-4e57-4a0c-a2fa-9300c68dfd05 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:04 user nova-compute[72809]: DEBUG nova.compute.manager [req-b3461bc2-68c4-4d6e-995f-c5f549419565 req-6451ae45-a72c-4812-9d28-8fdcdfb29fbb service nova] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Received event network-vif-deleted-664d7e69-c8c7-4ee9-980f-f58f8c8871b8 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:04 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-38ceae82-4e57-4a0c-a2fa-9300c68dfd05 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:54:04 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-38ceae82-4e57-4a0c-a2fa-9300c68dfd05 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:54:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-38ceae82-4e57-4a0c-a2fa-9300c68dfd05 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:04 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-38ceae82-4e57-4a0c-a2fa-9300c68dfd05 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Deleted allocations for instance b9b69c9e-f91d-4681-a53b-2f0fc4b13532
Aug 09 06:54:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-38ceae82-4e57-4a0c-a2fa-9300c68dfd05 tempest-TestVolumeSwap-1821007764 tempest-TestVolumeSwap-1821007764-project-member] Lock "b9b69c9e-f91d-4681-a53b-2f0fc4b13532" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.359s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:05 user nova-compute[72809]: DEBUG nova.compute.manager [req-23fc9e60-5855-43cb-84fb-b0b8ffc78980 req-a0674d04-0d4a-4032-9692-9ed768a0e004 service nova] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Received event network-vif-plugged-664d7e69-c8c7-4ee9-980f-f58f8c8871b8 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-23fc9e60-5855-43cb-84fb-b0b8ffc78980 req-a0674d04-0d4a-4032-9692-9ed768a0e004 service nova] Acquiring lock "b9b69c9e-f91d-4681-a53b-2f0fc4b13532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-23fc9e60-5855-43cb-84fb-b0b8ffc78980 req-a0674d04-0d4a-4032-9692-9ed768a0e004 service nova] Lock "b9b69c9e-f91d-4681-a53b-2f0fc4b13532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-23fc9e60-5855-43cb-84fb-b0b8ffc78980 req-a0674d04-0d4a-4032-9692-9ed768a0e004 service nova] Lock "b9b69c9e-f91d-4681-a53b-2f0fc4b13532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:05 user nova-compute[72809]: DEBUG nova.compute.manager [req-23fc9e60-5855-43cb-84fb-b0b8ffc78980 req-a0674d04-0d4a-4032-9692-9ed768a0e004 service nova] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] No waiting events found dispatching network-vif-plugged-664d7e69-c8c7-4ee9-980f-f58f8c8871b8 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:05 user nova-compute[72809]: WARNING nova.compute.manager [req-23fc9e60-5855-43cb-84fb-b0b8ffc78980 req-a0674d04-0d4a-4032-9692-9ed768a0e004 service nova] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Received unexpected event network-vif-plugged-664d7e69-c8c7-4ee9-980f-f58f8c8871b8 for instance with vm_state deleted and task_state None.
Aug 09 06:54:05 user nova-compute[72809]: DEBUG nova.network.neutron [req-f9a72b49-f7cc-46b0-9f76-358e3232136c req-2760ec9a-3995-4aa7-8149-23625c7058c6 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Updated VIF entry in instance network info cache for port 153083da-b420-4260-ae35-edae5a4d37b8. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:54:05 user nova-compute[72809]: DEBUG nova.network.neutron [req-f9a72b49-f7cc-46b0-9f76-358e3232136c req-2760ec9a-3995-4aa7-8149-23625c7058c6 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Updating instance_info_cache with network_info: [{"id": "a54c2c6b-acf2-43b8-b6cd-314710baa6fb", "address": "fa:16:3e:68:e2:17", "network": {"id": "8bb81854-eb04-46fe-99b4-dcd0b0f6845f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-129357522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54c2c6b-ac", "ovs_interfaceid": "a54c2c6b-acf2-43b8-b6cd-314710baa6fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1db9e576-a5f0-40ac-8bf6-181eec5c2d85", "address": "fa:16:3e:3b:48:01", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db9e576-a5", "ovs_interfaceid": "1db9e576-a5f0-40ac-8bf6-181eec5c2d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a076857-c138-4c63-955c-e3a9396f825f", "address": "fa:16:3e:51:09:9b", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a076857-c1", "ovs_interfaceid": "4a076857-c138-4c63-955c-e3a9396f825f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773", "address": "fa:16:3e:76:c8:43", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbbcf7b-60", "ovs_interfaceid": "8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "264f2093-5827-43e1-80a4-1a9190478f3f", "address": "fa:16:3e:3c:31:50", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264f2093-58", "ovs_interfaceid": "264f2093-5827-43e1-80a4-1a9190478f3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "153083da-b420-4260-ae35-edae5a4d37b8", "address": "fa:16:3e:2c:4b:aa", "network": {"id": "f6db78c1-51ff-449e-89e2-5b5f3df83e93", "bridge": "br-int", "label": "tempest-device-tagging-net2-538371520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153083da-b4", "ovs_interfaceid": "153083da-b420-4260-ae35-edae5a4d37b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6231c01e-c6ec-4103-8899-4cb730945ad0", "address": "fa:16:3e:ca:40:34", "network": {"id": "f6db78c1-51ff-449e-89e2-5b5f3df83e93", "bridge": "br-int", "label": "tempest-device-tagging-net2-538371520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6231c01e-c6", "ovs_interfaceid": "6231c01e-c6ec-4103-8899-4cb730945ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:54:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f9a72b49-f7cc-46b0-9f76-358e3232136c req-2760ec9a-3995-4aa7-8149-23625c7058c6 service nova] Releasing lock "refresh_cache-f69df9a2-e8ed-4bec-8c01-cd005432a373" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:54:05 user nova-compute[72809]: DEBUG nova.compute.manager [req-f9a72b49-f7cc-46b0-9f76-358e3232136c req-2760ec9a-3995-4aa7-8149-23625c7058c6 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-changed-6231c01e-c6ec-4103-8899-4cb730945ad0 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:05 user nova-compute[72809]: DEBUG nova.compute.manager [req-f9a72b49-f7cc-46b0-9f76-358e3232136c req-2760ec9a-3995-4aa7-8149-23625c7058c6 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Refreshing instance network info cache due to event network-changed-6231c01e-c6ec-4103-8899-4cb730945ad0. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:54:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f9a72b49-f7cc-46b0-9f76-358e3232136c req-2760ec9a-3995-4aa7-8149-23625c7058c6 service nova] Acquiring lock "refresh_cache-f69df9a2-e8ed-4bec-8c01-cd005432a373" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:54:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f9a72b49-f7cc-46b0-9f76-358e3232136c req-2760ec9a-3995-4aa7-8149-23625c7058c6 service nova] Acquired lock "refresh_cache-f69df9a2-e8ed-4bec-8c01-cd005432a373" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:54:05 user nova-compute[72809]: DEBUG nova.network.neutron [req-f9a72b49-f7cc-46b0-9f76-358e3232136c req-2760ec9a-3995-4aa7-8149-23625c7058c6 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Refreshing network info cache for port 6231c01e-c6ec-4103-8899-4cb730945ad0 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:54:05 user nova-compute[72809]: DEBUG nova.network.neutron [req-f9a72b49-f7cc-46b0-9f76-358e3232136c req-2760ec9a-3995-4aa7-8149-23625c7058c6 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Updated VIF entry in instance network info cache for port 6231c01e-c6ec-4103-8899-4cb730945ad0. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:54:05 user nova-compute[72809]: DEBUG nova.network.neutron [req-f9a72b49-f7cc-46b0-9f76-358e3232136c req-2760ec9a-3995-4aa7-8149-23625c7058c6 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Updating instance_info_cache with network_info: [{"id": "a54c2c6b-acf2-43b8-b6cd-314710baa6fb", "address": "fa:16:3e:68:e2:17", "network": {"id": "8bb81854-eb04-46fe-99b4-dcd0b0f6845f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-129357522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54c2c6b-ac", "ovs_interfaceid": "a54c2c6b-acf2-43b8-b6cd-314710baa6fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1db9e576-a5f0-40ac-8bf6-181eec5c2d85", "address": "fa:16:3e:3b:48:01", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db9e576-a5", "ovs_interfaceid": "1db9e576-a5f0-40ac-8bf6-181eec5c2d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a076857-c138-4c63-955c-e3a9396f825f", "address": "fa:16:3e:51:09:9b", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a076857-c1", "ovs_interfaceid": "4a076857-c138-4c63-955c-e3a9396f825f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773", "address": "fa:16:3e:76:c8:43", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbbcf7b-60", "ovs_interfaceid": "8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "264f2093-5827-43e1-80a4-1a9190478f3f", "address": "fa:16:3e:3c:31:50", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264f2093-58", "ovs_interfaceid": "264f2093-5827-43e1-80a4-1a9190478f3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "153083da-b420-4260-ae35-edae5a4d37b8", "address": "fa:16:3e:2c:4b:aa", "network": {"id": "f6db78c1-51ff-449e-89e2-5b5f3df83e93", "bridge": "br-int", "label": "tempest-device-tagging-net2-538371520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153083da-b4", "ovs_interfaceid": "153083da-b420-4260-ae35-edae5a4d37b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6231c01e-c6ec-4103-8899-4cb730945ad0", "address": "fa:16:3e:ca:40:34", "network": {"id": "f6db78c1-51ff-449e-89e2-5b5f3df83e93", "bridge": "br-int", "label": "tempest-device-tagging-net2-538371520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6231c01e-c6", "ovs_interfaceid": "6231c01e-c6ec-4103-8899-4cb730945ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:54:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f9a72b49-f7cc-46b0-9f76-358e3232136c req-2760ec9a-3995-4aa7-8149-23625c7058c6 service nova] Releasing lock "refresh_cache-f69df9a2-e8ed-4bec-8c01-cd005432a373" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:54:05 user nova-compute[72809]: DEBUG nova.compute.manager [req-f9a72b49-f7cc-46b0-9f76-358e3232136c req-2760ec9a-3995-4aa7-8149-23625c7058c6 service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Received event network-changed-b94aa917-6963-4aee-9bc2-15b2720191be {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:05 user nova-compute[72809]: DEBUG nova.compute.manager [req-f9a72b49-f7cc-46b0-9f76-358e3232136c req-2760ec9a-3995-4aa7-8149-23625c7058c6 service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Refreshing instance network info cache due to event network-changed-b94aa917-6963-4aee-9bc2-15b2720191be. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:54:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f9a72b49-f7cc-46b0-9f76-358e3232136c req-2760ec9a-3995-4aa7-8149-23625c7058c6 service nova] Acquiring lock "refresh_cache-aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:54:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f9a72b49-f7cc-46b0-9f76-358e3232136c req-2760ec9a-3995-4aa7-8149-23625c7058c6 service nova] Acquired lock "refresh_cache-aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:54:05 user nova-compute[72809]: DEBUG nova.network.neutron [req-f9a72b49-f7cc-46b0-9f76-358e3232136c req-2760ec9a-3995-4aa7-8149-23625c7058c6 service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Refreshing network info cache for port b94aa917-6963-4aee-9bc2-15b2720191be {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:54:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-58ac4982-2d08-40b5-9286-fda8206af5ae tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Acquiring lock "5fb24f48-e72d-4c52-ad10-aae7b37171db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-58ac4982-2d08-40b5-9286-fda8206af5ae tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "5fb24f48-e72d-4c52-ad10-aae7b37171db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-58ac4982-2d08-40b5-9286-fda8206af5ae tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Acquiring lock "5fb24f48-e72d-4c52-ad10-aae7b37171db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-58ac4982-2d08-40b5-9286-fda8206af5ae tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "5fb24f48-e72d-4c52-ad10-aae7b37171db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-58ac4982-2d08-40b5-9286-fda8206af5ae tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "5fb24f48-e72d-4c52-ad10-aae7b37171db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:06 user nova-compute[72809]: INFO nova.compute.manager [None req-58ac4982-2d08-40b5-9286-fda8206af5ae tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Terminating instance
Aug 09 06:54:06 user nova-compute[72809]: DEBUG nova.compute.manager [None req-58ac4982-2d08-40b5-9286-fda8206af5ae tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 06:54:06 user nova-compute[72809]: DEBUG nova.network.neutron [req-f9a72b49-f7cc-46b0-9f76-358e3232136c req-2760ec9a-3995-4aa7-8149-23625c7058c6 service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Updated VIF entry in instance network info cache for port b94aa917-6963-4aee-9bc2-15b2720191be. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:54:06 user nova-compute[72809]: DEBUG nova.network.neutron [req-f9a72b49-f7cc-46b0-9f76-358e3232136c req-2760ec9a-3995-4aa7-8149-23625c7058c6 service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Updating instance_info_cache with network_info: [{"id": "b94aa917-6963-4aee-9bc2-15b2720191be", "address": "fa:16:3e:5c:5d:c2", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb94aa917-69", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:54:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f9a72b49-f7cc-46b0-9f76-358e3232136c req-2760ec9a-3995-4aa7-8149-23625c7058c6 service nova] Releasing lock "refresh_cache-aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:54:06 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:06 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:06 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:06 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:06 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Instance destroyed successfully.
Aug 09 06:54:06 user nova-compute[72809]: DEBUG nova.objects.instance [None req-58ac4982-2d08-40b5-9286-fda8206af5ae tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lazy-loading 'resources' on Instance uuid 5fb24f48-e72d-4c52-ad10-aae7b37171db {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:54:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-58ac4982-2d08-40b5-9286-fda8206af5ae tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:51:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-390080409',display_name='tempest-VolumesAdminNegativeTest-server-390080409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-390080409',id=13,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:52:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06d061b94c6548d88d8c3cae6751d937',ramdisk_id='',reservation_id='r-4z0zwoku',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2043800207',owner_user_name='tempest-VolumesAdminNegativeTest-2043800207-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:52:08Z,user_data=None,user_id='6cd5e6af221a4c0d996b4da1cce17f55',uuid=5fb24f48-e72d-4c52-ad10-aae7b37171db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e6d0833-c258-4fec-bd3d-37233d8cc699", "address": "fa:16:3e:f0:1b:b0", "network": {"id": "9d98057f-37e6-42f0-9a94-2240979d38f4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-490582380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06d061b94c6548d88d8c3cae6751d937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6d0833-c2", "ovs_interfaceid": "7e6d0833-c258-4fec-bd3d-37233d8cc699", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:54:07 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-58ac4982-2d08-40b5-9286-fda8206af5ae tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Converting VIF {"id": "7e6d0833-c258-4fec-bd3d-37233d8cc699", "address": "fa:16:3e:f0:1b:b0", "network": {"id": "9d98057f-37e6-42f0-9a94-2240979d38f4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-490582380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06d061b94c6548d88d8c3cae6751d937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6d0833-c2", "ovs_interfaceid": "7e6d0833-c258-4fec-bd3d-37233d8cc699", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:54:07 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-58ac4982-2d08-40b5-9286-fda8206af5ae tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:1b:b0,bridge_name='br-int',has_traffic_filtering=True,id=7e6d0833-c258-4fec-bd3d-37233d8cc699,network=Network(9d98057f-37e6-42f0-9a94-2240979d38f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6d0833-c2') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:54:07 user nova-compute[72809]: DEBUG os_vif [None req-58ac4982-2d08-40b5-9286-fda8206af5ae tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:1b:b0,bridge_name='br-int',has_traffic_filtering=True,id=7e6d0833-c258-4fec-bd3d-37233d8cc699,network=Network(9d98057f-37e6-42f0-9a94-2240979d38f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6d0833-c2') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:54:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e6d0833-c2, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:54:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:54:07 user nova-compute[72809]: INFO os_vif [None req-58ac4982-2d08-40b5-9286-fda8206af5ae tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:1b:b0,bridge_name='br-int',has_traffic_filtering=True,id=7e6d0833-c258-4fec-bd3d-37233d8cc699,network=Network(9d98057f-37e6-42f0-9a94-2240979d38f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6d0833-c2')
Aug 09 06:54:07 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-58ac4982-2d08-40b5-9286-fda8206af5ae tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Deleting instance files /opt/stack/data/nova/instances/5fb24f48-e72d-4c52-ad10-aae7b37171db_del
Aug 09 06:54:07 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-58ac4982-2d08-40b5-9286-fda8206af5ae tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Deletion of /opt/stack/data/nova/instances/5fb24f48-e72d-4c52-ad10-aae7b37171db_del complete
Aug 09 06:54:07 user nova-compute[72809]: INFO nova.compute.manager [None req-58ac4982-2d08-40b5-9286-fda8206af5ae tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 09 06:54:07 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-58ac4982-2d08-40b5-9286-fda8206af5ae tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 06:54:07 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 06:54:07 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 06:54:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-a34e8267-3880-4ce2-8d49-a524ef2164f1 req-c18daafc-5760-4d00-893e-84703d628590 service nova] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Received event network-vif-unplugged-7e6d0833-c258-4fec-bd3d-37233d8cc699 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a34e8267-3880-4ce2-8d49-a524ef2164f1 req-c18daafc-5760-4d00-893e-84703d628590 service nova] Acquiring lock "5fb24f48-e72d-4c52-ad10-aae7b37171db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a34e8267-3880-4ce2-8d49-a524ef2164f1 req-c18daafc-5760-4d00-893e-84703d628590 service nova] Lock "5fb24f48-e72d-4c52-ad10-aae7b37171db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a34e8267-3880-4ce2-8d49-a524ef2164f1 req-c18daafc-5760-4d00-893e-84703d628590 service nova] Lock "5fb24f48-e72d-4c52-ad10-aae7b37171db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-a34e8267-3880-4ce2-8d49-a524ef2164f1 req-c18daafc-5760-4d00-893e-84703d628590 service nova] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] No waiting events found dispatching network-vif-unplugged-7e6d0833-c258-4fec-bd3d-37233d8cc699 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-a34e8267-3880-4ce2-8d49-a524ef2164f1 req-c18daafc-5760-4d00-893e-84703d628590 service nova] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Received event network-vif-unplugged-7e6d0833-c258-4fec-bd3d-37233d8cc699 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 06:54:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-a34e8267-3880-4ce2-8d49-a524ef2164f1 req-c18daafc-5760-4d00-893e-84703d628590 service nova] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Received event network-vif-plugged-7e6d0833-c258-4fec-bd3d-37233d8cc699 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a34e8267-3880-4ce2-8d49-a524ef2164f1 req-c18daafc-5760-4d00-893e-84703d628590 service nova] Acquiring lock "5fb24f48-e72d-4c52-ad10-aae7b37171db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a34e8267-3880-4ce2-8d49-a524ef2164f1 req-c18daafc-5760-4d00-893e-84703d628590 service nova] Lock "5fb24f48-e72d-4c52-ad10-aae7b37171db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a34e8267-3880-4ce2-8d49-a524ef2164f1 req-c18daafc-5760-4d00-893e-84703d628590 service nova] Lock "5fb24f48-e72d-4c52-ad10-aae7b37171db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-a34e8267-3880-4ce2-8d49-a524ef2164f1 req-c18daafc-5760-4d00-893e-84703d628590 service nova] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] No waiting events found dispatching network-vif-plugged-7e6d0833-c258-4fec-bd3d-37233d8cc699 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:07 user nova-compute[72809]: WARNING nova.compute.manager [req-a34e8267-3880-4ce2-8d49-a524ef2164f1 req-c18daafc-5760-4d00-893e-84703d628590 service nova] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Received unexpected event network-vif-plugged-7e6d0833-c258-4fec-bd3d-37233d8cc699 for instance with vm_state active and task_state deleting.
Aug 09 06:54:07 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:54:07 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Took 0.59 seconds to deallocate network for instance.
Aug 09 06:54:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-448e9b4e-b7e6-4933-8587-bf5ed002ab92 req-262bbf01-49eb-4271-b46b-37ba07eb8a63 service nova] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Received event network-vif-deleted-7e6d0833-c258-4fec-bd3d-37233d8cc699 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-58ac4982-2d08-40b5-9286-fda8206af5ae tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-58ac4982-2d08-40b5-9286-fda8206af5ae tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:08 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-58ac4982-2d08-40b5-9286-fda8206af5ae tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:54:08 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-58ac4982-2d08-40b5-9286-fda8206af5ae tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:54:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-58ac4982-2d08-40b5-9286-fda8206af5ae tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:08 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-58ac4982-2d08-40b5-9286-fda8206af5ae tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Deleted allocations for instance 5fb24f48-e72d-4c52-ad10-aae7b37171db
Aug 09 06:54:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-58ac4982-2d08-40b5-9286-fda8206af5ae tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "5fb24f48-e72d-4c52-ad10-aae7b37171db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.966s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:10 user nova-compute[72809]: INFO nova.virt.block_device [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Booting with volume ff653a94-36f6-4aff-9f9b-aca88282c8ce at /dev/vdc
Aug 09 06:54:10 user nova-compute[72809]: DEBUG os_brick.utils [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:54:10 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:10 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:10 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55aa5f4-53b0-4934-be02-76a7617adec1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:10 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:10 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:10 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[87817a5e-825e-490a-9857-c9d2d3e4906a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:10 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:10 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:10 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddab6e33-ef63-4091-8fe4-7b014a772797]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:10 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ee878e-966e-44f3-a12e-d8e1c0bd07af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:10 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:10 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:54:10 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 06:54:10 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:10 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:54:10 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 06:54:10 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[096afbda-ac5d-478a-a283-a0d9fa9b18d8]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:10 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 06:54:10 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 06:54:10 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 06:54:10 user nova-compute[72809]: DEBUG os_brick.utils [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:54:10 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Updating existing volume attachment record: 2c8c0a4b-4fce-4da6-af08-b9184e4d1062 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 06:54:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:12 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691564037.4733448, aec0a7ee-69e1-41cf-bfa8-5733bdedd70a => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:54:12 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] VM Stopped (Lifecycle Event)
Aug 09 06:54:12 user nova-compute[72809]: DEBUG nova.compute.manager [None req-79dcceff-caaf-4107-b9fc-cde893e5f4ab None None] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:54:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:18 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691564043.3979564, b9b69c9e-f91d-4681-a53b-2f0fc4b13532 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:54:18 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] VM Stopped (Lifecycle Event)
Aug 09 06:54:18 user nova-compute[72809]: DEBUG nova.compute.manager [None req-58d91087-0cfa-4ae5-aacb-0c0c68003060 None None] [instance: b9b69c9e-f91d-4681-a53b-2f0fc4b13532] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG nova.compute.manager [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 06:54:19 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Creating image(s)
Aug 09 06:54:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Did not create local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Ensure instance console log exists: /opt/stack/data/nova/instances/f69df9a2-e8ed-4bec-8c01-cd005432a373/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Start _get_guest_xml network_info=[{"id": "a54c2c6b-acf2-43b8-b6cd-314710baa6fb", "address": "fa:16:3e:68:e2:17", "network": {"id": "8bb81854-eb04-46fe-99b4-dcd0b0f6845f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-129357522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54c2c6b-ac", "ovs_interfaceid": "a54c2c6b-acf2-43b8-b6cd-314710baa6fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1db9e576-a5f0-40ac-8bf6-181eec5c2d85", "address": "fa:16:3e:3b:48:01", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db9e576-a5", "ovs_interfaceid": "1db9e576-a5f0-40ac-8bf6-181eec5c2d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a076857-c138-4c63-955c-e3a9396f825f", "address": "fa:16:3e:51:09:9b", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a076857-c1", "ovs_interfaceid": "4a076857-c138-4c63-955c-e3a9396f825f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773", "address": "fa:16:3e:76:c8:43", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbbcf7b-60", "ovs_interfaceid": "8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "264f2093-5827-43e1-80a4-1a9190478f3f", "address": "fa:16:3e:3c:31:50", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264f2093-58", "ovs_interfaceid": "264f2093-5827-43e1-80a4-1a9190478f3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "153083da-b420-4260-ae35-edae5a4d37b8", "address": "fa:16:3e:2c:4b:aa", "network": {"id": "f6db78c1-51ff-449e-89e2-5b5f3df83e93", "bridge": "br-int", "label": "tempest-device-tagging-net2-538371520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153083da-b4", "ovs_interfaceid": "153083da-b420-4260-ae35-edae5a4d37b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6231c01e-c6ec-4103-8899-4cb730945ad0", "address": "fa:16:3e:ca:40:34", "network": {"id": "f6db78c1-51ff-449e-89e2-5b5f3df83e93", "bridge": "br-int", "label": "tempest-device-tagging-net2-538371520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6231c01e-c6", "ovs_interfaceid": "6231c01e-c6ec-4103-8899-4cb730945ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KsPeaXqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f69df9a2-e8ed-4bec-8c01-cd005432a373', 'attached_at': '', 'detached_at': '', 'volume_id': '607e8c3a-2fac-41e7-98b9-f5dec95d58cb', 'serial': '607e8c3a-2fac-41e7-98b9-f5dec95d58cb'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': 0, 'attachment_id': '3e5d7b3d-5018-40a8-a5a6-a75ded225cc9', 'volume_type': None}, {'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYHOxVPf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f69df9a2-e8ed-4bec-8c01-cd005432a373', 'attached_at': '', 'detached_at': '', 'volume_id': 'f8b0e7d8-187c-44b9-a029-076cfd62a9dd', 'serial': 'f8b0e7d8-187c-44b9-a029-076cfd62a9dd'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': 1, 'attachment_id': '559c669a-c85d-4416-96a2-22b6888e69a0', 'volume_type': None}, {'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kfOpFoZn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f69df9a2-e8ed-4bec-8c01-cd005432a373', 'attached_at': '', 'detached_at': '', 'volume_id': 'ff653a94-36f6-4aff-9f9b-aca88282c8ce', 'serial': 'ff653a94-36f6-4aff-9f9b-aca88282c8ce'}, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': 2, 'attachment_id': '2c8c0a4b-4fce-4da6-af08-b9184e4d1062', 'volume_type': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:54:19 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:54:19 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:54:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KsPeaXqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:54:19 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:54:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:54:19 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:54:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:54:19 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fee9c52-3876-4799-8570-cde58a0e9c63]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 06:54:19 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[892874a8-79fa-41ee-b725-a0144c936f96]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb] added
Aug 09 06:54:19 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ffe299-9f9c-41f4-ad41-bc33f1b55b10]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15244ac-5014-48ae-951f-1b12baae0ff5]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KsPeaXqp {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KsPeaXqp" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[880a1813-c2a5-4b84-bebe-9ef7705bfbe0]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KsPeaXqp'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02c575b-2c88-4151-9a25-4561b4a2ceec]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2c6359-b57c-40e5-b9e5-94e721bc6d72]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:54:19 user nova-compute[72809]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:54:19 user nova-compute[72809]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:54:19 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:54:19 user nova-compute[72809]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:54:19 user nova-compute[72809]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:54:19 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e25e50c-a1cf-4879-be30-da9c9b2a37c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb, portal: 172.16.0.220,3260]
Aug 09 06:54:19 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb, portal: 172.16.0.220,3260] successful.
Aug 09 06:54:19 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[67171729-a355-4299-8d6e-43319db1015b]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff659d44-9a8f-4bb6-bbf6-524ca38e70be]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:54:19 user nova-compute[72809]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:54:19 user nova-compute[72809]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:54:19 user nova-compute[72809]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)
Aug 09 06:54:19 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:54:19 user nova-compute[72809]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:54:19 user nova-compute[72809]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:54:19 user nova-compute[72809]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)
Aug 09 06:54:19 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] HCTL ('36', '-', '-', 0) found on session 14 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b298f31d-ace3-41a3-8d9d-443276d90452]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Searching for a device in session 14 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 06:54:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KsPeaXqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 06:54:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:54:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23066636136343838', 'path': '/dev/sde'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:54:20 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066636136343838', 'path': '/dev/sde'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 06:54:20 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 06:54:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYHOxVPf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:54:20 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:54:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:54:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:54:20 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:54:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:54:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:54:20 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 06:54:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a4bf71-8135-45cc-9537-154215837909]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 06:54:21 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e3769f-3e2b-43a9-99f4-34447e02b362]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd] added
Aug 09 06:54:21 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36c9774-a35c-43fa-9163-40e074c9df6d]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.134s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[322dd3c3-9d74-4f65-ab1d-ee2227b2aa14]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RYHOxVPf {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RYHOxVPf" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3147c6-d3aa-4fc9-8293-03c87e5f083d]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RYHOxVPf'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a46606-3961-431e-a801-cedff67903e2]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[994c4868-897d-4430-a42d-790d48e9f03a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:54:21 user nova-compute[72809]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:54:21 user nova-compute[72809]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:54:21 user nova-compute[72809]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)
Aug 09 06:54:21 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:54:21 user nova-compute[72809]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:54:21 user nova-compute[72809]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:54:21 user nova-compute[72809]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)
Aug 09 06:54:21 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[950bc1fd-9ff1-472f-b493-c170f874202e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd, portal: 172.16.0.220,3260]
Aug 09 06:54:21 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd, portal: 172.16.0.220,3260] successful.
Aug 09 06:54:21 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e645b7-92f8-4460-bf70-fb9b4169e39b]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3941f8-e85f-45dc-ae46-fea737488acd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:54:21 user nova-compute[72809]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:54:21 user nova-compute[72809]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:54:21 user nova-compute[72809]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)
Aug 09 06:54:21 user nova-compute[72809]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)
Aug 09 06:54:21 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:54:21 user nova-compute[72809]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:54:21 user nova-compute[72809]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:54:21 user nova-compute[72809]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)
Aug 09 06:54:21 user nova-compute[72809]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)
Aug 09 06:54:21 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.402s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] HCTL ('37', '-', '-', 0) found on session 15 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0aba5b-2f6d-4e4f-99ab-9673f01347c1]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Searching for a device in session 15 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYHOxVPf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 06:54:21 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691564046.991955, 5fb24f48-e72d-4c52-ad10-aae7b37171db => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:54:21 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] VM Stopped (Lifecycle Event)
Aug 09 06:54:22 user nova-compute[72809]: DEBUG nova.compute.manager [None req-8120fba8-832d-42aa-95f0-1136fdc5377b None None] [instance: 5fb24f48-e72d-4c52-ad10-aae7b37171db] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.435s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] <== connect_volume: return (1436ms) {'type': 'block', 'scsi_wwn': '23163656330336164', 'path': '/dev/sdf'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163656330336164', 'path': '/dev/sdf'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kfOpFoZn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:54:22 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:54:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:54:22 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:54:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:54:22 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 06:54:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[00907c01-26ca-4d8c-8656-02eb08450acf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 06:54:22 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb5b22f-1ad5-4225-9548-56aa79b0e098]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce] added
Aug 09 06:54:22 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9051cae4-e2a2-4968-8f72-1afe8313bd55]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9575ecc-215a-401c-ac9c-07d65f3b7837]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kfOpFoZn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kfOpFoZn" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34b3aa5-7ac5-4a73-a363-d15ce0c065a6]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kfOpFoZn'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ec4112-0f61-4996-b4e7-9e6ff132bcba]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0db879a-1109-45d5-b2a9-aef92aa5ecc2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:54:22 user nova-compute[72809]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:54:22 user nova-compute[72809]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:54:22 user nova-compute[72809]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)
Aug 09 06:54:22 user nova-compute[72809]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)
Aug 09 06:54:22 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:54:22 user nova-compute[72809]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:54:22 user nova-compute[72809]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:54:22 user nova-compute[72809]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)
Aug 09 06:54:22 user nova-compute[72809]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)
Aug 09 06:54:22 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6131d183-7858-4beb-80e7-f0d5c0079d19]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce, portal: 172.16.0.220,3260]
Aug 09 06:54:22 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce, portal: 172.16.0.220,3260] successful.
Aug 09 06:54:22 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf108e8b-3179-4cfe-8676-0a242836846d]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a5eeed-e097-47c5-b032-6045a2db9ec3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:54:22 user nova-compute[72809]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:54:22 user nova-compute[72809]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:54:22 user nova-compute[72809]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)
Aug 09 06:54:22 user nova-compute[72809]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)
Aug 09 06:54:22 user nova-compute[72809]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)
Aug 09 06:54:22 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:54:22 user nova-compute[72809]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:54:22 user nova-compute[72809]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:54:22 user nova-compute[72809]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)
Aug 09 06:54:22 user nova-compute[72809]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)
Aug 09 06:54:22 user nova-compute[72809]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)
Aug 09 06:54:22 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] HCTL ('38', '-', '-', 0) found on session 16 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e401c7b-3b88-4a54-924c-efb053c46a48]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Searching for a device in session 16 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 06:54:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kfOpFoZn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23238346266333239', 'path': '/dev/sdg'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238346266333239', 'path': '/dev/sdg'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:53:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802868567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802868567',id=17,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7vsFRH8+QDNzfaJco48VmChAa1NTjfgrxrKV+K3cyOBxdBmpRm8dtdBfKusTNZw+eF3Jox4xjZZl93GKy+irR0T4OrQJ5DlVZ2As7Kz7Ef5hFmacrwCFHQpY+LYq12Wg==',key_name='tempest-keypair-1117604385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b6463729fb40a7ae708ac0f188263b',ramdisk_id='',reservation_id='r-24nqzfoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1529004159',owner_user_name='tempest-TaggedBootDevicesTest-1529004159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:53:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99e1c9eec3e6402482269c9878ac9987',uuid=f69df9a2-e8ed-4bec-8c01-cd005432a373,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a54c2c6b-acf2-43b8-b6cd-314710baa6fb", "address": "fa:16:3e:68:e2:17", "network": {"id": "8bb81854-eb04-46fe-99b4-dcd0b0f6845f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-129357522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54c2c6b-ac", "ovs_interfaceid": "a54c2c6b-acf2-43b8-b6cd-314710baa6fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converting VIF {"id": "a54c2c6b-acf2-43b8-b6cd-314710baa6fb", "address": "fa:16:3e:68:e2:17", "network": {"id": "8bb81854-eb04-46fe-99b4-dcd0b0f6845f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-129357522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54c2c6b-ac", "ovs_interfaceid": "a54c2c6b-acf2-43b8-b6cd-314710baa6fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:e2:17,bridge_name='br-int',has_traffic_filtering=True,id=a54c2c6b-acf2-43b8-b6cd-314710baa6fb,network=Network(8bb81854-eb04-46fe-99b4-dcd0b0f6845f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54c2c6b-ac') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:53:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802868567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802868567',id=17,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7vsFRH8+QDNzfaJco48VmChAa1NTjfgrxrKV+K3cyOBxdBmpRm8dtdBfKusTNZw+eF3Jox4xjZZl93GKy+irR0T4OrQJ5DlVZ2As7Kz7Ef5hFmacrwCFHQpY+LYq12Wg==',key_name='tempest-keypair-1117604385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b6463729fb40a7ae708ac0f188263b',ramdisk_id='',reservation_id='r-24nqzfoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1529004159',owner_user_name='tempest-TaggedBootDevicesTest-1529004159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:53:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99e1c9eec3e6402482269c9878ac9987',uuid=f69df9a2-e8ed-4bec-8c01-cd005432a373,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1db9e576-a5f0-40ac-8bf6-181eec5c2d85", "address": "fa:16:3e:3b:48:01", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db9e576-a5", "ovs_interfaceid": "1db9e576-a5f0-40ac-8bf6-181eec5c2d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converting VIF {"id": "1db9e576-a5f0-40ac-8bf6-181eec5c2d85", "address": "fa:16:3e:3b:48:01", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db9e576-a5", "ovs_interfaceid": "1db9e576-a5f0-40ac-8bf6-181eec5c2d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:48:01,bridge_name='br-int',has_traffic_filtering=True,id=1db9e576-a5f0-40ac-8bf6-181eec5c2d85,network=Network(201c59b3-f13e-4692-9b61-8cc4c753b3af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1db9e576-a5') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:53:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802868567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802868567',id=17,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7vsFRH8+QDNzfaJco48VmChAa1NTjfgrxrKV+K3cyOBxdBmpRm8dtdBfKusTNZw+eF3Jox4xjZZl93GKy+irR0T4OrQJ5DlVZ2As7Kz7Ef5hFmacrwCFHQpY+LYq12Wg==',key_name='tempest-keypair-1117604385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b6463729fb40a7ae708ac0f188263b',ramdisk_id='',reservation_id='r-24nqzfoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1529004159',owner_user_name='tempest-TaggedBootDevicesTest-1529004159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:53:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99e1c9eec3e6402482269c9878ac9987',uuid=f69df9a2-e8ed-4bec-8c01-cd005432a373,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a076857-c138-4c63-955c-e3a9396f825f", "address": "fa:16:3e:51:09:9b", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a076857-c1", "ovs_interfaceid": "4a076857-c138-4c63-955c-e3a9396f825f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converting VIF {"id": "4a076857-c138-4c63-955c-e3a9396f825f", "address": "fa:16:3e:51:09:9b", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a076857-c1", "ovs_interfaceid": "4a076857-c138-4c63-955c-e3a9396f825f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:09:9b,bridge_name='br-int',has_traffic_filtering=True,id=4a076857-c138-4c63-955c-e3a9396f825f,network=Network(201c59b3-f13e-4692-9b61-8cc4c753b3af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4a076857-c1') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:53:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802868567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802868567',id=17,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7vsFRH8+QDNzfaJco48VmChAa1NTjfgrxrKV+K3cyOBxdBmpRm8dtdBfKusTNZw+eF3Jox4xjZZl93GKy+irR0T4OrQJ5DlVZ2As7Kz7Ef5hFmacrwCFHQpY+LYq12Wg==',key_name='tempest-keypair-1117604385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b6463729fb40a7ae708ac0f188263b',ramdisk_id='',reservation_id='r-24nqzfoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1529004159',owner_user_name='tempest-TaggedBootDevicesTest-1529004159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:53:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99e1c9eec3e6402482269c9878ac9987',uuid=f69df9a2-e8ed-4bec-8c01-cd005432a373,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773", "address": "fa:16:3e:76:c8:43", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbbcf7b-60", "ovs_interfaceid": "8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converting VIF {"id": "8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773", "address": "fa:16:3e:76:c8:43", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbbcf7b-60", "ovs_interfaceid": "8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:c8:43,bridge_name='br-int',has_traffic_filtering=True,id=8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773,network=Network(201c59b3-f13e-4692-9b61-8cc4c753b3af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbbcf7b-60') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:53:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802868567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802868567',id=17,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7vsFRH8+QDNzfaJco48VmChAa1NTjfgrxrKV+K3cyOBxdBmpRm8dtdBfKusTNZw+eF3Jox4xjZZl93GKy+irR0T4OrQJ5DlVZ2As7Kz7Ef5hFmacrwCFHQpY+LYq12Wg==',key_name='tempest-keypair-1117604385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b6463729fb40a7ae708ac0f188263b',ramdisk_id='',reservation_id='r-24nqzfoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1529004159',owner_user_name='tempest-TaggedBootDevicesTest-1529004159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:53:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99e1c9eec3e6402482269c9878ac9987',uuid=f69df9a2-e8ed-4bec-8c01-cd005432a373,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "264f2093-5827-43e1-80a4-1a9190478f3f", "address": "fa:16:3e:3c:31:50", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264f2093-58", "ovs_interfaceid": "264f2093-5827-43e1-80a4-1a9190478f3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converting VIF {"id": "264f2093-5827-43e1-80a4-1a9190478f3f", "address": "fa:16:3e:3c:31:50", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264f2093-58", "ovs_interfaceid": "264f2093-5827-43e1-80a4-1a9190478f3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:31:50,bridge_name='br-int',has_traffic_filtering=True,id=264f2093-5827-43e1-80a4-1a9190478f3f,network=Network(201c59b3-f13e-4692-9b61-8cc4c753b3af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap264f2093-58') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:53:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802868567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802868567',id=17,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7vsFRH8+QDNzfaJco48VmChAa1NTjfgrxrKV+K3cyOBxdBmpRm8dtdBfKusTNZw+eF3Jox4xjZZl93GKy+irR0T4OrQJ5DlVZ2As7Kz7Ef5hFmacrwCFHQpY+LYq12Wg==',key_name='tempest-keypair-1117604385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b6463729fb40a7ae708ac0f188263b',ramdisk_id='',reservation_id='r-24nqzfoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1529004159',owner_user_name='tempest-TaggedBootDevicesTest-1529004159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:53:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99e1c9eec3e6402482269c9878ac9987',uuid=f69df9a2-e8ed-4bec-8c01-cd005432a373,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "153083da-b420-4260-ae35-edae5a4d37b8", "address": "fa:16:3e:2c:4b:aa", "network": {"id": "f6db78c1-51ff-449e-89e2-5b5f3df83e93", "bridge": "br-int", "label": "tempest-device-tagging-net2-538371520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153083da-b4", "ovs_interfaceid": "153083da-b420-4260-ae35-edae5a4d37b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converting VIF {"id": "153083da-b420-4260-ae35-edae5a4d37b8", "address": "fa:16:3e:2c:4b:aa", "network": {"id": "f6db78c1-51ff-449e-89e2-5b5f3df83e93", "bridge": "br-int", "label": "tempest-device-tagging-net2-538371520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153083da-b4", "ovs_interfaceid": "153083da-b420-4260-ae35-edae5a4d37b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:4b:aa,bridge_name='br-int',has_traffic_filtering=True,id=153083da-b420-4260-ae35-edae5a4d37b8,network=Network(f6db78c1-51ff-449e-89e2-5b5f3df83e93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap153083da-b4') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:53:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802868567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802868567',id=17,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7vsFRH8+QDNzfaJco48VmChAa1NTjfgrxrKV+K3cyOBxdBmpRm8dtdBfKusTNZw+eF3Jox4xjZZl93GKy+irR0T4OrQJ5DlVZ2As7Kz7Ef5hFmacrwCFHQpY+LYq12Wg==',key_name='tempest-keypair-1117604385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b6463729fb40a7ae708ac0f188263b',ramdisk_id='',reservation_id='r-24nqzfoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1529004159',owner_user_name='tempest-TaggedBootDevicesTest-1529004159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:53:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99e1c9eec3e6402482269c9878ac9987',uuid=f69df9a2-e8ed-4bec-8c01-cd005432a373,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6231c01e-c6ec-4103-8899-4cb730945ad0", "address": "fa:16:3e:ca:40:34", "network": {"id": "f6db78c1-51ff-449e-89e2-5b5f3df83e93", "bridge": "br-int", "label": "tempest-device-tagging-net2-538371520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6231c01e-c6", "ovs_interfaceid": "6231c01e-c6ec-4103-8899-4cb730945ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converting VIF {"id": "6231c01e-c6ec-4103-8899-4cb730945ad0", "address": "fa:16:3e:ca:40:34", "network": {"id": "f6db78c1-51ff-449e-89e2-5b5f3df83e93", "bridge": "br-int", "label": "tempest-device-tagging-net2-538371520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6231c01e-c6", "ovs_interfaceid": "6231c01e-c6ec-4103-8899-4cb730945ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:40:34,bridge_name='br-int',has_traffic_filtering=True,id=6231c01e-c6ec-4103-8899-4cb730945ad0,network=Network(f6db78c1-51ff-449e-89e2-5b5f3df83e93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6231c01e-c6') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.objects.instance [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Lazy-loading 'pci_devices' on Instance uuid f69df9a2-e8ed-4bec-8c01-cd005432a373 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:54:23 user nova-compute[72809]:   <uuid>f69df9a2-e8ed-4bec-8c01-cd005432a373</uuid>
Aug 09 06:54:23 user nova-compute[72809]:   <name>instance-00000011</name>
Aug 09 06:54:23 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:54:23 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:54:23 user nova-compute[72809]:   <metadata>
Aug 09 06:54:23 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:54:23 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:54:23 user nova-compute[72809]:       <nova:name>tempest-device-tagging-server-1802868567</nova:name>
Aug 09 06:54:23 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:54:19</nova:creationTime>
Aug 09 06:54:23 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:54:23 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:54:23 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:54:23 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:54:23 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:54:23 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:54:23 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:54:23 user nova-compute[72809]:       <nova:owner>
Aug 09 06:54:23 user nova-compute[72809]:         <nova:user uuid="99e1c9eec3e6402482269c9878ac9987">tempest-TaggedBootDevicesTest-1529004159-project-member</nova:user>
Aug 09 06:54:23 user nova-compute[72809]:         <nova:project uuid="71b6463729fb40a7ae708ac0f188263b">tempest-TaggedBootDevicesTest-1529004159</nova:project>
Aug 09 06:54:23 user nova-compute[72809]:       </nova:owner>
Aug 09 06:54:23 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:54:23 user nova-compute[72809]:       <nova:ports>
Aug 09 06:54:23 user nova-compute[72809]:         <nova:port uuid="a54c2c6b-acf2-43b8-b6cd-314710baa6fb">
Aug 09 06:54:23 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 06:54:23 user nova-compute[72809]:         </nova:port>
Aug 09 06:54:23 user nova-compute[72809]:         <nova:port uuid="1db9e576-a5f0-40ac-8bf6-181eec5c2d85">
Aug 09 06:54:23 user nova-compute[72809]:           <nova:ip type="fixed" address="10.1.1.4" ipVersion="4"/>
Aug 09 06:54:23 user nova-compute[72809]:         </nova:port>
Aug 09 06:54:23 user nova-compute[72809]:         <nova:port uuid="4a076857-c138-4c63-955c-e3a9396f825f">
Aug 09 06:54:23 user nova-compute[72809]:           <nova:ip type="fixed" address="10.1.1.142" ipVersion="4"/>
Aug 09 06:54:23 user nova-compute[72809]:         </nova:port>
Aug 09 06:54:23 user nova-compute[72809]:         <nova:port uuid="8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773">
Aug 09 06:54:23 user nova-compute[72809]:           <nova:ip type="fixed" address="10.1.1.52" ipVersion="4"/>
Aug 09 06:54:23 user nova-compute[72809]:         </nova:port>
Aug 09 06:54:23 user nova-compute[72809]:         <nova:port uuid="264f2093-5827-43e1-80a4-1a9190478f3f">
Aug 09 06:54:23 user nova-compute[72809]:           <nova:ip type="fixed" address="10.1.1.75" ipVersion="4"/>
Aug 09 06:54:23 user nova-compute[72809]:         </nova:port>
Aug 09 06:54:23 user nova-compute[72809]:         <nova:port uuid="153083da-b420-4260-ae35-edae5a4d37b8">
Aug 09 06:54:23 user nova-compute[72809]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 09 06:54:23 user nova-compute[72809]:         </nova:port>
Aug 09 06:54:23 user nova-compute[72809]:         <nova:port uuid="6231c01e-c6ec-4103-8899-4cb730945ad0">
Aug 09 06:54:23 user nova-compute[72809]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 09 06:54:23 user nova-compute[72809]:         </nova:port>
Aug 09 06:54:23 user nova-compute[72809]:       </nova:ports>
Aug 09 06:54:23 user nova-compute[72809]:     </nova:instance>
Aug 09 06:54:23 user nova-compute[72809]:   </metadata>
Aug 09 06:54:23 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:54:23 user nova-compute[72809]:     <system>
Aug 09 06:54:23 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:54:23 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:54:23 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:54:23 user nova-compute[72809]:       <entry name="serial">f69df9a2-e8ed-4bec-8c01-cd005432a373</entry>
Aug 09 06:54:23 user nova-compute[72809]:       <entry name="uuid">f69df9a2-e8ed-4bec-8c01-cd005432a373</entry>
Aug 09 06:54:23 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:54:23 user nova-compute[72809]:     </system>
Aug 09 06:54:23 user nova-compute[72809]:   </sysinfo>
Aug 09 06:54:23 user nova-compute[72809]:   <os>
Aug 09 06:54:23 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:54:23 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 06:54:23 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:54:23 user nova-compute[72809]:   </os>
Aug 09 06:54:23 user nova-compute[72809]:   <features>
Aug 09 06:54:23 user nova-compute[72809]:     <acpi/>
Aug 09 06:54:23 user nova-compute[72809]:     <apic/>
Aug 09 06:54:23 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:54:23 user nova-compute[72809]:   </features>
Aug 09 06:54:23 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:54:23 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:54:23 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:54:23 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:54:23 user nova-compute[72809]:   </clock>
Aug 09 06:54:23 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:54:23 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:54:23 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:54:23 user nova-compute[72809]:   </cpu>
Aug 09 06:54:23 user nova-compute[72809]:   <devices>
Aug 09 06:54:23 user nova-compute[72809]:     <disk type="file" device="cdrom">
Aug 09 06:54:23 user nova-compute[72809]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 06:54:23 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/f69df9a2-e8ed-4bec-8c01-cd005432a373/disk.config"/>
Aug 09 06:54:23 user nova-compute[72809]:       <target dev="hda" bus="ide"/>
Aug 09 06:54:23 user nova-compute[72809]:     </disk>
Aug 09 06:54:23 user nova-compute[72809]:     <disk type="block" device="disk">
Aug 09 06:54:23 user nova-compute[72809]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:54:23 user nova-compute[72809]:       <source dev="/dev/sde"/>
Aug 09 06:54:23 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:54:23 user nova-compute[72809]:       <serial>607e8c3a-2fac-41e7-98b9-f5dec95d58cb</serial>
Aug 09 06:54:23 user nova-compute[72809]:     </disk>
Aug 09 06:54:23 user nova-compute[72809]:     <disk type="block" device="disk">
Aug 09 06:54:23 user nova-compute[72809]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:54:23 user nova-compute[72809]:       <source dev="/dev/sdf"/>
Aug 09 06:54:23 user nova-compute[72809]:       <target dev="vdb" bus="virtio"/>
Aug 09 06:54:23 user nova-compute[72809]:       <serial>f8b0e7d8-187c-44b9-a029-076cfd62a9dd</serial>
Aug 09 06:54:23 user nova-compute[72809]:     </disk>
Aug 09 06:54:23 user nova-compute[72809]:     <disk type="block" device="disk">
Aug 09 06:54:23 user nova-compute[72809]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:54:23 user nova-compute[72809]:       <source dev="/dev/sdg"/>
Aug 09 06:54:23 user nova-compute[72809]:       <target dev="vdc" bus="virtio"/>
Aug 09 06:54:23 user nova-compute[72809]:       <serial>ff653a94-36f6-4aff-9f9b-aca88282c8ce</serial>
Aug 09 06:54:23 user nova-compute[72809]:     </disk>
Aug 09 06:54:23 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:54:23 user nova-compute[72809]:       <mac address="fa:16:3e:68:e2:17"/>
Aug 09 06:54:23 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:54:23 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:54:23 user nova-compute[72809]:       <target dev="tapa54c2c6b-ac"/>
Aug 09 06:54:23 user nova-compute[72809]:     </interface>
Aug 09 06:54:23 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:54:23 user nova-compute[72809]:       <mac address="fa:16:3e:3b:48:01"/>
Aug 09 06:54:23 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:54:23 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:54:23 user nova-compute[72809]:       <target dev="tap1db9e576-a5"/>
Aug 09 06:54:23 user nova-compute[72809]:     </interface>
Aug 09 06:54:23 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:54:23 user nova-compute[72809]:       <mac address="fa:16:3e:51:09:9b"/>
Aug 09 06:54:23 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:54:23 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:54:23 user nova-compute[72809]:       <target dev="tap4a076857-c1"/>
Aug 09 06:54:23 user nova-compute[72809]:     </interface>
Aug 09 06:54:23 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:54:23 user nova-compute[72809]:       <mac address="fa:16:3e:76:c8:43"/>
Aug 09 06:54:23 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:54:23 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:54:23 user nova-compute[72809]:       <target dev="tap8fbbcf7b-60"/>
Aug 09 06:54:23 user nova-compute[72809]:     </interface>
Aug 09 06:54:23 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:54:23 user nova-compute[72809]:       <mac address="fa:16:3e:3c:31:50"/>
Aug 09 06:54:23 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:54:23 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:54:23 user nova-compute[72809]:       <target dev="tap264f2093-58"/>
Aug 09 06:54:23 user nova-compute[72809]:     </interface>
Aug 09 06:54:23 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:54:23 user nova-compute[72809]:       <mac address="fa:16:3e:2c:4b:aa"/>
Aug 09 06:54:23 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:54:23 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:54:23 user nova-compute[72809]:       <target dev="tap153083da-b4"/>
Aug 09 06:54:23 user nova-compute[72809]:     </interface>
Aug 09 06:54:23 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:54:23 user nova-compute[72809]:       <mac address="fa:16:3e:ca:40:34"/>
Aug 09 06:54:23 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:54:23 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:54:23 user nova-compute[72809]:       <target dev="tap6231c01e-c6"/>
Aug 09 06:54:23 user nova-compute[72809]:     </interface>
Aug 09 06:54:23 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:54:23 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/f69df9a2-e8ed-4bec-8c01-cd005432a373/console.log" append="off"/>
Aug 09 06:54:23 user nova-compute[72809]:     </serial>
Aug 09 06:54:23 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:54:23 user nova-compute[72809]:     <video>
Aug 09 06:54:23 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:54:23 user nova-compute[72809]:     </video>
Aug 09 06:54:23 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:54:23 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:54:23 user nova-compute[72809]:     </rng>
Aug 09 06:54:23 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:54:23 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:54:23 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:54:23 user nova-compute[72809]:     </memballoon>
Aug 09 06:54:23 user nova-compute[72809]:   </devices>
Aug 09 06:54:23 user nova-compute[72809]: </domain>
Aug 09 06:54:23 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:53:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802868567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802868567',id=17,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7vsFRH8+QDNzfaJco48VmChAa1NTjfgrxrKV+K3cyOBxdBmpRm8dtdBfKusTNZw+eF3Jox4xjZZl93GKy+irR0T4OrQJ5DlVZ2As7Kz7Ef5hFmacrwCFHQpY+LYq12Wg==',key_name='tempest-keypair-1117604385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b6463729fb40a7ae708ac0f188263b',ramdisk_id='',reservation_id='r-24nqzfoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1529004159',owner_user_name='tempest-TaggedBootDevicesTest-1529004159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:53:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99e1c9eec3e6402482269c9878ac9987',uuid=f69df9a2-e8ed-4bec-8c01-cd005432a373,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a54c2c6b-acf2-43b8-b6cd-314710baa6fb", "address": "fa:16:3e:68:e2:17", "network": {"id": "8bb81854-eb04-46fe-99b4-dcd0b0f6845f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-129357522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54c2c6b-ac", "ovs_interfaceid": "a54c2c6b-acf2-43b8-b6cd-314710baa6fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converting VIF {"id": "a54c2c6b-acf2-43b8-b6cd-314710baa6fb", "address": "fa:16:3e:68:e2:17", "network": {"id": "8bb81854-eb04-46fe-99b4-dcd0b0f6845f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-129357522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54c2c6b-ac", "ovs_interfaceid": "a54c2c6b-acf2-43b8-b6cd-314710baa6fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:e2:17,bridge_name='br-int',has_traffic_filtering=True,id=a54c2c6b-acf2-43b8-b6cd-314710baa6fb,network=Network(8bb81854-eb04-46fe-99b4-dcd0b0f6845f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54c2c6b-ac') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG os_vif [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:e2:17,bridge_name='br-int',has_traffic_filtering=True,id=a54c2c6b-acf2-43b8-b6cd-314710baa6fb,network=Network(8bb81854-eb04-46fe-99b4-dcd0b0f6845f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54c2c6b-ac') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa54c2c6b-ac, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa54c2c6b-ac, col_values=(('external_ids', {'iface-id': 'a54c2c6b-acf2-43b8-b6cd-314710baa6fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:e2:17', 'vm-uuid': 'f69df9a2-e8ed-4bec-8c01-cd005432a373'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:23 user nova-compute[72809]: INFO os_vif [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:e2:17,bridge_name='br-int',has_traffic_filtering=True,id=a54c2c6b-acf2-43b8-b6cd-314710baa6fb,network=Network(8bb81854-eb04-46fe-99b4-dcd0b0f6845f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54c2c6b-ac')
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:53:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802868567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802868567',id=17,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7vsFRH8+QDNzfaJco48VmChAa1NTjfgrxrKV+K3cyOBxdBmpRm8dtdBfKusTNZw+eF3Jox4xjZZl93GKy+irR0T4OrQJ5DlVZ2As7Kz7Ef5hFmacrwCFHQpY+LYq12Wg==',key_name='tempest-keypair-1117604385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b6463729fb40a7ae708ac0f188263b',ramdisk_id='',reservation_id='r-24nqzfoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1529004159',owner_user_name='tempest-TaggedBootDevicesTest-1529004159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:53:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99e1c9eec3e6402482269c9878ac9987',uuid=f69df9a2-e8ed-4bec-8c01-cd005432a373,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1db9e576-a5f0-40ac-8bf6-181eec5c2d85", "address": "fa:16:3e:3b:48:01", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db9e576-a5", "ovs_interfaceid": "1db9e576-a5f0-40ac-8bf6-181eec5c2d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converting VIF {"id": "1db9e576-a5f0-40ac-8bf6-181eec5c2d85", "address": "fa:16:3e:3b:48:01", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db9e576-a5", "ovs_interfaceid": "1db9e576-a5f0-40ac-8bf6-181eec5c2d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:48:01,bridge_name='br-int',has_traffic_filtering=True,id=1db9e576-a5f0-40ac-8bf6-181eec5c2d85,network=Network(201c59b3-f13e-4692-9b61-8cc4c753b3af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1db9e576-a5') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG os_vif [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:48:01,bridge_name='br-int',has_traffic_filtering=True,id=1db9e576-a5f0-40ac-8bf6-181eec5c2d85,network=Network(201c59b3-f13e-4692-9b61-8cc4c753b3af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1db9e576-a5') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1db9e576-a5, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1db9e576-a5, col_values=(('external_ids', {'iface-id': '1db9e576-a5f0-40ac-8bf6-181eec5c2d85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:48:01', 'vm-uuid': 'f69df9a2-e8ed-4bec-8c01-cd005432a373'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:23 user nova-compute[72809]: INFO os_vif [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:48:01,bridge_name='br-int',has_traffic_filtering=True,id=1db9e576-a5f0-40ac-8bf6-181eec5c2d85,network=Network(201c59b3-f13e-4692-9b61-8cc4c753b3af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1db9e576-a5')
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:53:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802868567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802868567',id=17,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7vsFRH8+QDNzfaJco48VmChAa1NTjfgrxrKV+K3cyOBxdBmpRm8dtdBfKusTNZw+eF3Jox4xjZZl93GKy+irR0T4OrQJ5DlVZ2As7Kz7Ef5hFmacrwCFHQpY+LYq12Wg==',key_name='tempest-keypair-1117604385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b6463729fb40a7ae708ac0f188263b',ramdisk_id='',reservation_id='r-24nqzfoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1529004159',owner_user_name='tempest-TaggedBootDevicesTest-1529004159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:53:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99e1c9eec3e6402482269c9878ac9987',uuid=f69df9a2-e8ed-4bec-8c01-cd005432a373,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a076857-c138-4c63-955c-e3a9396f825f", "address": "fa:16:3e:51:09:9b", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a076857-c1", "ovs_interfaceid": "4a076857-c138-4c63-955c-e3a9396f825f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converting VIF {"id": "4a076857-c138-4c63-955c-e3a9396f825f", "address": "fa:16:3e:51:09:9b", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a076857-c1", "ovs_interfaceid": "4a076857-c138-4c63-955c-e3a9396f825f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:09:9b,bridge_name='br-int',has_traffic_filtering=True,id=4a076857-c138-4c63-955c-e3a9396f825f,network=Network(201c59b3-f13e-4692-9b61-8cc4c753b3af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4a076857-c1') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG os_vif [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:09:9b,bridge_name='br-int',has_traffic_filtering=True,id=4a076857-c138-4c63-955c-e3a9396f825f,network=Network(201c59b3-f13e-4692-9b61-8cc4c753b3af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4a076857-c1') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a076857-c1, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4a076857-c1, col_values=(('external_ids', {'iface-id': '4a076857-c138-4c63-955c-e3a9396f825f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:09:9b', 'vm-uuid': 'f69df9a2-e8ed-4bec-8c01-cd005432a373'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:23 user nova-compute[72809]: INFO os_vif [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:09:9b,bridge_name='br-int',has_traffic_filtering=True,id=4a076857-c138-4c63-955c-e3a9396f825f,network=Network(201c59b3-f13e-4692-9b61-8cc4c753b3af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4a076857-c1')
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:53:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802868567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802868567',id=17,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7vsFRH8+QDNzfaJco48VmChAa1NTjfgrxrKV+K3cyOBxdBmpRm8dtdBfKusTNZw+eF3Jox4xjZZl93GKy+irR0T4OrQJ5DlVZ2As7Kz7Ef5hFmacrwCFHQpY+LYq12Wg==',key_name='tempest-keypair-1117604385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b6463729fb40a7ae708ac0f188263b',ramdisk_id='',reservation_id='r-24nqzfoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1529004159',owner_user_name='tempest-TaggedBootDevicesTest-1529004159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:53:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99e1c9eec3e6402482269c9878ac9987',uuid=f69df9a2-e8ed-4bec-8c01-cd005432a373,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773", "address": "fa:16:3e:76:c8:43", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbbcf7b-60", "ovs_interfaceid": "8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converting VIF {"id": "8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773", "address": "fa:16:3e:76:c8:43", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbbcf7b-60", "ovs_interfaceid": "8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:c8:43,bridge_name='br-int',has_traffic_filtering=True,id=8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773,network=Network(201c59b3-f13e-4692-9b61-8cc4c753b3af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbbcf7b-60') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG os_vif [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:c8:43,bridge_name='br-int',has_traffic_filtering=True,id=8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773,network=Network(201c59b3-f13e-4692-9b61-8cc4c753b3af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbbcf7b-60') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fbbcf7b-60, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8fbbcf7b-60, col_values=(('external_ids', {'iface-id': '8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:c8:43', 'vm-uuid': 'f69df9a2-e8ed-4bec-8c01-cd005432a373'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:54:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:24 user nova-compute[72809]: INFO os_vif [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:c8:43,bridge_name='br-int',has_traffic_filtering=True,id=8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773,network=Network(201c59b3-f13e-4692-9b61-8cc4c753b3af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbbcf7b-60')
Aug 09 06:54:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:53:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802868567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802868567',id=17,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7vsFRH8+QDNzfaJco48VmChAa1NTjfgrxrKV+K3cyOBxdBmpRm8dtdBfKusTNZw+eF3Jox4xjZZl93GKy+irR0T4OrQJ5DlVZ2As7Kz7Ef5hFmacrwCFHQpY+LYq12Wg==',key_name='tempest-keypair-1117604385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b6463729fb40a7ae708ac0f188263b',ramdisk_id='',reservation_id='r-24nqzfoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1529004159',owner_user_name='tempest-TaggedBootDevicesTest-1529004159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:53:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99e1c9eec3e6402482269c9878ac9987',uuid=f69df9a2-e8ed-4bec-8c01-cd005432a373,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "264f2093-5827-43e1-80a4-1a9190478f3f", "address": "fa:16:3e:3c:31:50", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264f2093-58", "ovs_interfaceid": "264f2093-5827-43e1-80a4-1a9190478f3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converting VIF {"id": "264f2093-5827-43e1-80a4-1a9190478f3f", "address": "fa:16:3e:3c:31:50", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264f2093-58", "ovs_interfaceid": "264f2093-5827-43e1-80a4-1a9190478f3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:31:50,bridge_name='br-int',has_traffic_filtering=True,id=264f2093-5827-43e1-80a4-1a9190478f3f,network=Network(201c59b3-f13e-4692-9b61-8cc4c753b3af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap264f2093-58') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG os_vif [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:31:50,bridge_name='br-int',has_traffic_filtering=True,id=264f2093-5827-43e1-80a4-1a9190478f3f,network=Network(201c59b3-f13e-4692-9b61-8cc4c753b3af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap264f2093-58') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap264f2093-58, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap264f2093-58, col_values=(('external_ids', {'iface-id': '264f2093-5827-43e1-80a4-1a9190478f3f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:31:50', 'vm-uuid': 'f69df9a2-e8ed-4bec-8c01-cd005432a373'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:24 user nova-compute[72809]: INFO os_vif [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:31:50,bridge_name='br-int',has_traffic_filtering=True,id=264f2093-5827-43e1-80a4-1a9190478f3f,network=Network(201c59b3-f13e-4692-9b61-8cc4c753b3af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap264f2093-58')
Aug 09 06:54:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:53:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802868567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802868567',id=17,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7vsFRH8+QDNzfaJco48VmChAa1NTjfgrxrKV+K3cyOBxdBmpRm8dtdBfKusTNZw+eF3Jox4xjZZl93GKy+irR0T4OrQJ5DlVZ2As7Kz7Ef5hFmacrwCFHQpY+LYq12Wg==',key_name='tempest-keypair-1117604385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b6463729fb40a7ae708ac0f188263b',ramdisk_id='',reservation_id='r-24nqzfoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1529004159',owner_user_name='tempest-TaggedBootDevicesTest-1529004159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:53:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99e1c9eec3e6402482269c9878ac9987',uuid=f69df9a2-e8ed-4bec-8c01-cd005432a373,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "153083da-b420-4260-ae35-edae5a4d37b8", "address": "fa:16:3e:2c:4b:aa", "network": {"id": "f6db78c1-51ff-449e-89e2-5b5f3df83e93", "bridge": "br-int", "label": "tempest-device-tagging-net2-538371520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153083da-b4", "ovs_interfaceid": "153083da-b420-4260-ae35-edae5a4d37b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converting VIF {"id": "153083da-b420-4260-ae35-edae5a4d37b8", "address": "fa:16:3e:2c:4b:aa", "network": {"id": "f6db78c1-51ff-449e-89e2-5b5f3df83e93", "bridge": "br-int", "label": "tempest-device-tagging-net2-538371520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153083da-b4", "ovs_interfaceid": "153083da-b420-4260-ae35-edae5a4d37b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:4b:aa,bridge_name='br-int',has_traffic_filtering=True,id=153083da-b420-4260-ae35-edae5a4d37b8,network=Network(f6db78c1-51ff-449e-89e2-5b5f3df83e93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap153083da-b4') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG os_vif [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:4b:aa,bridge_name='br-int',has_traffic_filtering=True,id=153083da-b420-4260-ae35-edae5a4d37b8,network=Network(f6db78c1-51ff-449e-89e2-5b5f3df83e93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap153083da-b4') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap153083da-b4, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap153083da-b4, col_values=(('external_ids', {'iface-id': '153083da-b420-4260-ae35-edae5a4d37b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:4b:aa', 'vm-uuid': 'f69df9a2-e8ed-4bec-8c01-cd005432a373'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:24 user nova-compute[72809]: INFO os_vif [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:4b:aa,bridge_name='br-int',has_traffic_filtering=True,id=153083da-b420-4260-ae35-edae5a4d37b8,network=Network(f6db78c1-51ff-449e-89e2-5b5f3df83e93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap153083da-b4')
Aug 09 06:54:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:53:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802868567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802868567',id=17,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7vsFRH8+QDNzfaJco48VmChAa1NTjfgrxrKV+K3cyOBxdBmpRm8dtdBfKusTNZw+eF3Jox4xjZZl93GKy+irR0T4OrQJ5DlVZ2As7Kz7Ef5hFmacrwCFHQpY+LYq12Wg==',key_name='tempest-keypair-1117604385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b6463729fb40a7ae708ac0f188263b',ramdisk_id='',reservation_id='r-24nqzfoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1529004159',owner_user_name='tempest-TaggedBootDevicesTest-1529004159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:53:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99e1c9eec3e6402482269c9878ac9987',uuid=f69df9a2-e8ed-4bec-8c01-cd005432a373,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6231c01e-c6ec-4103-8899-4cb730945ad0", "address": "fa:16:3e:ca:40:34", "network": {"id": "f6db78c1-51ff-449e-89e2-5b5f3df83e93", "bridge": "br-int", "label": "tempest-device-tagging-net2-538371520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6231c01e-c6", "ovs_interfaceid": "6231c01e-c6ec-4103-8899-4cb730945ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converting VIF {"id": "6231c01e-c6ec-4103-8899-4cb730945ad0", "address": "fa:16:3e:ca:40:34", "network": {"id": "f6db78c1-51ff-449e-89e2-5b5f3df83e93", "bridge": "br-int", "label": "tempest-device-tagging-net2-538371520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6231c01e-c6", "ovs_interfaceid": "6231c01e-c6ec-4103-8899-4cb730945ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:40:34,bridge_name='br-int',has_traffic_filtering=True,id=6231c01e-c6ec-4103-8899-4cb730945ad0,network=Network(f6db78c1-51ff-449e-89e2-5b5f3df83e93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6231c01e-c6') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG os_vif [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:40:34,bridge_name='br-int',has_traffic_filtering=True,id=6231c01e-c6ec-4103-8899-4cb730945ad0,network=Network(f6db78c1-51ff-449e-89e2-5b5f3df83e93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6231c01e-c6') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6231c01e-c6, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6231c01e-c6, col_values=(('external_ids', {'iface-id': '6231c01e-c6ec-4103-8899-4cb730945ad0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:40:34', 'vm-uuid': 'f69df9a2-e8ed-4bec-8c01-cd005432a373'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:24 user nova-compute[72809]: INFO os_vif [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:40:34,bridge_name='br-int',has_traffic_filtering=True,id=6231c01e-c6ec-4103-8899-4cb730945ad0,network=Network(f6db78c1-51ff-449e-89e2-5b5f3df83e93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6231c01e-c6')
Aug 09 06:54:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] No BDM found with device name hda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] No VIF found with MAC fa:16:3e:68:e2:17, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] No VIF found with MAC fa:16:3e:3c:31:50, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:54:24 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Using config drive
Aug 09 06:54:24 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Creating config drive at /opt/stack/data/nova/instances/f69df9a2-e8ed-4bec-8c01-cd005432a373/disk.config
Aug 09 06:54:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f69df9a2-e8ed-4bec-8c01-cd005432a373/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmph86qw5y3 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f69df9a2-e8ed-4bec-8c01-cd005432a373/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmph86qw5y3" returned: 0 in 0.053s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:26 user nova-compute[72809]: DEBUG nova.compute.manager [req-b10b1a26-595a-4e65-8576-8f61f80f6fe9 req-1c368a1b-850b-4a58-a6df-9d8a4bbe5b7f service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-plugged-a54c2c6b-acf2-43b8-b6cd-314710baa6fb {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b10b1a26-595a-4e65-8576-8f61f80f6fe9 req-1c368a1b-850b-4a58-a6df-9d8a4bbe5b7f service nova] Acquiring lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b10b1a26-595a-4e65-8576-8f61f80f6fe9 req-1c368a1b-850b-4a58-a6df-9d8a4bbe5b7f service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b10b1a26-595a-4e65-8576-8f61f80f6fe9 req-1c368a1b-850b-4a58-a6df-9d8a4bbe5b7f service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:26 user nova-compute[72809]: DEBUG nova.compute.manager [req-b10b1a26-595a-4e65-8576-8f61f80f6fe9 req-1c368a1b-850b-4a58-a6df-9d8a4bbe5b7f service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] No waiting events found dispatching network-vif-plugged-a54c2c6b-acf2-43b8-b6cd-314710baa6fb {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:26 user nova-compute[72809]: WARNING nova.compute.manager [req-b10b1a26-595a-4e65-8576-8f61f80f6fe9 req-1c368a1b-850b-4a58-a6df-9d8a4bbe5b7f service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received unexpected event network-vif-plugged-a54c2c6b-acf2-43b8-b6cd-314710baa6fb for instance with vm_state building and task_state spawning.
Aug 09 06:54:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:26 user nova-compute[72809]: INFO nova.compute.manager [None req-cae7288e-b5cf-4f07-b315-864cf411b59c tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Unrescuing
Aug 09 06:54:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cae7288e-b5cf-4f07-b315-864cf411b59c tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Acquiring lock "refresh_cache-3640991e-8a5b-4674-af81-3117d4269a68" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:54:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cae7288e-b5cf-4f07-b315-864cf411b59c tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Acquired lock "refresh_cache-3640991e-8a5b-4674-af81-3117d4269a68" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:54:26 user nova-compute[72809]: DEBUG nova.network.neutron [None req-cae7288e-b5cf-4f07-b315-864cf411b59c tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:54:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:27 user nova-compute[72809]: DEBUG nova.compute.manager [req-28ed3ec1-785f-461c-b937-1f76a86d1d07 req-e12e89e1-b4e9-476c-bfcd-c2c9c37fdd9c service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-plugged-1db9e576-a5f0-40ac-8bf6-181eec5c2d85 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-28ed3ec1-785f-461c-b937-1f76a86d1d07 req-e12e89e1-b4e9-476c-bfcd-c2c9c37fdd9c service nova] Acquiring lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-28ed3ec1-785f-461c-b937-1f76a86d1d07 req-e12e89e1-b4e9-476c-bfcd-c2c9c37fdd9c service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-28ed3ec1-785f-461c-b937-1f76a86d1d07 req-e12e89e1-b4e9-476c-bfcd-c2c9c37fdd9c service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:27 user nova-compute[72809]: DEBUG nova.compute.manager [req-28ed3ec1-785f-461c-b937-1f76a86d1d07 req-e12e89e1-b4e9-476c-bfcd-c2c9c37fdd9c service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] No waiting events found dispatching network-vif-plugged-1db9e576-a5f0-40ac-8bf6-181eec5c2d85 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:27 user nova-compute[72809]: WARNING nova.compute.manager [req-28ed3ec1-785f-461c-b937-1f76a86d1d07 req-e12e89e1-b4e9-476c-bfcd-c2c9c37fdd9c service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received unexpected event network-vif-plugged-1db9e576-a5f0-40ac-8bf6-181eec5c2d85 for instance with vm_state building and task_state spawning.
Aug 09 06:54:27 user nova-compute[72809]: DEBUG nova.network.neutron [None req-cae7288e-b5cf-4f07-b315-864cf411b59c tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Updating instance_info_cache with network_info: [{"id": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "address": "fa:16:3e:70:a1:b1", "network": {"id": "d6503417-7fd7-487b-8474-f23e4cc77845", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1134767045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04f60d3bd9a41fc930f728a74371a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030dd6f3-f7", "ovs_interfaceid": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:54:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cae7288e-b5cf-4f07-b315-864cf411b59c tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Releasing lock "refresh_cache-3640991e-8a5b-4674-af81-3117d4269a68" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:54:27 user nova-compute[72809]: DEBUG nova.objects.instance [None req-cae7288e-b5cf-4f07-b315-864cf411b59c tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lazy-loading 'flavor' on Instance uuid 3640991e-8a5b-4674-af81-3117d4269a68 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:54:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:27 user nova-compute[72809]: DEBUG nova.compute.manager [req-6c995713-0bc3-49c8-a024-9f1798b9a378 req-346f85c3-6ee1-449b-9b82-7856815f2b28 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received event network-vif-unplugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6c995713-0bc3-49c8-a024-9f1798b9a378 req-346f85c3-6ee1-449b-9b82-7856815f2b28 service nova] Acquiring lock "3640991e-8a5b-4674-af81-3117d4269a68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6c995713-0bc3-49c8-a024-9f1798b9a378 req-346f85c3-6ee1-449b-9b82-7856815f2b28 service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6c995713-0bc3-49c8-a024-9f1798b9a378 req-346f85c3-6ee1-449b-9b82-7856815f2b28 service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:27 user nova-compute[72809]: DEBUG nova.compute.manager [req-6c995713-0bc3-49c8-a024-9f1798b9a378 req-346f85c3-6ee1-449b-9b82-7856815f2b28 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] No waiting events found dispatching network-vif-unplugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:27 user nova-compute[72809]: WARNING nova.compute.manager [req-6c995713-0bc3-49c8-a024-9f1798b9a378 req-346f85c3-6ee1-449b-9b82-7856815f2b28 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received unexpected event network-vif-unplugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 for instance with vm_state rescued and task_state unrescuing.
Aug 09 06:54:27 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:54:27 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:54:27 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Cleaning up deleted instances {{(pid=72809) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 06:54:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:27 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] There are 0 instances to clean {{(pid=72809) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 06:54:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:28 user nova-compute[72809]: DEBUG nova.compute.manager [req-ec4bf527-8527-41cb-8c41-77c81159ecbd req-537fcba1-a793-451f-a2b7-18f66530e6f9 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-plugged-a54c2c6b-acf2-43b8-b6cd-314710baa6fb {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ec4bf527-8527-41cb-8c41-77c81159ecbd req-537fcba1-a793-451f-a2b7-18f66530e6f9 service nova] Acquiring lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ec4bf527-8527-41cb-8c41-77c81159ecbd req-537fcba1-a793-451f-a2b7-18f66530e6f9 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ec4bf527-8527-41cb-8c41-77c81159ecbd req-537fcba1-a793-451f-a2b7-18f66530e6f9 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:28 user nova-compute[72809]: DEBUG nova.compute.manager [req-ec4bf527-8527-41cb-8c41-77c81159ecbd req-537fcba1-a793-451f-a2b7-18f66530e6f9 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] No waiting events found dispatching network-vif-plugged-a54c2c6b-acf2-43b8-b6cd-314710baa6fb {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:28 user nova-compute[72809]: WARNING nova.compute.manager [req-ec4bf527-8527-41cb-8c41-77c81159ecbd req-537fcba1-a793-451f-a2b7-18f66530e6f9 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received unexpected event network-vif-plugged-a54c2c6b-acf2-43b8-b6cd-314710baa6fb for instance with vm_state building and task_state spawning.
Aug 09 06:54:28 user nova-compute[72809]: DEBUG nova.compute.manager [req-ec4bf527-8527-41cb-8c41-77c81159ecbd req-537fcba1-a793-451f-a2b7-18f66530e6f9 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-plugged-8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ec4bf527-8527-41cb-8c41-77c81159ecbd req-537fcba1-a793-451f-a2b7-18f66530e6f9 service nova] Acquiring lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ec4bf527-8527-41cb-8c41-77c81159ecbd req-537fcba1-a793-451f-a2b7-18f66530e6f9 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ec4bf527-8527-41cb-8c41-77c81159ecbd req-537fcba1-a793-451f-a2b7-18f66530e6f9 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:28 user nova-compute[72809]: DEBUG nova.compute.manager [req-ec4bf527-8527-41cb-8c41-77c81159ecbd req-537fcba1-a793-451f-a2b7-18f66530e6f9 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] No waiting events found dispatching network-vif-plugged-8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:28 user nova-compute[72809]: WARNING nova.compute.manager [req-ec4bf527-8527-41cb-8c41-77c81159ecbd req-537fcba1-a793-451f-a2b7-18f66530e6f9 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received unexpected event network-vif-plugged-8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773 for instance with vm_state building and task_state spawning.
Aug 09 06:54:28 user nova-compute[72809]: DEBUG nova.compute.manager [req-ec4bf527-8527-41cb-8c41-77c81159ecbd req-537fcba1-a793-451f-a2b7-18f66530e6f9 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-plugged-8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ec4bf527-8527-41cb-8c41-77c81159ecbd req-537fcba1-a793-451f-a2b7-18f66530e6f9 service nova] Acquiring lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ec4bf527-8527-41cb-8c41-77c81159ecbd req-537fcba1-a793-451f-a2b7-18f66530e6f9 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ec4bf527-8527-41cb-8c41-77c81159ecbd req-537fcba1-a793-451f-a2b7-18f66530e6f9 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:28 user nova-compute[72809]: DEBUG nova.compute.manager [req-ec4bf527-8527-41cb-8c41-77c81159ecbd req-537fcba1-a793-451f-a2b7-18f66530e6f9 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] No waiting events found dispatching network-vif-plugged-8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:28 user nova-compute[72809]: WARNING nova.compute.manager [req-ec4bf527-8527-41cb-8c41-77c81159ecbd req-537fcba1-a793-451f-a2b7-18f66530e6f9 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received unexpected event network-vif-plugged-8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773 for instance with vm_state building and task_state spawning.
Aug 09 06:54:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:28 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Instance destroyed successfully.
Aug 09 06:54:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:28 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:54:28 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 06:54:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-b64e7169-044c-4d0a-9ee5-f2914f1f5529" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-b64e7169-044c-4d0a-9ee5-f2914f1f5529" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-7205e70f-3b47-4460-89f0-56adabe59dfd req-c0eb67e8-91c3-414e-a93f-76cd34fdc624 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-plugged-1db9e576-a5f0-40ac-8bf6-181eec5c2d85 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7205e70f-3b47-4460-89f0-56adabe59dfd req-c0eb67e8-91c3-414e-a93f-76cd34fdc624 service nova] Acquiring lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7205e70f-3b47-4460-89f0-56adabe59dfd req-c0eb67e8-91c3-414e-a93f-76cd34fdc624 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7205e70f-3b47-4460-89f0-56adabe59dfd req-c0eb67e8-91c3-414e-a93f-76cd34fdc624 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-7205e70f-3b47-4460-89f0-56adabe59dfd req-c0eb67e8-91c3-414e-a93f-76cd34fdc624 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] No waiting events found dispatching network-vif-plugged-1db9e576-a5f0-40ac-8bf6-181eec5c2d85 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:29 user nova-compute[72809]: WARNING nova.compute.manager [req-7205e70f-3b47-4460-89f0-56adabe59dfd req-c0eb67e8-91c3-414e-a93f-76cd34fdc624 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received unexpected event network-vif-plugged-1db9e576-a5f0-40ac-8bf6-181eec5c2d85 for instance with vm_state building and task_state spawning.
Aug 09 06:54:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-7205e70f-3b47-4460-89f0-56adabe59dfd req-c0eb67e8-91c3-414e-a93f-76cd34fdc624 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-plugged-4a076857-c138-4c63-955c-e3a9396f825f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7205e70f-3b47-4460-89f0-56adabe59dfd req-c0eb67e8-91c3-414e-a93f-76cd34fdc624 service nova] Acquiring lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7205e70f-3b47-4460-89f0-56adabe59dfd req-c0eb67e8-91c3-414e-a93f-76cd34fdc624 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7205e70f-3b47-4460-89f0-56adabe59dfd req-c0eb67e8-91c3-414e-a93f-76cd34fdc624 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-7205e70f-3b47-4460-89f0-56adabe59dfd req-c0eb67e8-91c3-414e-a93f-76cd34fdc624 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] No waiting events found dispatching network-vif-plugged-4a076857-c138-4c63-955c-e3a9396f825f {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:29 user nova-compute[72809]: WARNING nova.compute.manager [req-7205e70f-3b47-4460-89f0-56adabe59dfd req-c0eb67e8-91c3-414e-a93f-76cd34fdc624 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received unexpected event network-vif-plugged-4a076857-c138-4c63-955c-e3a9396f825f for instance with vm_state building and task_state spawning.
Aug 09 06:54:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-7205e70f-3b47-4460-89f0-56adabe59dfd req-c0eb67e8-91c3-414e-a93f-76cd34fdc624 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-plugged-4a076857-c138-4c63-955c-e3a9396f825f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7205e70f-3b47-4460-89f0-56adabe59dfd req-c0eb67e8-91c3-414e-a93f-76cd34fdc624 service nova] Acquiring lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7205e70f-3b47-4460-89f0-56adabe59dfd req-c0eb67e8-91c3-414e-a93f-76cd34fdc624 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7205e70f-3b47-4460-89f0-56adabe59dfd req-c0eb67e8-91c3-414e-a93f-76cd34fdc624 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-7205e70f-3b47-4460-89f0-56adabe59dfd req-c0eb67e8-91c3-414e-a93f-76cd34fdc624 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] No waiting events found dispatching network-vif-plugged-4a076857-c138-4c63-955c-e3a9396f825f {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:29 user nova-compute[72809]: WARNING nova.compute.manager [req-7205e70f-3b47-4460-89f0-56adabe59dfd req-c0eb67e8-91c3-414e-a93f-76cd34fdc624 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received unexpected event network-vif-plugged-4a076857-c138-4c63-955c-e3a9396f825f for instance with vm_state building and task_state spawning.
Aug 09 06:54:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received event network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] Acquiring lock "3640991e-8a5b-4674-af81-3117d4269a68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] No waiting events found dispatching network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:29 user nova-compute[72809]: WARNING nova.compute.manager [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received unexpected event network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 for instance with vm_state rescued and task_state unrescuing.
Aug 09 06:54:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-plugged-153083da-b420-4260-ae35-edae5a4d37b8 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] Acquiring lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] No waiting events found dispatching network-vif-plugged-153083da-b420-4260-ae35-edae5a4d37b8 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:29 user nova-compute[72809]: WARNING nova.compute.manager [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received unexpected event network-vif-plugged-153083da-b420-4260-ae35-edae5a4d37b8 for instance with vm_state building and task_state spawning.
Aug 09 06:54:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-plugged-153083da-b420-4260-ae35-edae5a4d37b8 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] Acquiring lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] No waiting events found dispatching network-vif-plugged-153083da-b420-4260-ae35-edae5a4d37b8 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:29 user nova-compute[72809]: WARNING nova.compute.manager [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received unexpected event network-vif-plugged-153083da-b420-4260-ae35-edae5a4d37b8 for instance with vm_state building and task_state spawning.
Aug 09 06:54:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received event network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] Acquiring lock "3640991e-8a5b-4674-af81-3117d4269a68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] No waiting events found dispatching network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:29 user nova-compute[72809]: WARNING nova.compute.manager [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received unexpected event network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 for instance with vm_state rescued and task_state unrescuing.
Aug 09 06:54:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received event network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] Acquiring lock "3640991e-8a5b-4674-af81-3117d4269a68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] No waiting events found dispatching network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:29 user nova-compute[72809]: WARNING nova.compute.manager [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received unexpected event network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 for instance with vm_state rescued and task_state unrescuing.
Aug 09 06:54:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received event network-vif-unplugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] Acquiring lock "3640991e-8a5b-4674-af81-3117d4269a68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] No waiting events found dispatching network-vif-unplugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:29 user nova-compute[72809]: WARNING nova.compute.manager [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received unexpected event network-vif-unplugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 for instance with vm_state rescued and task_state unrescuing.
Aug 09 06:54:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received event network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] Acquiring lock "3640991e-8a5b-4674-af81-3117d4269a68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] No waiting events found dispatching network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:29 user nova-compute[72809]: WARNING nova.compute.manager [req-a543a196-c6ec-46f5-adc9-51b349576ab1 req-2d4ec22f-4a9c-456d-89c2-71ca7d87a788 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received unexpected event network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 for instance with vm_state rescued and task_state unrescuing.
Aug 09 06:54:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Updating instance_info_cache with network_info: [{"id": "d83214ef-f913-4ab9-b9b5-4bcd171b1656", "address": "fa:16:3e:7b:70:28", "network": {"id": "9d98057f-37e6-42f0-9a94-2240979d38f4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-490582380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06d061b94c6548d88d8c3cae6751d937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd83214ef-f9", "ovs_interfaceid": "d83214ef-f913-4ab9-b9b5-4bcd171b1656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-b64e7169-044c-4d0a-9ee5-f2914f1f5529" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-plugged-264f2093-5827-43e1-80a4-1a9190478f3f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] Acquiring lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] No waiting events found dispatching network-vif-plugged-264f2093-5827-43e1-80a4-1a9190478f3f {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:30 user nova-compute[72809]: WARNING nova.compute.manager [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received unexpected event network-vif-plugged-264f2093-5827-43e1-80a4-1a9190478f3f for instance with vm_state building and task_state spawning.
Aug 09 06:54:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received event network-changed-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Refreshing instance network info cache due to event network-changed-030dd6f3-f758-4b5a-b9fb-be3c64cb9341. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] Acquiring lock "refresh_cache-3640991e-8a5b-4674-af81-3117d4269a68" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] Acquired lock "refresh_cache-3640991e-8a5b-4674-af81-3117d4269a68" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG nova.network.neutron [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Refreshing network info cache for port 030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG nova.network.neutron [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Updated VIF entry in instance network info cache for port 030dd6f3-f758-4b5a-b9fb-be3c64cb9341. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:54:30 user nova-compute[72809]: DEBUG nova.network.neutron [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Updating instance_info_cache with network_info: [{"id": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "address": "fa:16:3e:70:a1:b1", "network": {"id": "d6503417-7fd7-487b-8474-f23e4cc77845", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1134767045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04f60d3bd9a41fc930f728a74371a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030dd6f3-f7", "ovs_interfaceid": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] Releasing lock "refresh_cache-3640991e-8a5b-4674-af81-3117d4269a68" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG nova.compute.manager [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received event network-changed-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG nova.compute.manager [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Refreshing instance network info cache due to event network-changed-030dd6f3-f758-4b5a-b9fb-be3c64cb9341. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] Acquiring lock "refresh_cache-3640991e-8a5b-4674-af81-3117d4269a68" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] Acquired lock "refresh_cache-3640991e-8a5b-4674-af81-3117d4269a68" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG nova.network.neutron [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Refreshing network info cache for port 030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564071.4486976, f69df9a2-e8ed-4bec-8c01-cd005432a373 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:54:31 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] VM Resumed (Lifecycle Event)
Aug 09 06:54:31 user nova-compute[72809]: DEBUG nova.compute.manager [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 06:54:31 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Instance spawned successfully.
Aug 09 06:54:31 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:54:31 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:54:31 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564071.4526138, f69df9a2-e8ed-4bec-8c01-cd005432a373 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:54:31 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] VM Started (Lifecycle Event)
Aug 09 06:54:31 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:31 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:54:31 user nova-compute[72809]: INFO nova.compute.manager [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Took 12.10 seconds to spawn the instance on the hypervisor.
Aug 09 06:54:31 user nova-compute[72809]: DEBUG nova.compute.manager [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG nova.network.neutron [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Updated VIF entry in instance network info cache for port 030dd6f3-f758-4b5a-b9fb-be3c64cb9341. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG nova.network.neutron [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Updating instance_info_cache with network_info: [{"id": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "address": "fa:16:3e:70:a1:b1", "network": {"id": "d6503417-7fd7-487b-8474-f23e4cc77845", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1134767045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04f60d3bd9a41fc930f728a74371a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030dd6f3-f7", "ovs_interfaceid": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] Releasing lock "refresh_cache-3640991e-8a5b-4674-af81-3117d4269a68" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG nova.compute.manager [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-plugged-264f2093-5827-43e1-80a4-1a9190478f3f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] Acquiring lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG nova.compute.manager [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] No waiting events found dispatching network-vif-plugged-264f2093-5827-43e1-80a4-1a9190478f3f {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:31 user nova-compute[72809]: WARNING nova.compute.manager [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received unexpected event network-vif-plugged-264f2093-5827-43e1-80a4-1a9190478f3f for instance with vm_state building and task_state spawning.
Aug 09 06:54:31 user nova-compute[72809]: DEBUG nova.compute.manager [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-plugged-6231c01e-c6ec-4103-8899-4cb730945ad0 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] Acquiring lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG nova.compute.manager [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] No waiting events found dispatching network-vif-plugged-6231c01e-c6ec-4103-8899-4cb730945ad0 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:31 user nova-compute[72809]: WARNING nova.compute.manager [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received unexpected event network-vif-plugged-6231c01e-c6ec-4103-8899-4cb730945ad0 for instance with vm_state building and task_state spawning.
Aug 09 06:54:31 user nova-compute[72809]: DEBUG nova.compute.manager [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-plugged-6231c01e-c6ec-4103-8899-4cb730945ad0 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] Acquiring lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG nova.compute.manager [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] No waiting events found dispatching network-vif-plugged-6231c01e-c6ec-4103-8899-4cb730945ad0 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:31 user nova-compute[72809]: WARNING nova.compute.manager [req-b1589675-f206-4853-bf8f-f94b33ce14fb req-66734ca0-3035-4dd6-9735-6ea34b4a6577 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received unexpected event network-vif-plugged-6231c01e-c6ec-4103-8899-4cb730945ad0 for instance with vm_state building and task_state spawning.
Aug 09 06:54:31 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:31 user nova-compute[72809]: INFO nova.compute.manager [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Took 41.18 seconds to build instance.
Aug 09 06:54:31 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7d3bd3f2-b5e1-4338-883e-d17f2ad29834 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.301s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG nova.compute.manager [req-bef19313-09a6-4dda-930b-2992fa7c1e00 req-9d4c1a4e-2719-4cf8-904a-06fdac60db11 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received event network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-bef19313-09a6-4dda-930b-2992fa7c1e00 req-9d4c1a4e-2719-4cf8-904a-06fdac60db11 service nova] Acquiring lock "3640991e-8a5b-4674-af81-3117d4269a68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-bef19313-09a6-4dda-930b-2992fa7c1e00 req-9d4c1a4e-2719-4cf8-904a-06fdac60db11 service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-bef19313-09a6-4dda-930b-2992fa7c1e00 req-9d4c1a4e-2719-4cf8-904a-06fdac60db11 service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG nova.compute.manager [req-bef19313-09a6-4dda-930b-2992fa7c1e00 req-9d4c1a4e-2719-4cf8-904a-06fdac60db11 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] No waiting events found dispatching network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:31 user nova-compute[72809]: WARNING nova.compute.manager [req-bef19313-09a6-4dda-930b-2992fa7c1e00 req-9d4c1a4e-2719-4cf8-904a-06fdac60db11 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received unexpected event network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 for instance with vm_state rescued and task_state unrescuing.
Aug 09 06:54:31 user nova-compute[72809]: DEBUG nova.compute.manager [req-bef19313-09a6-4dda-930b-2992fa7c1e00 req-9d4c1a4e-2719-4cf8-904a-06fdac60db11 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received event network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-bef19313-09a6-4dda-930b-2992fa7c1e00 req-9d4c1a4e-2719-4cf8-904a-06fdac60db11 service nova] Acquiring lock "3640991e-8a5b-4674-af81-3117d4269a68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-bef19313-09a6-4dda-930b-2992fa7c1e00 req-9d4c1a4e-2719-4cf8-904a-06fdac60db11 service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-bef19313-09a6-4dda-930b-2992fa7c1e00 req-9d4c1a4e-2719-4cf8-904a-06fdac60db11 service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG nova.compute.manager [req-bef19313-09a6-4dda-930b-2992fa7c1e00 req-9d4c1a4e-2719-4cf8-904a-06fdac60db11 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] No waiting events found dispatching network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:31 user nova-compute[72809]: WARNING nova.compute.manager [req-bef19313-09a6-4dda-930b-2992fa7c1e00 req-9d4c1a4e-2719-4cf8-904a-06fdac60db11 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received unexpected event network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 for instance with vm_state rescued and task_state unrescuing.
Aug 09 06:54:31 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 06:54:31 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 06:54:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 06:54:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 06:54:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Removed pending event for 3640991e-8a5b-4674-af81-3117d4269a68 due to event {{(pid=72809) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 06:54:32 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564072.3178687, 3640991e-8a5b-4674-af81-3117d4269a68 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:54:32 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] VM Resumed (Lifecycle Event)
Aug 09 06:54:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-cae7288e-b5cf-4f07-b315-864cf411b59c tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:54:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:54:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:32 user nova-compute[72809]: INFO nova.compute.manager [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Detaching volume 9764e6f5-4af3-437f-82a0-f0becb06d18c
Aug 09 06:54:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:54:32 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 06:54:32 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564072.3305552, 3640991e-8a5b-4674-af81-3117d4269a68 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:54:32 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] VM Started (Lifecycle Event)
Aug 09 06:54:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:54:32 user nova-compute[72809]: INFO nova.virt.block_device [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Attempting to driver detach volume 9764e6f5-4af3-437f-82a0-f0becb06d18c from mountpoint /dev/vdb
Aug 09 06:54:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:54:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Attempting to detach device vdb from instance 24ba9b41-d0bf-4a84-9f04-bfda9525b154 from the persistent domain config. {{(pid=72809) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 06:54:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 06:54:32 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:54:32 user nova-compute[72809]:   <source dev="/dev/sdd"/>
Aug 09 06:54:32 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 06:54:32 user nova-compute[72809]:   <serial>9764e6f5-4af3-437f-82a0-f0becb06d18c</serial>
Aug 09 06:54:32 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 06:54:32 user nova-compute[72809]: </disk>
Aug 09 06:54:32 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 06:54:32 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Successfully detached device vdb from instance 24ba9b41-d0bf-4a84-9f04-bfda9525b154 from the persistent domain config.
Aug 09 06:54:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 24ba9b41-d0bf-4a84-9f04-bfda9525b154 from the live domain config. {{(pid=72809) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 06:54:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 06:54:32 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:54:32 user nova-compute[72809]:   <source dev="/dev/sdd"/>
Aug 09 06:54:32 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 06:54:32 user nova-compute[72809]:   <serial>9764e6f5-4af3-437f-82a0-f0becb06d18c</serial>
Aug 09 06:54:32 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 06:54:32 user nova-compute[72809]: </disk>
Aug 09 06:54:32 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 06:54:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Received event <DeviceRemovedEvent: 1691564073.0192947, 24ba9b41-d0bf-4a84-9f04-bfda9525b154 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72809) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 24ba9b41-d0bf-4a84-9f04-bfda9525b154 {{(pid=72809) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 06:54:33 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Successfully detached device vdb from instance 24ba9b41-d0bf-4a84-9f04-bfda9525b154 from the live domain config.
Aug 09 06:54:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fiKtUFLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:54:33 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:54:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:33 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:54:33 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:54:33 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=7640MB free_disk=25.405406951904297GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75c8a29-e91e-4ade-a759-f21eeab461d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a15942-13d7-4239-8bb4-4b61d8ee4ef3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:54:33 user nova-compute[72809]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:54:33 user nova-compute[72809]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:54:33 user nova-compute[72809]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)
Aug 09 06:54:33 user nova-compute[72809]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)
Aug 09 06:54:33 user nova-compute[72809]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)
Aug 09 06:54:33 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:54:33 user nova-compute[72809]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c (non-flash)
Aug 09 06:54:33 user nova-compute[72809]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:54:33 user nova-compute[72809]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)
Aug 09 06:54:33 user nova-compute[72809]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)
Aug 09 06:54:33 user nova-compute[72809]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)
Aug 09 06:54:33 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc13851fac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c'): ({'sdd'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Removing single pathed devices sdd {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[57981963-cb08-4b0f-b86f-128a54a3ac19]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Applying migration context for instance 15dda080-3487-4316-ab7b-f7185f0a4519 as it has an incoming, in-progress migration 8c283718-c3fd-4750-866b-935bf3a6380a. Migration status is reverting {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 09 06:54:33 user nova-compute[72809]: INFO nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Updating resource usage from migration 8c283718-c3fd-4750-866b-935bf3a6380a
Aug 09 06:54:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acde210-4ef0-4551-9ceb-fe6d517a36e7]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Flushing IO for device /dev/sdd {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f29a87-03eb-4f83-82bf-a029ee432660]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0b71d9-5e74-4620-9ed8-120f0149c78f]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] SCSI volumes sdd have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1606e41-e352-4904-9044-52403ab9844f]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG nova.network.neutron [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Port 6efe1803-2ae3-490f-8791-c2ba35919f09 binding to destination host user is already ACTIVE {{(pid=72809) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquiring lock "refresh_cache-15dda080-3487-4316-ab7b-f7185f0a4519" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquired lock "refresh_cache-15dda080-3487-4316-ab7b-f7185f0a4519" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG nova.network.neutron [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[82892b18-0080-496e-87ce-aa4befe6d8aa]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c, portal: 172.16.0.220,3260]
Aug 09 06:54:33 user nova-compute[72809]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c, portal: 172.16.0.220,3260] successful.
Aug 09 06:54:33 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764e6f5-4af3-437f-82a0-f0becb06d18c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa267e53-e137-40eb-bcf8-3e79ead9662e]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] <== disconnect_volume: return (344ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 24ba9b41-d0bf-4a84-9f04-bfda9525b154 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 3640991e-8a5b-4674-af81-3117d4269a68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance b64e7169-044c-4d0a-9ee5-f2914f1f5529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Migration 8c283718-c3fd-4750-866b-935bf3a6380a is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 15dda080-3487-4316-ab7b-f7185f0a4519 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 336770eb-4f09-4134-92ef-f96039bf4fa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance f69df9a2-e8ed-4bec-8c01-cd005432a373 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 06:54:33 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 06:54:34 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:54:34 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:54:34 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 06:54:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.701s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:34 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:54:34 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:34 user nova-compute[72809]: DEBUG nova.network.neutron [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Updating instance_info_cache with network_info: [{"id": "6efe1803-2ae3-490f-8791-c2ba35919f09", "address": "fa:16:3e:a7:75:9f", "network": {"id": "aae92e96-18c4-419a-b1b0-5ab55d8f26c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1926005183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52fb0421f625467a8205b8000a6dcee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efe1803-2a", "ovs_interfaceid": "6efe1803-2ae3-490f-8791-c2ba35919f09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:54:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Releasing lock "refresh_cache-15dda080-3487-4316-ab7b-f7185f0a4519" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:54:34 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Creating tmpfile /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/tmp72_bxzd_ to verify with other compute node that the instance is on the same shared storage. {{(pid=72809) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 09 06:54:34 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:34 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:34 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:34 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:34 user nova-compute[72809]: DEBUG nova.objects.instance [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lazy-loading 'flavor' on Instance uuid 24ba9b41-d0bf-4a84-9f04-bfda9525b154 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:54:34 user nova-compute[72809]: DEBUG nova.compute.manager [req-aedc4cf9-55ae-413a-b8e2-b094ee522e08 req-ec5ac085-ce5c-4287-85d4-92c77b25c03c service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Received event network-vif-unplugged-6efe1803-2ae3-490f-8791-c2ba35919f09 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-aedc4cf9-55ae-413a-b8e2-b094ee522e08 req-ec5ac085-ce5c-4287-85d4-92c77b25c03c service nova] Acquiring lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-aedc4cf9-55ae-413a-b8e2-b094ee522e08 req-ec5ac085-ce5c-4287-85d4-92c77b25c03c service nova] Lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-aedc4cf9-55ae-413a-b8e2-b094ee522e08 req-ec5ac085-ce5c-4287-85d4-92c77b25c03c service nova] Lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:34 user nova-compute[72809]: DEBUG nova.compute.manager [req-aedc4cf9-55ae-413a-b8e2-b094ee522e08 req-ec5ac085-ce5c-4287-85d4-92c77b25c03c service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] No waiting events found dispatching network-vif-unplugged-6efe1803-2ae3-490f-8791-c2ba35919f09 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:34 user nova-compute[72809]: WARNING nova.compute.manager [req-aedc4cf9-55ae-413a-b8e2-b094ee522e08 req-ec5ac085-ce5c-4287-85d4-92c77b25c03c service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Received unexpected event network-vif-unplugged-6efe1803-2ae3-490f-8791-c2ba35919f09 for instance with vm_state resized and task_state resize_reverting.
Aug 09 06:54:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d565f455-1ce8-4ac8-ab1c-5822cd8189df tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.408s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:35 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Instance destroyed successfully.
Aug 09 06:54:35 user nova-compute[72809]: DEBUG nova.objects.instance [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lazy-loading 'resources' on Instance uuid 15dda080-3487-4316-ab7b-f7185f0a4519 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:48:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1848436274',display_name='tempest-ServerActionsTestOtherB-server-1848436274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1848436274',id=4,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzddBZQV6rBoKhUSr/KZYr11ADyq1HDaJHBbKwm5pCectYOG8Y/A3xcUayq6O8xK7rSLI08X+2Hg8J2DtxIR/GKq1CHmG5GQromz7rdkcwdeRGHWTQ/2HdiKGS29Oa5Sg==',key_name='tempest-keypair-830185710',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:53:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52fb0421f625467a8205b8000a6dcee5',ramdisk_id='',reservation_id='r-iw1w1c5y',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1112762044',owner_user_name='tempest-ServerActionsTestOtherB-1112762044-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:53:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0347074764734e2a8ca3f580efcb1272',uuid=15dda080-3487-4316-ab7b-f7185f0a4519,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6efe1803-2ae3-490f-8791-c2ba35919f09", "address": "fa:16:3e:a7:75:9f", "network": {"id": "aae92e96-18c4-419a-b1b0-5ab55d8f26c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1926005183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52fb0421f625467a8205b8000a6dcee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efe1803-2a", "ovs_interfaceid": "6efe1803-2ae3-490f-8791-c2ba35919f09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Converting VIF {"id": "6efe1803-2ae3-490f-8791-c2ba35919f09", "address": "fa:16:3e:a7:75:9f", "network": {"id": "aae92e96-18c4-419a-b1b0-5ab55d8f26c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1926005183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52fb0421f625467a8205b8000a6dcee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efe1803-2a", "ovs_interfaceid": "6efe1803-2ae3-490f-8791-c2ba35919f09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:75:9f,bridge_name='br-int',has_traffic_filtering=True,id=6efe1803-2ae3-490f-8791-c2ba35919f09,network=Network(aae92e96-18c4-419a-b1b0-5ab55d8f26c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efe1803-2a') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG os_vif [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:75:9f,bridge_name='br-int',has_traffic_filtering=True,id=6efe1803-2ae3-490f-8791-c2ba35919f09,network=Network(aae92e96-18c4-419a-b1b0-5ab55d8f26c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efe1803-2a') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6efe1803-2a, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:54:35 user nova-compute[72809]: INFO os_vif [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:75:9f,bridge_name='br-int',has_traffic_filtering=True,id=6efe1803-2ae3-490f-8791-c2ba35919f09,network=Network(aae92e96-18c4-419a-b1b0-5ab55d8f26c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efe1803-2a')
Aug 09 06:54:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMtUvsXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:54:35 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:54:35 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a83ae3-98bf-4a79-a72b-d583c6c2198f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b251446-9c6f-4249-924f-764c6f48362a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:54:35 user nova-compute[72809]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:54:35 user nova-compute[72809]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)
Aug 09 06:54:35 user nova-compute[72809]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)
Aug 09 06:54:35 user nova-compute[72809]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)
Aug 09 06:54:35 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:54:35 user nova-compute[72809]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:54:35 user nova-compute[72809]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)
Aug 09 06:54:35 user nova-compute[72809]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)
Aug 09 06:54:35 user nova-compute[72809]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)
Aug 09 06:54:35 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc13851d7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf'): ({'sdc'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Removing single pathed devices sdc {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1b4d6f-0d00-45b5-9f69-1015f851957c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[461ea312-a60d-42d3-88c1-babf53879588]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Flushing IO for device /dev/sdc {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5054ed6-4315-4284-b2f8-0386e166a130]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[582709c4-e783-4921-9802-42f88f216764]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] SCSI volumes sdc have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b79a0c0-8f7b-40a1-9bba-d99a94364c5c]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dabf705-54fa-486f-9b4d-38da8886e521]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf, portal: 172.16.0.220,3260]
Aug 09 06:54:35 user nova-compute[72809]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf, portal: 172.16.0.220,3260] successful.
Aug 09 06:54:35 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd83419a-5b46-4b61-9894-f437ae5766e3]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] <== disconnect_volume: return (314ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72809) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-47a30fac-6c1f-4948-ad59-97fce0822182 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-47a30fac-6c1f-4948-ad59-97fce0822182 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG nova.compute.manager [None req-47a30fac-6c1f-4948-ad59-97fce0822182 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG nova.compute.manager [None req-47a30fac-6c1f-4948-ad59-97fce0822182 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72809) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG nova.objects.instance [None req-47a30fac-6c1f-4948-ad59-97fce0822182 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lazy-loading 'flavor' on Instance uuid 24ba9b41-d0bf-4a84-9f04-bfda9525b154 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:35 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:36 user nova-compute[72809]: DEBUG nova.compute.manager [req-de69177d-075a-40f4-9998-c2f4ea95b910 req-03e99c0f-9082-49df-a4de-2a00b3286cce service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Received event network-vif-unplugged-f12bff80-425f-42ba-804d-540ad751f70c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-de69177d-075a-40f4-9998-c2f4ea95b910 req-03e99c0f-9082-49df-a4de-2a00b3286cce service nova] Acquiring lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-de69177d-075a-40f4-9998-c2f4ea95b910 req-03e99c0f-9082-49df-a4de-2a00b3286cce service nova] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-de69177d-075a-40f4-9998-c2f4ea95b910 req-03e99c0f-9082-49df-a4de-2a00b3286cce service nova] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:36 user nova-compute[72809]: DEBUG nova.compute.manager [req-de69177d-075a-40f4-9998-c2f4ea95b910 req-03e99c0f-9082-49df-a4de-2a00b3286cce service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] No waiting events found dispatching network-vif-unplugged-f12bff80-425f-42ba-804d-540ad751f70c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:36 user nova-compute[72809]: WARNING nova.compute.manager [req-de69177d-075a-40f4-9998-c2f4ea95b910 req-03e99c0f-9082-49df-a4de-2a00b3286cce service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Received unexpected event network-vif-unplugged-f12bff80-425f-42ba-804d-540ad751f70c for instance with vm_state active and task_state powering-off.
Aug 09 06:54:36 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Instance destroyed successfully.
Aug 09 06:54:36 user nova-compute[72809]: DEBUG nova.compute.manager [None req-47a30fac-6c1f-4948-ad59-97fce0822182 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:54:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:36 user nova-compute[72809]: DEBUG nova.objects.instance [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lazy-loading 'migration_context' on Instance uuid 15dda080-3487-4316-ab7b-f7185f0a4519 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:54:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-47a30fac-6c1f-4948-ad59-97fce0822182 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.894s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:36 user nova-compute[72809]: DEBUG nova.compute.manager [req-9525c72a-4dd0-452c-a930-b21c3f83ed57 req-d52a4ae6-da13-4bf3-86a9-2368c3d8e831 service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Received event network-vif-plugged-6efe1803-2ae3-490f-8791-c2ba35919f09 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9525c72a-4dd0-452c-a930-b21c3f83ed57 req-d52a4ae6-da13-4bf3-86a9-2368c3d8e831 service nova] Acquiring lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9525c72a-4dd0-452c-a930-b21c3f83ed57 req-d52a4ae6-da13-4bf3-86a9-2368c3d8e831 service nova] Lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9525c72a-4dd0-452c-a930-b21c3f83ed57 req-d52a4ae6-da13-4bf3-86a9-2368c3d8e831 service nova] Lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:36 user nova-compute[72809]: DEBUG nova.compute.manager [req-9525c72a-4dd0-452c-a930-b21c3f83ed57 req-d52a4ae6-da13-4bf3-86a9-2368c3d8e831 service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] No waiting events found dispatching network-vif-plugged-6efe1803-2ae3-490f-8791-c2ba35919f09 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:36 user nova-compute[72809]: WARNING nova.compute.manager [req-9525c72a-4dd0-452c-a930-b21c3f83ed57 req-d52a4ae6-da13-4bf3-86a9-2368c3d8e831 service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Received unexpected event network-vif-plugged-6efe1803-2ae3-490f-8791-c2ba35919f09 for instance with vm_state resized and task_state resize_reverting.
Aug 09 06:54:36 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:54:36 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:54:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.377s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:37 user nova-compute[72809]: INFO nova.compute.manager [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Swapping old allocation on dict_keys(['28f55a7b-2cb8-4eb0-b993-21feaf69c3a3']) held by migration 8c283718-c3fd-4750-866b-935bf3a6380a for instance
Aug 09 06:54:37 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Overwriting current allocation {'allocations': {'28f55a7b-2cb8-4eb0-b993-21feaf69c3a3': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 21}}, 'project_id': '52fb0421f625467a8205b8000a6dcee5', 'user_id': '0347074764734e2a8ca3f580efcb1272', 'consumer_generation': 1} on consumer 15dda080-3487-4316-ab7b-f7185f0a4519 {{(pid=72809) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 09 06:54:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquiring lock "refresh_cache-15dda080-3487-4316-ab7b-f7185f0a4519" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:54:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquired lock "refresh_cache-15dda080-3487-4316-ab7b-f7185f0a4519" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:54:37 user nova-compute[72809]: DEBUG nova.network.neutron [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:54:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:38 user nova-compute[72809]: DEBUG nova.network.neutron [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Updating instance_info_cache with network_info: [{"id": "6efe1803-2ae3-490f-8791-c2ba35919f09", "address": "fa:16:3e:a7:75:9f", "network": {"id": "aae92e96-18c4-419a-b1b0-5ab55d8f26c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1926005183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52fb0421f625467a8205b8000a6dcee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efe1803-2a", "ovs_interfaceid": "6efe1803-2ae3-490f-8791-c2ba35919f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:54:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Releasing lock "refresh_cache-15dda080-3487-4316-ab7b-f7185f0a4519" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:54:38 user nova-compute[72809]: DEBUG os_brick.utils [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:54:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:38 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[240df57c-b76a-41aa-8535-08e27b3a1b2f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:38 user nova-compute[72809]: DEBUG nova.compute.manager [req-89c9e574-718f-4d3d-822c-a35ea064bfed req-4d74f2e3-cf42-4c38-91ae-51e8602080b9 service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Received event network-vif-plugged-f12bff80-425f-42ba-804d-540ad751f70c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-89c9e574-718f-4d3d-822c-a35ea064bfed req-4d74f2e3-cf42-4c38-91ae-51e8602080b9 service nova] Acquiring lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-89c9e574-718f-4d3d-822c-a35ea064bfed req-4d74f2e3-cf42-4c38-91ae-51e8602080b9 service nova] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-89c9e574-718f-4d3d-822c-a35ea064bfed req-4d74f2e3-cf42-4c38-91ae-51e8602080b9 service nova] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:38 user nova-compute[72809]: DEBUG nova.compute.manager [req-89c9e574-718f-4d3d-822c-a35ea064bfed req-4d74f2e3-cf42-4c38-91ae-51e8602080b9 service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] No waiting events found dispatching network-vif-plugged-f12bff80-425f-42ba-804d-540ad751f70c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:38 user nova-compute[72809]: WARNING nova.compute.manager [req-89c9e574-718f-4d3d-822c-a35ea064bfed req-4d74f2e3-cf42-4c38-91ae-51e8602080b9 service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Received unexpected event network-vif-plugged-f12bff80-425f-42ba-804d-540ad751f70c for instance with vm_state stopped and task_state None.
Aug 09 06:54:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:38 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ba8e6b-417a-4e94-997f-e3a1c3d5769b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:38 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[17679790-ed35-498e-a9f7-9d7991153de4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:38 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9721c0bd-58f4-4688-ae9d-9660cd3e22b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:54:38 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 06:54:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:54:38 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 06:54:38 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a885c476-ceaf-40c2-ade1-63150e38fa1b]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:38 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 06:54:38 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 06:54:38 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 06:54:38 user nova-compute[72809]: DEBUG os_brick.utils [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:54:40 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:41 user nova-compute[72809]: DEBUG nova.compute.manager [req-ada79e11-fe51-4524-bd06-42516e8c8b8e req-3156d019-e7a8-41a9-8283-9d1a0e23d06c service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Received event network-changed-947db6ff-ed42-4aca-a543-a929517ae8e4 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:41 user nova-compute[72809]: DEBUG nova.compute.manager [req-ada79e11-fe51-4524-bd06-42516e8c8b8e req-3156d019-e7a8-41a9-8283-9d1a0e23d06c service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Refreshing instance network info cache due to event network-changed-947db6ff-ed42-4aca-a543-a929517ae8e4. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:54:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ada79e11-fe51-4524-bd06-42516e8c8b8e req-3156d019-e7a8-41a9-8283-9d1a0e23d06c service nova] Acquiring lock "refresh_cache-c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:54:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ada79e11-fe51-4524-bd06-42516e8c8b8e req-3156d019-e7a8-41a9-8283-9d1a0e23d06c service nova] Acquired lock "refresh_cache-c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:54:41 user nova-compute[72809]: DEBUG nova.network.neutron [req-ada79e11-fe51-4524-bd06-42516e8c8b8e req-3156d019-e7a8-41a9-8283-9d1a0e23d06c service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Refreshing network info cache for port 947db6ff-ed42-4aca-a543-a929517ae8e4 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:54:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-42337d1a-f39e-43af-b7ef-698a2a241166 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Acquiring lock "interface-c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-42337d1a-f39e-43af-b7ef-698a2a241166 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lock "interface-c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:41 user nova-compute[72809]: DEBUG nova.objects.instance [None req-42337d1a-f39e-43af-b7ef-698a2a241166 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lazy-loading 'flavor' on Instance uuid c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:54:41 user nova-compute[72809]: DEBUG nova.network.neutron [req-ada79e11-fe51-4524-bd06-42516e8c8b8e req-3156d019-e7a8-41a9-8283-9d1a0e23d06c service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Updated VIF entry in instance network info cache for port 947db6ff-ed42-4aca-a543-a929517ae8e4. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:54:41 user nova-compute[72809]: DEBUG nova.network.neutron [req-ada79e11-fe51-4524-bd06-42516e8c8b8e req-3156d019-e7a8-41a9-8283-9d1a0e23d06c service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Updating instance_info_cache with network_info: [{"id": "947db6ff-ed42-4aca-a543-a929517ae8e4", "address": "fa:16:3e:5d:13:2e", "network": {"id": "1e8ee49b-483d-4c93-839e-c0e80a98012f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1381031589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f46d46622964063ba2425358469a36f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap947db6ff-ed", "ovs_interfaceid": "947db6ff-ed42-4aca-a543-a929517ae8e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:54:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ada79e11-fe51-4524-bd06-42516e8c8b8e req-3156d019-e7a8-41a9-8283-9d1a0e23d06c service nova] Releasing lock "refresh_cache-c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:54:41 user nova-compute[72809]: DEBUG nova.objects.instance [None req-42337d1a-f39e-43af-b7ef-698a2a241166 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lazy-loading 'pci_requests' on Instance uuid c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:54:41 user nova-compute[72809]: DEBUG nova.network.neutron [None req-42337d1a-f39e-43af-b7ef-698a2a241166 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 06:54:41 user nova-compute[72809]: DEBUG nova.policy [None req-42337d1a-f39e-43af-b7ef-698a2a241166 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7924f8e3d85440b9e826c8c33d3f0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f46d46622964063ba2425358469a36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 06:54:42 user nova-compute[72809]: DEBUG nova.network.neutron [None req-42337d1a-f39e-43af-b7ef-698a2a241166 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Successfully created port: d47e67e7-9ad1-4670-9a22-a85ad34210a8 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:54:43 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:43 user nova-compute[72809]: DEBUG nova.network.neutron [None req-42337d1a-f39e-43af-b7ef-698a2a241166 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Successfully updated port: d47e67e7-9ad1-4670-9a22-a85ad34210a8 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:54:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-42337d1a-f39e-43af-b7ef-698a2a241166 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Acquiring lock "refresh_cache-c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:54:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-42337d1a-f39e-43af-b7ef-698a2a241166 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Acquired lock "refresh_cache-c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:54:43 user nova-compute[72809]: DEBUG nova.network.neutron [None req-42337d1a-f39e-43af-b7ef-698a2a241166 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:54:43 user nova-compute[72809]: DEBUG nova.compute.manager [req-2d7e7981-f293-44a1-9feb-f6079925519d req-c970cd71-dd6c-4728-919a-41ae184505f4 service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Received event network-changed-d47e67e7-9ad1-4670-9a22-a85ad34210a8 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:43 user nova-compute[72809]: DEBUG nova.compute.manager [req-2d7e7981-f293-44a1-9feb-f6079925519d req-c970cd71-dd6c-4728-919a-41ae184505f4 service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Refreshing instance network info cache due to event network-changed-d47e67e7-9ad1-4670-9a22-a85ad34210a8. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:54:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2d7e7981-f293-44a1-9feb-f6079925519d req-c970cd71-dd6c-4728-919a-41ae184505f4 service nova] Acquiring lock "refresh_cache-c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:54:44 user nova-compute[72809]: DEBUG nova.network.neutron [None req-42337d1a-f39e-43af-b7ef-698a2a241166 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Updating instance_info_cache with network_info: [{"id": "947db6ff-ed42-4aca-a543-a929517ae8e4", "address": "fa:16:3e:5d:13:2e", "network": {"id": "1e8ee49b-483d-4c93-839e-c0e80a98012f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1381031589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f46d46622964063ba2425358469a36f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap947db6ff-ed", "ovs_interfaceid": "947db6ff-ed42-4aca-a543-a929517ae8e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d47e67e7-9ad1-4670-9a22-a85ad34210a8", "address": "fa:16:3e:20:b3:43", "network": {"id": "d4350fc1-44b6-4863-9fe0-9f3f31f339ba", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1127515905", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8f46d46622964063ba2425358469a36f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd47e67e7-9a", "ovs_interfaceid": "d47e67e7-9ad1-4670-9a22-a85ad34210a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:54:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-42337d1a-f39e-43af-b7ef-698a2a241166 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Releasing lock "refresh_cache-c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:54:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2d7e7981-f293-44a1-9feb-f6079925519d req-c970cd71-dd6c-4728-919a-41ae184505f4 service nova] Acquired lock "refresh_cache-c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:54:44 user nova-compute[72809]: DEBUG nova.network.neutron [req-2d7e7981-f293-44a1-9feb-f6079925519d req-c970cd71-dd6c-4728-919a-41ae184505f4 service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Refreshing network info cache for port d47e67e7-9ad1-4670-9a22-a85ad34210a8 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:54:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-42337d1a-f39e-43af-b7ef-698a2a241166 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:52:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1988221204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1988221204',id=14,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPK9vq6/OkHd2yVdt3nXYH448++2AjnbM8TBYy+YeBzYamc/s5ulP19NzFTO2SUzL2nV3SSIjRSpQ5e91AAsiRiFQ7Uv2icWJyZYAAM4/eghMaXNHw3fgBL4murRC+Qesw==',key_name='tempest-keypair-387388256',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:52:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8f46d46622964063ba2425358469a36f',ramdisk_id='',reservation_id='r-8bvspqp6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-722644131',owner_user_name='tempest-TaggedAttachmentsTest-722644131-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:52:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7924f8e3d85440b9e826c8c33d3f0dc',uuid=c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d47e67e7-9ad1-4670-9a22-a85ad34210a8", "address": "fa:16:3e:20:b3:43", "network": {"id": "d4350fc1-44b6-4863-9fe0-9f3f31f339ba", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1127515905", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8f46d46622964063ba2425358469a36f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd47e67e7-9a", "ovs_interfaceid": "d47e67e7-9ad1-4670-9a22-a85ad34210a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:54:44 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-42337d1a-f39e-43af-b7ef-698a2a241166 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Converting VIF {"id": "d47e67e7-9ad1-4670-9a22-a85ad34210a8", "address": "fa:16:3e:20:b3:43", "network": {"id": "d4350fc1-44b6-4863-9fe0-9f3f31f339ba", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1127515905", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8f46d46622964063ba2425358469a36f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd47e67e7-9a", "ovs_interfaceid": "d47e67e7-9ad1-4670-9a22-a85ad34210a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:54:44 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-42337d1a-f39e-43af-b7ef-698a2a241166 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:b3:43,bridge_name='br-int',has_traffic_filtering=True,id=d47e67e7-9ad1-4670-9a22-a85ad34210a8,network=Network(d4350fc1-44b6-4863-9fe0-9f3f31f339ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd47e67e7-9a') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:54:44 user nova-compute[72809]: DEBUG os_vif [None req-42337d1a-f39e-43af-b7ef-698a2a241166 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:b3:43,bridge_name='br-int',has_traffic_filtering=True,id=d47e67e7-9ad1-4670-9a22-a85ad34210a8,network=Network(d4350fc1-44b6-4863-9fe0-9f3f31f339ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd47e67e7-9a') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:54:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:54:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:54:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd47e67e7-9a, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:54:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd47e67e7-9a, col_values=(('external_ids', {'iface-id': 'd47e67e7-9ad1-4670-9a22-a85ad34210a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:b3:43', 'vm-uuid': 'c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:54:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:54:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:44 user nova-compute[72809]: INFO os_vif [None req-42337d1a-f39e-43af-b7ef-698a2a241166 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:b3:43,bridge_name='br-int',has_traffic_filtering=True,id=d47e67e7-9ad1-4670-9a22-a85ad34210a8,network=Network(d4350fc1-44b6-4863-9fe0-9f3f31f339ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd47e67e7-9a')
Aug 09 06:54:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-42337d1a-f39e-43af-b7ef-698a2a241166 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:52:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1988221204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1988221204',id=14,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPK9vq6/OkHd2yVdt3nXYH448++2AjnbM8TBYy+YeBzYamc/s5ulP19NzFTO2SUzL2nV3SSIjRSpQ5e91AAsiRiFQ7Uv2icWJyZYAAM4/eghMaXNHw3fgBL4murRC+Qesw==',key_name='tempest-keypair-387388256',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:52:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8f46d46622964063ba2425358469a36f',ramdisk_id='',reservation_id='r-8bvspqp6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-722644131',owner_user_name='tempest-TaggedAttachmentsTest-722644131-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:52:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7924f8e3d85440b9e826c8c33d3f0dc',uuid=c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d47e67e7-9ad1-4670-9a22-a85ad34210a8", "address": "fa:16:3e:20:b3:43", "network": {"id": "d4350fc1-44b6-4863-9fe0-9f3f31f339ba", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1127515905", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8f46d46622964063ba2425358469a36f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd47e67e7-9a", "ovs_interfaceid": "d47e67e7-9ad1-4670-9a22-a85ad34210a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:54:44 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-42337d1a-f39e-43af-b7ef-698a2a241166 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Converting VIF {"id": "d47e67e7-9ad1-4670-9a22-a85ad34210a8", "address": "fa:16:3e:20:b3:43", "network": {"id": "d4350fc1-44b6-4863-9fe0-9f3f31f339ba", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1127515905", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8f46d46622964063ba2425358469a36f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd47e67e7-9a", "ovs_interfaceid": "d47e67e7-9ad1-4670-9a22-a85ad34210a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:54:44 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-42337d1a-f39e-43af-b7ef-698a2a241166 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:b3:43,bridge_name='br-int',has_traffic_filtering=True,id=d47e67e7-9ad1-4670-9a22-a85ad34210a8,network=Network(d4350fc1-44b6-4863-9fe0-9f3f31f339ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd47e67e7-9a') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:54:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-42337d1a-f39e-43af-b7ef-698a2a241166 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] attach device xml: <interface type="ethernet">
Aug 09 06:54:44 user nova-compute[72809]:   <mac address="fa:16:3e:20:b3:43"/>
Aug 09 06:54:44 user nova-compute[72809]:   <model type="virtio"/>
Aug 09 06:54:44 user nova-compute[72809]:   <mtu size="1442"/>
Aug 09 06:54:44 user nova-compute[72809]:   <target dev="tapd47e67e7-9a"/>
Aug 09 06:54:44 user nova-compute[72809]: </interface>
Aug 09 06:54:44 user nova-compute[72809]:  {{(pid=72809) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 06:54:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:44 user nova-compute[72809]: DEBUG nova.compute.manager [req-0cc32574-42b4-45f7-b46d-ebcc0b237589 req-c09e4310-0200-437b-a930-acd1d97ee302 service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Received event network-vif-plugged-d47e67e7-9ad1-4670-9a22-a85ad34210a8 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0cc32574-42b4-45f7-b46d-ebcc0b237589 req-c09e4310-0200-437b-a930-acd1d97ee302 service nova] Acquiring lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0cc32574-42b4-45f7-b46d-ebcc0b237589 req-c09e4310-0200-437b-a930-acd1d97ee302 service nova] Lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0cc32574-42b4-45f7-b46d-ebcc0b237589 req-c09e4310-0200-437b-a930-acd1d97ee302 service nova] Lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:44 user nova-compute[72809]: DEBUG nova.compute.manager [req-0cc32574-42b4-45f7-b46d-ebcc0b237589 req-c09e4310-0200-437b-a930-acd1d97ee302 service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] No waiting events found dispatching network-vif-plugged-d47e67e7-9ad1-4670-9a22-a85ad34210a8 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:44 user nova-compute[72809]: WARNING nova.compute.manager [req-0cc32574-42b4-45f7-b46d-ebcc0b237589 req-c09e4310-0200-437b-a930-acd1d97ee302 service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Received unexpected event network-vif-plugged-d47e67e7-9ad1-4670-9a22-a85ad34210a8 for instance with vm_state active and task_state None.
Aug 09 06:54:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-42337d1a-f39e-43af-b7ef-698a2a241166 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:54:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-42337d1a-f39e-43af-b7ef-698a2a241166 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] No BDM found with device name hda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:54:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-42337d1a-f39e-43af-b7ef-698a2a241166 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] No VIF found with MAC fa:16:3e:5d:13:2e, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-42337d1a-f39e-43af-b7ef-698a2a241166 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:54:45 user nova-compute[72809]:   <nova:package version="0.0.0"/>
Aug 09 06:54:45 user nova-compute[72809]:   <nova:name>tempest-device-tagging-server-1988221204</nova:name>
Aug 09 06:54:45 user nova-compute[72809]:   <nova:creationTime>2023-08-09 06:54:44</nova:creationTime>
Aug 09 06:54:45 user nova-compute[72809]:   <nova:flavor name="m1.tiny">
Aug 09 06:54:45 user nova-compute[72809]:     <nova:memory>512</nova:memory>
Aug 09 06:54:45 user nova-compute[72809]:     <nova:disk>1</nova:disk>
Aug 09 06:54:45 user nova-compute[72809]:     <nova:swap>0</nova:swap>
Aug 09 06:54:45 user nova-compute[72809]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:54:45 user nova-compute[72809]:     <nova:vcpus>1</nova:vcpus>
Aug 09 06:54:45 user nova-compute[72809]:   </nova:flavor>
Aug 09 06:54:45 user nova-compute[72809]:   <nova:owner>
Aug 09 06:54:45 user nova-compute[72809]:     <nova:user uuid="c7924f8e3d85440b9e826c8c33d3f0dc">tempest-TaggedAttachmentsTest-722644131-project-member</nova:user>
Aug 09 06:54:45 user nova-compute[72809]:     <nova:project uuid="8f46d46622964063ba2425358469a36f">tempest-TaggedAttachmentsTest-722644131</nova:project>
Aug 09 06:54:45 user nova-compute[72809]:   </nova:owner>
Aug 09 06:54:45 user nova-compute[72809]:   <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:54:45 user nova-compute[72809]:   <nova:ports>
Aug 09 06:54:45 user nova-compute[72809]:     <nova:port uuid="947db6ff-ed42-4aca-a543-a929517ae8e4">
Aug 09 06:54:45 user nova-compute[72809]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 06:54:45 user nova-compute[72809]:     </nova:port>
Aug 09 06:54:45 user nova-compute[72809]:     <nova:port uuid="d47e67e7-9ad1-4670-9a22-a85ad34210a8">
Aug 09 06:54:45 user nova-compute[72809]:       <nova:ip type="fixed" address="10.10.10.164" ipVersion="4"/>
Aug 09 06:54:45 user nova-compute[72809]:     </nova:port>
Aug 09 06:54:45 user nova-compute[72809]:   </nova:ports>
Aug 09 06:54:45 user nova-compute[72809]: </nova:instance>
Aug 09 06:54:45 user nova-compute[72809]:  {{(pid=72809) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-42337d1a-f39e-43af-b7ef-698a2a241166 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lock "interface-c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.465s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG nova.network.neutron [req-2d7e7981-f293-44a1-9feb-f6079925519d req-c970cd71-dd6c-4728-919a-41ae184505f4 service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Updated VIF entry in instance network info cache for port d47e67e7-9ad1-4670-9a22-a85ad34210a8. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG nova.network.neutron [req-2d7e7981-f293-44a1-9feb-f6079925519d req-c970cd71-dd6c-4728-919a-41ae184505f4 service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Updating instance_info_cache with network_info: [{"id": "947db6ff-ed42-4aca-a543-a929517ae8e4", "address": "fa:16:3e:5d:13:2e", "network": {"id": "1e8ee49b-483d-4c93-839e-c0e80a98012f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1381031589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f46d46622964063ba2425358469a36f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap947db6ff-ed", "ovs_interfaceid": "947db6ff-ed42-4aca-a543-a929517ae8e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d47e67e7-9ad1-4670-9a22-a85ad34210a8", "address": "fa:16:3e:20:b3:43", "network": {"id": "d4350fc1-44b6-4863-9fe0-9f3f31f339ba", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1127515905", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8f46d46622964063ba2425358469a36f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd47e67e7-9a", "ovs_interfaceid": "d47e67e7-9ad1-4670-9a22-a85ad34210a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2d7e7981-f293-44a1-9feb-f6079925519d req-c970cd71-dd6c-4728-919a-41ae184505f4 service nova] Releasing lock "refresh_cache-c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Acquiring lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG nova.objects.instance [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lazy-loading 'flavor' on Instance uuid c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Acquiring lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:45 user nova-compute[72809]: INFO nova.compute.manager [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Attaching volume 5eddf756-b7e6-4ea4-ad4f-0c7af989abdb to /dev/vdb
Aug 09 06:54:45 user nova-compute[72809]: DEBUG os_brick.utils [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4e4fef-1cf7-45c3-b2a9-a7c162035751]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd50889c-7ddc-494b-91da-37f7347382db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b24c882-9e90-4ae6-8d88-57ce9c4c6325]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4402b079-e84e-4a71-bbbc-70bdada0ee3d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:54:45 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 06:54:45 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[59597801-157d-40df-9d20-2ffa1669e6f2]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG os_brick.utils [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:54:45 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Updating existing volume attachment record: 87898276-c376-4ff0-b038-e7e2c77f205c {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 06:54:46 user nova-compute[72809]: DEBUG nova.compute.manager [req-0f7146e5-cb04-4a51-929b-b3749f8cf9f9 req-8b678d17-2b82-47f4-892c-4ddb525e30a7 service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Received event network-vif-plugged-d47e67e7-9ad1-4670-9a22-a85ad34210a8 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0f7146e5-cb04-4a51-929b-b3749f8cf9f9 req-8b678d17-2b82-47f4-892c-4ddb525e30a7 service nova] Acquiring lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0f7146e5-cb04-4a51-929b-b3749f8cf9f9 req-8b678d17-2b82-47f4-892c-4ddb525e30a7 service nova] Lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0f7146e5-cb04-4a51-929b-b3749f8cf9f9 req-8b678d17-2b82-47f4-892c-4ddb525e30a7 service nova] Lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:46 user nova-compute[72809]: DEBUG nova.compute.manager [req-0f7146e5-cb04-4a51-929b-b3749f8cf9f9 req-8b678d17-2b82-47f4-892c-4ddb525e30a7 service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] No waiting events found dispatching network-vif-plugged-d47e67e7-9ad1-4670-9a22-a85ad34210a8 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:46 user nova-compute[72809]: WARNING nova.compute.manager [req-0f7146e5-cb04-4a51-929b-b3749f8cf9f9 req-8b678d17-2b82-47f4-892c-4ddb525e30a7 service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Received unexpected event network-vif-plugged-d47e67e7-9ad1-4670-9a22-a85ad34210a8 for instance with vm_state active and task_state None.
Aug 09 06:54:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Starting finish_revert_migration {{(pid=72809) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Start _get_guest_xml network_info=[{"id": "6efe1803-2ae3-490f-8791-c2ba35919f09", "address": "fa:16:3e:a7:75:9f", "network": {"id": "aae92e96-18c4-419a-b1b0-5ab55d8f26c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1926005183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52fb0421f625467a8205b8000a6dcee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efe1803-2a", "ovs_interfaceid": "6efe1803-2ae3-490f-8791-c2ba35919f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMtUvsXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '15dda080-3487-4316-ab7b-f7185f0a4519', 'attached_at': '2023-08-09T06:54:48.000000', 'detached_at': '', 'volume_id': '521a87a6-3612-4fe2-ba75-ffa77601e8bf', 'serial': '521a87a6-3612-4fe2-ba75-ffa77601e8bf'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': None, 'attachment_id': '95b4803c-4092-4a71-bef3-834ccdedca1f', 'volume_type': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:54:48 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:54:48 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:54:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG nova.objects.instance [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lazy-loading 'vcpu_model' on Instance uuid 15dda080-3487-4316-ab7b-f7185f0a4519 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMtUvsXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:54:48 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:54:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:54:48 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:54:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:54:48 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 06:54:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[df41ef4a-cbdf-450b-83a3-ae17f24cb053]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 06:54:48 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6140fff-8110-47f9-96cd-f43a5ebca640]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf] added
Aug 09 06:54:48 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdd096f-a5b0-48b1-85b3-a87cc68fad56]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cea8bf-0f22-4331-a980-b2a452cf6f2b]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zMtUvsXI {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zMtUvsXI" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[78baa278-8635-4c4a-bf01-ad2a6e6a96d6]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zMtUvsXI'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d026ac-7c14-4254-9deb-479c0397dc93]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba8fa3a-ae52-426f-bc5b-5a6d30b09627]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:54:48 user nova-compute[72809]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)
Aug 09 06:54:48 user nova-compute[72809]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)
Aug 09 06:54:48 user nova-compute[72809]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)
Aug 09 06:54:48 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:54:48 user nova-compute[72809]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)
Aug 09 06:54:48 user nova-compute[72809]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)
Aug 09 06:54:48 user nova-compute[72809]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)
Aug 09 06:54:48 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b07770-30f0-4c73-b9a0-e46bbbb43100]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf, portal: 172.16.0.220,3260]
Aug 09 06:54:48 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf, portal: 172.16.0.220,3260] successful.
Aug 09 06:54:48 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e8eb8d-0cb8-4510-9046-e2fea9c69ac8]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e1493e-66dd-4ac5-aafb-813b413f1138]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:54:48 user nova-compute[72809]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)
Aug 09 06:54:48 user nova-compute[72809]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)
Aug 09 06:54:48 user nova-compute[72809]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)
Aug 09 06:54:48 user nova-compute[72809]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:54:48 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:54:48 user nova-compute[72809]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)
Aug 09 06:54:48 user nova-compute[72809]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)
Aug 09 06:54:48 user nova-compute[72809]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)
Aug 09 06:54:48 user nova-compute[72809]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:54:48 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5126e520-3774-494f-83c1-c3c83e9dbb4b]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:48 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: None {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 06:54:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:49 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 06:54:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMtUvsXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 06:54:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:54:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '26334623733663261', 'path': '/dev/sdc'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:54:49 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334623733663261', 'path': '/dev/sdc'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 06:54:49 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:48:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1848436274',display_name='tempest-ServerActionsTestOtherB-server-1848436274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1848436274',id=4,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzddBZQV6rBoKhUSr/KZYr11ADyq1HDaJHBbKwm5pCectYOG8Y/A3xcUayq6O8xK7rSLI08X+2Hg8J2DtxIR/GKq1CHmG5GQromz7rdkcwdeRGHWTQ/2HdiKGS29Oa5Sg==',key_name='tempest-keypair-830185710',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:53:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='52fb0421f625467a8205b8000a6dcee5',ramdisk_id='',reservation_id='r-iw1w1c5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1112762044',owner_user_name='tempest-ServerActionsTestOtherB-1112762044-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:54:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0347074764734e2a8ca3f580efcb1272',uuid=15dda080-3487-4316-ab7b-f7185f0a4519,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6efe1803-2ae3-490f-8791-c2ba35919f09", "address": "fa:16:3e:a7:75:9f", "network": {"id": "aae92e96-18c4-419a-b1b0-5ab55d8f26c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1926005183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52fb0421f625467a8205b8000a6dcee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efe1803-2a", "ovs_interfaceid": "6efe1803-2ae3-490f-8791-c2ba35919f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:54:49 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Converting VIF {"id": "6efe1803-2ae3-490f-8791-c2ba35919f09", "address": "fa:16:3e:a7:75:9f", "network": {"id": "aae92e96-18c4-419a-b1b0-5ab55d8f26c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1926005183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52fb0421f625467a8205b8000a6dcee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efe1803-2a", "ovs_interfaceid": "6efe1803-2ae3-490f-8791-c2ba35919f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:54:49 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:75:9f,bridge_name='br-int',has_traffic_filtering=True,id=6efe1803-2ae3-490f-8791-c2ba35919f09,network=Network(aae92e96-18c4-419a-b1b0-5ab55d8f26c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efe1803-2a') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:54:49 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:54:49 user nova-compute[72809]:   <uuid>15dda080-3487-4316-ab7b-f7185f0a4519</uuid>
Aug 09 06:54:49 user nova-compute[72809]:   <name>instance-00000004</name>
Aug 09 06:54:49 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:54:49 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:54:49 user nova-compute[72809]:   <metadata>
Aug 09 06:54:49 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:54:49 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:54:49 user nova-compute[72809]:       <nova:name>tempest-ServerActionsTestOtherB-server-1848436274</nova:name>
Aug 09 06:54:49 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:54:48</nova:creationTime>
Aug 09 06:54:49 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:54:49 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:54:49 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:54:49 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:54:49 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:54:49 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:54:49 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:54:49 user nova-compute[72809]:       <nova:owner>
Aug 09 06:54:49 user nova-compute[72809]:         <nova:user uuid="0347074764734e2a8ca3f580efcb1272">tempest-ServerActionsTestOtherB-1112762044-project-member</nova:user>
Aug 09 06:54:49 user nova-compute[72809]:         <nova:project uuid="52fb0421f625467a8205b8000a6dcee5">tempest-ServerActionsTestOtherB-1112762044</nova:project>
Aug 09 06:54:49 user nova-compute[72809]:       </nova:owner>
Aug 09 06:54:49 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:54:49 user nova-compute[72809]:       <nova:ports>
Aug 09 06:54:49 user nova-compute[72809]:         <nova:port uuid="6efe1803-2ae3-490f-8791-c2ba35919f09">
Aug 09 06:54:49 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 06:54:49 user nova-compute[72809]:         </nova:port>
Aug 09 06:54:49 user nova-compute[72809]:       </nova:ports>
Aug 09 06:54:49 user nova-compute[72809]:     </nova:instance>
Aug 09 06:54:49 user nova-compute[72809]:   </metadata>
Aug 09 06:54:49 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:54:49 user nova-compute[72809]:     <system>
Aug 09 06:54:49 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:54:49 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:54:49 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:54:49 user nova-compute[72809]:       <entry name="serial">15dda080-3487-4316-ab7b-f7185f0a4519</entry>
Aug 09 06:54:49 user nova-compute[72809]:       <entry name="uuid">15dda080-3487-4316-ab7b-f7185f0a4519</entry>
Aug 09 06:54:49 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:54:49 user nova-compute[72809]:     </system>
Aug 09 06:54:49 user nova-compute[72809]:   </sysinfo>
Aug 09 06:54:49 user nova-compute[72809]:   <os>
Aug 09 06:54:49 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:54:49 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 06:54:49 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:54:49 user nova-compute[72809]:   </os>
Aug 09 06:54:49 user nova-compute[72809]:   <features>
Aug 09 06:54:49 user nova-compute[72809]:     <acpi/>
Aug 09 06:54:49 user nova-compute[72809]:     <apic/>
Aug 09 06:54:49 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:54:49 user nova-compute[72809]:   </features>
Aug 09 06:54:49 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:54:49 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:54:49 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:54:49 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:54:49 user nova-compute[72809]:   </clock>
Aug 09 06:54:49 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:54:49 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:54:49 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:54:49 user nova-compute[72809]:   </cpu>
Aug 09 06:54:49 user nova-compute[72809]:   <devices>
Aug 09 06:54:49 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:54:49 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:54:49 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk"/>
Aug 09 06:54:49 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:54:49 user nova-compute[72809]:     </disk>
Aug 09 06:54:49 user nova-compute[72809]:     <disk type="block" device="disk">
Aug 09 06:54:49 user nova-compute[72809]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:54:49 user nova-compute[72809]:       <source dev="/dev/sdc"/>
Aug 09 06:54:49 user nova-compute[72809]:       <target dev="vdb" bus="virtio"/>
Aug 09 06:54:49 user nova-compute[72809]:       <serial>521a87a6-3612-4fe2-ba75-ffa77601e8bf</serial>
Aug 09 06:54:49 user nova-compute[72809]:     </disk>
Aug 09 06:54:49 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:54:49 user nova-compute[72809]:       <mac address="fa:16:3e:a7:75:9f"/>
Aug 09 06:54:49 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:54:49 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:54:49 user nova-compute[72809]:       <target dev="tap6efe1803-2a"/>
Aug 09 06:54:49 user nova-compute[72809]:     </interface>
Aug 09 06:54:49 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:54:49 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/console.log" append="off"/>
Aug 09 06:54:49 user nova-compute[72809]:     </serial>
Aug 09 06:54:49 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:54:49 user nova-compute[72809]:     <video>
Aug 09 06:54:49 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:54:49 user nova-compute[72809]:     </video>
Aug 09 06:54:49 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:54:49 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:54:49 user nova-compute[72809]:     </rng>
Aug 09 06:54:49 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:54:49 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:54:49 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:54:49 user nova-compute[72809]:     </memballoon>
Aug 09 06:54:49 user nova-compute[72809]:   </devices>
Aug 09 06:54:49 user nova-compute[72809]: </domain>
Aug 09 06:54:49 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:54:49 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:48:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1848436274',display_name='tempest-ServerActionsTestOtherB-server-1848436274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1848436274',id=4,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzddBZQV6rBoKhUSr/KZYr11ADyq1HDaJHBbKwm5pCectYOG8Y/A3xcUayq6O8xK7rSLI08X+2Hg8J2DtxIR/GKq1CHmG5GQromz7rdkcwdeRGHWTQ/2HdiKGS29Oa5Sg==',key_name='tempest-keypair-830185710',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:53:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='52fb0421f625467a8205b8000a6dcee5',ramdisk_id='',reservation_id='r-iw1w1c5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1112762044',owner_user_name='tempest-ServerActionsTestOtherB-1112762044-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:54:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0347074764734e2a8ca3f580efcb1272',uuid=15dda080-3487-4316-ab7b-f7185f0a4519,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6efe1803-2ae3-490f-8791-c2ba35919f09", "address": "fa:16:3e:a7:75:9f", "network": {"id": "aae92e96-18c4-419a-b1b0-5ab55d8f26c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1926005183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52fb0421f625467a8205b8000a6dcee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efe1803-2a", "ovs_interfaceid": "6efe1803-2ae3-490f-8791-c2ba35919f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:54:49 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Converting VIF {"id": "6efe1803-2ae3-490f-8791-c2ba35919f09", "address": "fa:16:3e:a7:75:9f", "network": {"id": "aae92e96-18c4-419a-b1b0-5ab55d8f26c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1926005183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52fb0421f625467a8205b8000a6dcee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efe1803-2a", "ovs_interfaceid": "6efe1803-2ae3-490f-8791-c2ba35919f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:54:49 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:75:9f,bridge_name='br-int',has_traffic_filtering=True,id=6efe1803-2ae3-490f-8791-c2ba35919f09,network=Network(aae92e96-18c4-419a-b1b0-5ab55d8f26c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efe1803-2a') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:54:49 user nova-compute[72809]: DEBUG os_vif [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:75:9f,bridge_name='br-int',has_traffic_filtering=True,id=6efe1803-2ae3-490f-8791-c2ba35919f09,network=Network(aae92e96-18c4-419a-b1b0-5ab55d8f26c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efe1803-2a') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:54:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:54:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:54:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6efe1803-2a, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:54:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6efe1803-2a, col_values=(('external_ids', {'iface-id': '6efe1803-2ae3-490f-8791-c2ba35919f09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:75:9f', 'vm-uuid': '15dda080-3487-4316-ab7b-f7185f0a4519'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:54:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:54:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:49 user nova-compute[72809]: INFO os_vif [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:75:9f,bridge_name='br-int',has_traffic_filtering=True,id=6efe1803-2ae3-490f-8791-c2ba35919f09,network=Network(aae92e96-18c4-419a-b1b0-5ab55d8f26c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efe1803-2a')
Aug 09 06:54:50 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691564075.247489, 15dda080-3487-4316-ab7b-f7185f0a4519 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:54:50 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] VM Stopped (Lifecycle Event)
Aug 09 06:54:50 user nova-compute[72809]: DEBUG nova.compute.manager [None req-34c3e489-ca79-462b-9ed5-cc2a7538310a None None] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:54:50 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:50 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:51 user nova-compute[72809]: DEBUG nova.compute.manager [req-5a551f26-c56b-45f7-be0b-89491a645ed0 req-403d6541-233e-46dd-9bc2-b2c21f289d46 service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Received event network-vif-plugged-6efe1803-2ae3-490f-8791-c2ba35919f09 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5a551f26-c56b-45f7-be0b-89491a645ed0 req-403d6541-233e-46dd-9bc2-b2c21f289d46 service nova] Acquiring lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5a551f26-c56b-45f7-be0b-89491a645ed0 req-403d6541-233e-46dd-9bc2-b2c21f289d46 service nova] Lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5a551f26-c56b-45f7-be0b-89491a645ed0 req-403d6541-233e-46dd-9bc2-b2c21f289d46 service nova] Lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:51 user nova-compute[72809]: DEBUG nova.compute.manager [req-5a551f26-c56b-45f7-be0b-89491a645ed0 req-403d6541-233e-46dd-9bc2-b2c21f289d46 service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] No waiting events found dispatching network-vif-plugged-6efe1803-2ae3-490f-8791-c2ba35919f09 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:51 user nova-compute[72809]: WARNING nova.compute.manager [req-5a551f26-c56b-45f7-be0b-89491a645ed0 req-403d6541-233e-46dd-9bc2-b2c21f289d46 service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Received unexpected event network-vif-plugged-6efe1803-2ae3-490f-8791-c2ba35919f09 for instance with vm_state resized and task_state resize_reverting.
Aug 09 06:54:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:51 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691564076.6045182, 24ba9b41-d0bf-4a84-9f04-bfda9525b154 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:54:51 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] VM Stopped (Lifecycle Event)
Aug 09 06:54:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:51 user nova-compute[72809]: DEBUG nova.compute.manager [None req-3da85b3d-5458-4392-a6ba-ddf12d6525a1 None None] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:54:51 user nova-compute[72809]: DEBUG nova.compute.manager [None req-3da85b3d-5458-4392-a6ba-ddf12d6525a1 None None] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:54:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:53 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564093.1719081, 15dda080-3487-4316-ab7b-f7185f0a4519 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:54:53 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] VM Resumed (Lifecycle Event)
Aug 09 06:54:53 user nova-compute[72809]: DEBUG nova.compute.manager [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:54:53 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Instance running successfully.
Aug 09 06:54:53 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] finish_revert_migration finished successfully. {{(pid=72809) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 09 06:54:53 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:54:53 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:54:53 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 09 06:54:53 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564093.1739407, 15dda080-3487-4316-ab7b-f7185f0a4519 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:54:53 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] VM Started (Lifecycle Event)
Aug 09 06:54:53 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:54:53 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:54:53 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 09 06:54:53 user nova-compute[72809]: DEBUG nova.compute.manager [req-f017650f-4e70-49ed-8d8d-54b10f52ccca req-86a3b6fb-28ac-4a6d-b010-728c8ff9e905 service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Received event network-vif-plugged-6efe1803-2ae3-490f-8791-c2ba35919f09 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:53 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f017650f-4e70-49ed-8d8d-54b10f52ccca req-86a3b6fb-28ac-4a6d-b010-728c8ff9e905 service nova] Acquiring lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:53 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f017650f-4e70-49ed-8d8d-54b10f52ccca req-86a3b6fb-28ac-4a6d-b010-728c8ff9e905 service nova] Lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:53 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f017650f-4e70-49ed-8d8d-54b10f52ccca req-86a3b6fb-28ac-4a6d-b010-728c8ff9e905 service nova] Lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:53 user nova-compute[72809]: DEBUG nova.compute.manager [req-f017650f-4e70-49ed-8d8d-54b10f52ccca req-86a3b6fb-28ac-4a6d-b010-728c8ff9e905 service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] No waiting events found dispatching network-vif-plugged-6efe1803-2ae3-490f-8791-c2ba35919f09 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:53 user nova-compute[72809]: WARNING nova.compute.manager [req-f017650f-4e70-49ed-8d8d-54b10f52ccca req-86a3b6fb-28ac-4a6d-b010-728c8ff9e905 service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Received unexpected event network-vif-plugged-6efe1803-2ae3-490f-8791-c2ba35919f09 for instance with vm_state resized and task_state resize_reverting.
Aug 09 06:54:53 user nova-compute[72809]: INFO nova.compute.manager [None req-a4fd8596-a3ca-4cec-9dc5-69994eec1ddc tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Updating instance to original state: 'active'
Aug 09 06:54:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:54 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 06:54:54 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rSynYCeQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:54:54 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:54:54 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:54:54 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:54:54 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:54:54 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:54:54 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:54:54 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 06:54:54 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:54 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:54 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d6b7b0-9146-4843-a6c6-4c1ef0e3f814]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:54 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 06:54:54 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:54 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:54 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:54 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0307ef-0d41-4205-a80d-0394f4acd87a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:54 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb] added
Aug 09 06:54:54 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:54 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:54 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:54 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4d5edb-1515-416f-8643-31216e9ab069]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:54 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:54 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:54 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.120s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:54 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4731a4b6-ccc7-46e3-81f4-f5edd402bbaf]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:54 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:54 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rSynYCeQ {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:54 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rSynYCeQ" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:54 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e6a8ad-d19d-4d53-9961-45449069fe73]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:54 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rSynYCeQ'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:54 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:54 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:54 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[295803ab-b081-43b8-982c-e8292740dce8]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:54 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:54 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:55 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29f3646-4de9-421d-ac4e-c2f0b2a0726a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:54:55 user nova-compute[72809]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)
Aug 09 06:54:55 user nova-compute[72809]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)
Aug 09 06:54:55 user nova-compute[72809]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)
Aug 09 06:54:55 user nova-compute[72809]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:54:55 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:54:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:54:55 user nova-compute[72809]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)
Aug 09 06:54:55 user nova-compute[72809]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)
Aug 09 06:54:55 user nova-compute[72809]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)
Aug 09 06:54:55 user nova-compute[72809]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:54:55 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:54:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:55 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea9e03c-9490-4451-824c-970e7e8cd66f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb, portal: 172.16.0.220,3260]
Aug 09 06:54:55 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb, portal: 172.16.0.220,3260] successful.
Aug 09 06:54:55 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:55 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[18833dff-6bc2-4195-a71b-46fc3e4c097d]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:55 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73407b6-295e-48b0-80f9-b82e33afbc04]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:54:55 user nova-compute[72809]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)
Aug 09 06:54:55 user nova-compute[72809]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)
Aug 09 06:54:55 user nova-compute[72809]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)
Aug 09 06:54:55 user nova-compute[72809]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:54:55 user nova-compute[72809]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb (non-flash)
Aug 09 06:54:55 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:54:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:54:55 user nova-compute[72809]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)
Aug 09 06:54:55 user nova-compute[72809]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)
Aug 09 06:54:55 user nova-compute[72809]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)
Aug 09 06:54:55 user nova-compute[72809]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:54:55 user nova-compute[72809]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb (non-flash)
Aug 09 06:54:55 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:54:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.439s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:54:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 06:54:55 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 06:54:55 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 06:54:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:55 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfea61cc-46f9-455c-881d-7b53cc20ab0c]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:55 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 06:54:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rSynYCeQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 06:54:56 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.477s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:54:56 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] <== connect_volume: return (1478ms) {'type': 'block', 'scsi_wwn': '23537663331623032', 'path': '/dev/sdd'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:54:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537663331623032', 'path': '/dev/sdd'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 06:54:56 user nova-compute[72809]: DEBUG nova.objects.instance [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lazy-loading 'flavor' on Instance uuid c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:54:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 06:54:56 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:54:56 user nova-compute[72809]:   <source dev="/dev/sdd"/>
Aug 09 06:54:56 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 06:54:56 user nova-compute[72809]:   <serial>5eddf756-b7e6-4ea4-ad4f-0c7af989abdb</serial>
Aug 09 06:54:56 user nova-compute[72809]: </disk>
Aug 09 06:54:56 user nova-compute[72809]:  {{(pid=72809) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 06:54:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:54:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] No BDM found with device name hda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:54:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] No VIF found with MAC fa:16:3e:5d:13:2e, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:54:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-295baa68-1120-47d7-94ef-99d9533d73a4 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.159s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Acquiring lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:58 user nova-compute[72809]: INFO nova.compute.manager [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Detaching volume 5eddf756-b7e6-4ea4-ad4f-0c7af989abdb
Aug 09 06:54:58 user nova-compute[72809]: INFO nova.virt.block_device [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Attempting to driver detach volume 5eddf756-b7e6-4ea4-ad4f-0c7af989abdb from mountpoint /dev/vdb
Aug 09 06:54:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Attempting to detach device vdb from instance c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed from the persistent domain config. {{(pid=72809) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 06:54:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 06:54:58 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:54:58 user nova-compute[72809]:   <source dev="/dev/sdd"/>
Aug 09 06:54:58 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 06:54:58 user nova-compute[72809]:   <serial>5eddf756-b7e6-4ea4-ad4f-0c7af989abdb</serial>
Aug 09 06:54:58 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 06:54:58 user nova-compute[72809]: </disk>
Aug 09 06:54:58 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 06:54:58 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Successfully detached device vdb from instance c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed from the persistent domain config.
Aug 09 06:54:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed from the live domain config. {{(pid=72809) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 06:54:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 06:54:58 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:54:58 user nova-compute[72809]:   <source dev="/dev/sdd"/>
Aug 09 06:54:58 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 06:54:58 user nova-compute[72809]:   <serial>5eddf756-b7e6-4ea4-ad4f-0c7af989abdb</serial>
Aug 09 06:54:58 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 06:54:58 user nova-compute[72809]: </disk>
Aug 09 06:54:58 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Received event <DeviceRemovedEvent: 1691564099.264904, c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72809) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed {{(pid=72809) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 06:54:59 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Successfully detached device vdb from instance c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed from the live domain config.
Aug 09 06:54:59 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rSynYCeQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:54:59 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:54:59 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af3642e-9981-4612-a7b3-081ca63cee1d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2eeb1c8-4274-4a9d-bfe2-8ad5bd3b5ae6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:54:59 user nova-compute[72809]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)
Aug 09 06:54:59 user nova-compute[72809]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)
Aug 09 06:54:59 user nova-compute[72809]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)
Aug 09 06:54:59 user nova-compute[72809]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:54:59 user nova-compute[72809]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb (non-flash)
Aug 09 06:54:59 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:54:59 user nova-compute[72809]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)
Aug 09 06:54:59 user nova-compute[72809]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)
Aug 09 06:54:59 user nova-compute[72809]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)
Aug 09 06:54:59 user nova-compute[72809]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:54:59 user nova-compute[72809]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb (non-flash)
Aug 09 06:54:59 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc13851ea70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb'): ({'sdd'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Removing single pathed devices sdd {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[918a69ed-b154-4098-acf0-4956d212aaae]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e980021a-fe1c-4249-88d8-bc92c58eaaa0]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Flushing IO for device /dev/sdd {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8aa87b-b159-4565-98de-e9f7614ce22f]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-39379e7f-b827-4ddf-8062-b242e47433d8 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Acquiring lock "1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-39379e7f-b827-4ddf-8062-b242e47433d8 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lock "1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-39379e7f-b827-4ddf-8062-b242e47433d8 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Acquiring lock "1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-39379e7f-b827-4ddf-8062-b242e47433d8 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lock "1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-39379e7f-b827-4ddf-8062-b242e47433d8 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lock "1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:59 user nova-compute[72809]: INFO nova.compute.manager [None req-39379e7f-b827-4ddf-8062-b242e47433d8 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Terminating instance
Aug 09 06:54:59 user nova-compute[72809]: DEBUG nova.compute.manager [None req-39379e7f-b827-4ddf-8062-b242e47433d8 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3478aa6d-fc2c-437d-83dd-8b5a42d2c6de]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] SCSI volumes sdd have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a64511-4da2-4e76-bab2-bf3bc3845ce1]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecf4a12-8393-457a-9486-1e7ad1e6e284]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb, portal: 172.16.0.220,3260]
Aug 09 06:54:59 user nova-compute[72809]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb, portal: 172.16.0.220,3260] successful.
Aug 09 06:54:59 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eddf756-b7e6-4ea4-ad4f-0c7af989abdb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fed74b-53c7-4b5c-af3b-6da544957af7]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] <== disconnect_volume: return (371ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG nova.compute.manager [req-c8a3f5bd-c5cd-4376-a708-6c441bd21aef req-016880c7-8b80-4fdf-9c02-0785bbcb85e1 service nova] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Received event network-vif-unplugged-be2444ce-562d-44c8-9707-4908e0f8cc4a {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c8a3f5bd-c5cd-4376-a708-6c441bd21aef req-016880c7-8b80-4fdf-9c02-0785bbcb85e1 service nova] Acquiring lock "1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c8a3f5bd-c5cd-4376-a708-6c441bd21aef req-016880c7-8b80-4fdf-9c02-0785bbcb85e1 service nova] Lock "1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c8a3f5bd-c5cd-4376-a708-6c441bd21aef req-016880c7-8b80-4fdf-9c02-0785bbcb85e1 service nova] Lock "1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG nova.compute.manager [req-c8a3f5bd-c5cd-4376-a708-6c441bd21aef req-016880c7-8b80-4fdf-9c02-0785bbcb85e1 service nova] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] No waiting events found dispatching network-vif-unplugged-be2444ce-562d-44c8-9707-4908e0f8cc4a {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:54:59 user nova-compute[72809]: DEBUG nova.compute.manager [req-c8a3f5bd-c5cd-4376-a708-6c441bd21aef req-016880c7-8b80-4fdf-9c02-0785bbcb85e1 service nova] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Received event network-vif-unplugged-be2444ce-562d-44c8-9707-4908e0f8cc4a for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 06:55:00 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Instance destroyed successfully.
Aug 09 06:55:00 user nova-compute[72809]: DEBUG nova.objects.instance [None req-39379e7f-b827-4ddf-8062-b242e47433d8 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lazy-loading 'resources' on Instance uuid 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:55:00 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-39379e7f-b827-4ddf-8062-b242e47433d8 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:53:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1530198571',display_name='tempest-VolumesActionsTest-instance-1530198571',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1530198571',id=15,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:53:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7448d7b10a924d5cbd60f6276224a8cc',ramdisk_id='',reservation_id='r-yhg16q1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-812095692',owner_user_name='tempest-VolumesActionsTest-812095692-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:53:13Z,user_data=None,user_id='4f0a431477454b8aa0006b5d06cd53b2',uuid=1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be2444ce-562d-44c8-9707-4908e0f8cc4a", "address": "fa:16:3e:6b:40:c4", "network": {"id": "66bd3e40-f19b-4145-baaf-8eab9760324a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1038504284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7448d7b10a924d5cbd60f6276224a8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe2444ce-56", "ovs_interfaceid": "be2444ce-562d-44c8-9707-4908e0f8cc4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:55:00 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-39379e7f-b827-4ddf-8062-b242e47433d8 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Converting VIF {"id": "be2444ce-562d-44c8-9707-4908e0f8cc4a", "address": "fa:16:3e:6b:40:c4", "network": {"id": "66bd3e40-f19b-4145-baaf-8eab9760324a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1038504284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7448d7b10a924d5cbd60f6276224a8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe2444ce-56", "ovs_interfaceid": "be2444ce-562d-44c8-9707-4908e0f8cc4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:55:00 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-39379e7f-b827-4ddf-8062-b242e47433d8 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:40:c4,bridge_name='br-int',has_traffic_filtering=True,id=be2444ce-562d-44c8-9707-4908e0f8cc4a,network=Network(66bd3e40-f19b-4145-baaf-8eab9760324a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe2444ce-56') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:55:00 user nova-compute[72809]: DEBUG os_vif [None req-39379e7f-b827-4ddf-8062-b242e47433d8 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:40:c4,bridge_name='br-int',has_traffic_filtering=True,id=be2444ce-562d-44c8-9707-4908e0f8cc4a,network=Network(66bd3e40-f19b-4145-baaf-8eab9760324a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe2444ce-56') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:55:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe2444ce-56, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:55:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:55:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:00 user nova-compute[72809]: INFO os_vif [None req-39379e7f-b827-4ddf-8062-b242e47433d8 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:40:c4,bridge_name='br-int',has_traffic_filtering=True,id=be2444ce-562d-44c8-9707-4908e0f8cc4a,network=Network(66bd3e40-f19b-4145-baaf-8eab9760324a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe2444ce-56')
Aug 09 06:55:00 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-39379e7f-b827-4ddf-8062-b242e47433d8 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Deleting instance files /opt/stack/data/nova/instances/1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8_del
Aug 09 06:55:00 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-39379e7f-b827-4ddf-8062-b242e47433d8 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Deletion of /opt/stack/data/nova/instances/1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8_del complete
Aug 09 06:55:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:00 user nova-compute[72809]: INFO nova.compute.manager [None req-39379e7f-b827-4ddf-8062-b242e47433d8 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Took 0.75 seconds to destroy the instance on the hypervisor.
Aug 09 06:55:00 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-39379e7f-b827-4ddf-8062-b242e47433d8 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 06:55:00 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 06:55:00 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 06:55:00 user nova-compute[72809]: DEBUG nova.objects.instance [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lazy-loading 'flavor' on Instance uuid c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:55:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-29ef8f74-397c-4dd8-b18a-6e0ff0865bc2 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.216s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:00 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:55:00 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Took 0.62 seconds to deallocate network for instance.
Aug 09 06:55:00 user nova-compute[72809]: DEBUG nova.compute.manager [req-c47a79aa-f3b7-43c9-b8a4-682e2da1e0fb req-8c956f55-d9c6-4f79-8e8d-3e3086a05ca8 service nova] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Received event network-vif-deleted-be2444ce-562d-44c8-9707-4908e0f8cc4a {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:00 user nova-compute[72809]: INFO nova.compute.manager [req-c47a79aa-f3b7-43c9-b8a4-682e2da1e0fb req-8c956f55-d9c6-4f79-8e8d-3e3086a05ca8 service nova] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Neutron deleted interface be2444ce-562d-44c8-9707-4908e0f8cc4a; detaching it from the instance and deleting it from the info cache
Aug 09 06:55:00 user nova-compute[72809]: DEBUG nova.network.neutron [req-c47a79aa-f3b7-43c9-b8a4-682e2da1e0fb req-8c956f55-d9c6-4f79-8e8d-3e3086a05ca8 service nova] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:55:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-66ce3716-39e6-48e1-accb-0044e5293135 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Acquiring lock "interface-c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed-d47e67e7-9ad1-4670-9a22-a85ad34210a8" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-66ce3716-39e6-48e1-accb-0044e5293135 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lock "interface-c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed-d47e67e7-9ad1-4670-9a22-a85ad34210a8" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:00 user nova-compute[72809]: DEBUG nova.compute.manager [req-c47a79aa-f3b7-43c9-b8a4-682e2da1e0fb req-8c956f55-d9c6-4f79-8e8d-3e3086a05ca8 service nova] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Detach interface failed, port_id=be2444ce-562d-44c8-9707-4908e0f8cc4a, reason: Instance 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8 could not be found. {{(pid=72809) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 06:55:00 user nova-compute[72809]: DEBUG nova.objects.instance [None req-66ce3716-39e6-48e1-accb-0044e5293135 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lazy-loading 'flavor' on Instance uuid c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:55:00 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-66ce3716-39e6-48e1-accb-0044e5293135 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:52:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1988221204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1988221204',id=14,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPK9vq6/OkHd2yVdt3nXYH448++2AjnbM8TBYy+YeBzYamc/s5ulP19NzFTO2SUzL2nV3SSIjRSpQ5e91AAsiRiFQ7Uv2icWJyZYAAM4/eghMaXNHw3fgBL4murRC+Qesw==',key_name='tempest-keypair-387388256',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:52:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f46d46622964063ba2425358469a36f',ramdisk_id='',reservation_id='r-8bvspqp6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-722644131',owner_user_name='tempest-TaggedAttachmentsTest-722644131-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:52:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7924f8e3d85440b9e826c8c33d3f0dc',uuid=c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d47e67e7-9ad1-4670-9a22-a85ad34210a8", "address": "fa:16:3e:20:b3:43", "network": {"id": "d4350fc1-44b6-4863-9fe0-9f3f31f339ba", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1127515905", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8f46d46622964063ba2425358469a36f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd47e67e7-9a", "ovs_interfaceid": "d47e67e7-9ad1-4670-9a22-a85ad34210a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:55:00 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-66ce3716-39e6-48e1-accb-0044e5293135 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Converting VIF {"id": "d47e67e7-9ad1-4670-9a22-a85ad34210a8", "address": "fa:16:3e:20:b3:43", "network": {"id": "d4350fc1-44b6-4863-9fe0-9f3f31f339ba", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1127515905", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8f46d46622964063ba2425358469a36f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd47e67e7-9a", "ovs_interfaceid": "d47e67e7-9ad1-4670-9a22-a85ad34210a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:55:00 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-66ce3716-39e6-48e1-accb-0044e5293135 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:b3:43,bridge_name='br-int',has_traffic_filtering=True,id=d47e67e7-9ad1-4670-9a22-a85ad34210a8,network=Network(d4350fc1-44b6-4863-9fe0-9f3f31f339ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd47e67e7-9a') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:55:00 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-66ce3716-39e6-48e1-accb-0044e5293135 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:20:b3:43"/><model type="virtio"/><mtu size="1442"/><target dev="tapd47e67e7-9a"/></interface> {{(pid=72809) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 06:55:00 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-66ce3716-39e6-48e1-accb-0044e5293135 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:20:b3:43"/><model type="virtio"/><mtu size="1442"/><target dev="tapd47e67e7-9a"/></interface> {{(pid=72809) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 06:55:00 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-66ce3716-39e6-48e1-accb-0044e5293135 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Attempting to detach device tapd47e67e7-9a from instance c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed from the persistent domain config. {{(pid=72809) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 06:55:00 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-66ce3716-39e6-48e1-accb-0044e5293135 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] detach device xml: <interface type="ethernet">
Aug 09 06:55:00 user nova-compute[72809]:   <mac address="fa:16:3e:20:b3:43"/>
Aug 09 06:55:00 user nova-compute[72809]:   <model type="virtio"/>
Aug 09 06:55:00 user nova-compute[72809]:   <mtu size="1442"/>
Aug 09 06:55:00 user nova-compute[72809]:   <target dev="tapd47e67e7-9a"/>
Aug 09 06:55:00 user nova-compute[72809]: </interface>
Aug 09 06:55:00 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 06:55:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-39379e7f-b827-4ddf-8062-b242e47433d8 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-39379e7f-b827-4ddf-8062-b242e47433d8 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:00 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-66ce3716-39e6-48e1-accb-0044e5293135 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:20:b3:43"/><model type="virtio"/><mtu size="1442"/><target dev="tapd47e67e7-9a"/></interface> {{(pid=72809) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 06:55:00 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-66ce3716-39e6-48e1-accb-0044e5293135 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:20:b3:43"/><model type="virtio"/><mtu size="1442"/><target dev="tapd47e67e7-9a"/></interface>not found in domain: <domain type='kvm' id='16'>
Aug 09 06:55:00 user nova-compute[72809]:   <name>instance-0000000e</name>
Aug 09 06:55:00 user nova-compute[72809]:   <uuid>c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed</uuid>
Aug 09 06:55:00 user nova-compute[72809]:   <metadata>
Aug 09 06:55:00 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:55:00 user nova-compute[72809]:   <nova:package version="0.0.0"/>
Aug 09 06:55:00 user nova-compute[72809]:   <nova:name>tempest-device-tagging-server-1988221204</nova:name>
Aug 09 06:55:00 user nova-compute[72809]:   <nova:creationTime>2023-08-09 06:54:44</nova:creationTime>
Aug 09 06:55:00 user nova-compute[72809]:   <nova:flavor name="m1.tiny">
Aug 09 06:55:00 user nova-compute[72809]:     <nova:memory>512</nova:memory>
Aug 09 06:55:00 user nova-compute[72809]:     <nova:disk>1</nova:disk>
Aug 09 06:55:00 user nova-compute[72809]:     <nova:swap>0</nova:swap>
Aug 09 06:55:00 user nova-compute[72809]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:55:00 user nova-compute[72809]:     <nova:vcpus>1</nova:vcpus>
Aug 09 06:55:00 user nova-compute[72809]:   </nova:flavor>
Aug 09 06:55:00 user nova-compute[72809]:   <nova:owner>
Aug 09 06:55:00 user nova-compute[72809]:     <nova:user uuid="c7924f8e3d85440b9e826c8c33d3f0dc">tempest-TaggedAttachmentsTest-722644131-project-member</nova:user>
Aug 09 06:55:00 user nova-compute[72809]:     <nova:project uuid="8f46d46622964063ba2425358469a36f">tempest-TaggedAttachmentsTest-722644131</nova:project>
Aug 09 06:55:00 user nova-compute[72809]:   </nova:owner>
Aug 09 06:55:00 user nova-compute[72809]:   <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:55:00 user nova-compute[72809]:   <nova:ports>
Aug 09 06:55:00 user nova-compute[72809]:     <nova:port uuid="947db6ff-ed42-4aca-a543-a929517ae8e4">
Aug 09 06:55:00 user nova-compute[72809]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 06:55:00 user nova-compute[72809]:     </nova:port>
Aug 09 06:55:00 user nova-compute[72809]:     <nova:port uuid="d47e67e7-9ad1-4670-9a22-a85ad34210a8">
Aug 09 06:55:00 user nova-compute[72809]:       <nova:ip type="fixed" address="10.10.10.164" ipVersion="4"/>
Aug 09 06:55:00 user nova-compute[72809]:     </nova:port>
Aug 09 06:55:00 user nova-compute[72809]:   </nova:ports>
Aug 09 06:55:00 user nova-compute[72809]: </nova:instance>
Aug 09 06:55:00 user nova-compute[72809]:   </metadata>
Aug 09 06:55:00 user nova-compute[72809]:   <memory unit='KiB'>524288</memory>
Aug 09 06:55:00 user nova-compute[72809]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 09 06:55:00 user nova-compute[72809]:   <vcpu placement='static'>1</vcpu>
Aug 09 06:55:00 user nova-compute[72809]:   <resource>
Aug 09 06:55:00 user nova-compute[72809]:     <partition>/machine</partition>
Aug 09 06:55:00 user nova-compute[72809]:   </resource>
Aug 09 06:55:00 user nova-compute[72809]:   <sysinfo type='smbios'>
Aug 09 06:55:00 user nova-compute[72809]:     <system>
Aug 09 06:55:00 user nova-compute[72809]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 09 06:55:00 user nova-compute[72809]:       <entry name='product'>OpenStack Nova</entry>
Aug 09 06:55:00 user nova-compute[72809]:       <entry name='version'>0.0.0</entry>
Aug 09 06:55:00 user nova-compute[72809]:       <entry name='serial'>c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed</entry>
Aug 09 06:55:00 user nova-compute[72809]:       <entry name='uuid'>c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed</entry>
Aug 09 06:55:00 user nova-compute[72809]:       <entry name='family'>Virtual Machine</entry>
Aug 09 06:55:00 user nova-compute[72809]:     </system>
Aug 09 06:55:00 user nova-compute[72809]:   </sysinfo>
Aug 09 06:55:00 user nova-compute[72809]:   <os>
Aug 09 06:55:00 user nova-compute[72809]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 09 06:55:00 user nova-compute[72809]:     <boot dev='hd'/>
Aug 09 06:55:00 user nova-compute[72809]:     <smbios mode='sysinfo'/>
Aug 09 06:55:00 user nova-compute[72809]:   </os>
Aug 09 06:55:00 user nova-compute[72809]:   <features>
Aug 09 06:55:00 user nova-compute[72809]:     <acpi/>
Aug 09 06:55:00 user nova-compute[72809]:     <apic/>
Aug 09 06:55:00 user nova-compute[72809]:     <vmcoreinfo state='on'/>
Aug 09 06:55:00 user nova-compute[72809]:   </features>
Aug 09 06:55:00 user nova-compute[72809]:   <cpu mode='custom' match='exact' check='full'>
Aug 09 06:55:00 user nova-compute[72809]:     <model fallback='forbid'>Nehalem</model>
Aug 09 06:55:00 user nova-compute[72809]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 09 06:55:00 user nova-compute[72809]:     <feature policy='require' name='vme'/>
Aug 09 06:55:00 user nova-compute[72809]:     <feature policy='require' name='x2apic'/>
Aug 09 06:55:00 user nova-compute[72809]:     <feature policy='require' name='hypervisor'/>
Aug 09 06:55:00 user nova-compute[72809]:   </cpu>
Aug 09 06:55:00 user nova-compute[72809]:   <clock offset='utc'>
Aug 09 06:55:00 user nova-compute[72809]:     <timer name='pit' tickpolicy='delay'/>
Aug 09 06:55:00 user nova-compute[72809]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 09 06:55:00 user nova-compute[72809]:     <timer name='hpet' present='no'/>
Aug 09 06:55:00 user nova-compute[72809]:   </clock>
Aug 09 06:55:00 user nova-compute[72809]:   <on_poweroff>destroy</on_poweroff>
Aug 09 06:55:00 user nova-compute[72809]:   <on_reboot>restart</on_reboot>
Aug 09 06:55:00 user nova-compute[72809]:   <on_crash>destroy</on_crash>
Aug 09 06:55:00 user nova-compute[72809]:   <devices>
Aug 09 06:55:00 user nova-compute[72809]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 06:55:00 user nova-compute[72809]:     <disk type='file' device='disk'>
Aug 09 06:55:00 user nova-compute[72809]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 09 06:55:00 user nova-compute[72809]:       <source file='/opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/disk' index='2'/>
Aug 09 06:55:00 user nova-compute[72809]:       <backingStore type='file' index='3'>
Aug 09 06:55:00 user nova-compute[72809]:         <format type='raw'/>
Aug 09 06:55:00 user nova-compute[72809]:         <source file='/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8'/>
Aug 09 06:55:00 user nova-compute[72809]:         <backingStore/>
Aug 09 06:55:00 user nova-compute[72809]:       </backingStore>
Aug 09 06:55:00 user nova-compute[72809]:       <target dev='vda' bus='virtio'/>
Aug 09 06:55:00 user nova-compute[72809]:       <alias name='virtio-disk0'/>
Aug 09 06:55:00 user nova-compute[72809]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 09 06:55:00 user nova-compute[72809]:     </disk>
Aug 09 06:55:00 user nova-compute[72809]:     <disk type='file' device='cdrom'>
Aug 09 06:55:00 user nova-compute[72809]:       <driver name='qemu' type='raw' cache='none'/>
Aug 09 06:55:00 user nova-compute[72809]:       <source file='/opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/disk.config' index='1'/>
Aug 09 06:55:00 user nova-compute[72809]:       <backingStore/>
Aug 09 06:55:00 user nova-compute[72809]:       <target dev='hda' bus='ide'/>
Aug 09 06:55:00 user nova-compute[72809]:       <readonly/>
Aug 09 06:55:00 user nova-compute[72809]:       <alias name='ide0-0-0'/>
Aug 09 06:55:00 user nova-compute[72809]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 09 06:55:00 user nova-compute[72809]:     </disk>
Aug 09 06:55:00 user nova-compute[72809]:     <controller type='usb' index='0' model='none'>
Aug 09 06:55:00 user nova-compute[72809]:       <alias name='usb'/>
Aug 09 06:55:00 user nova-compute[72809]:     </controller>
Aug 09 06:55:00 user nova-compute[72809]:     <controller type='pci' index='0' model='pci-root'>
Aug 09 06:55:00 user nova-compute[72809]:       <alias name='pci.0'/>
Aug 09 06:55:00 user nova-compute[72809]:     </controller>
Aug 09 06:55:00 user nova-compute[72809]:     <controller type='ide' index='0'>
Aug 09 06:55:00 user nova-compute[72809]:       <alias name='ide'/>
Aug 09 06:55:00 user nova-compute[72809]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 09 06:55:00 user nova-compute[72809]:     </controller>
Aug 09 06:55:00 user nova-compute[72809]:     <interface type='ethernet'>
Aug 09 06:55:00 user nova-compute[72809]:       <mac address='fa:16:3e:5d:13:2e'/>
Aug 09 06:55:00 user nova-compute[72809]:       <target dev='tap947db6ff-ed'/>
Aug 09 06:55:00 user nova-compute[72809]:       <model type='virtio'/>
Aug 09 06:55:00 user nova-compute[72809]:       <mtu size='1442'/>
Aug 09 06:55:00 user nova-compute[72809]:       <alias name='net0'/>
Aug 09 06:55:00 user nova-compute[72809]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 09 06:55:00 user nova-compute[72809]:     </interface>
Aug 09 06:55:00 user nova-compute[72809]:     <interface type='ethernet'>
Aug 09 06:55:00 user nova-compute[72809]:       <mac address='fa:16:3e:20:b3:43'/>
Aug 09 06:55:00 user nova-compute[72809]:       <target dev='tapd47e67e7-9a'/>
Aug 09 06:55:00 user nova-compute[72809]:       <model type='virtio'/>
Aug 09 06:55:00 user nova-compute[72809]:       <mtu size='1442'/>
Aug 09 06:55:00 user nova-compute[72809]:       <alias name='net1'/>
Aug 09 06:55:00 user nova-compute[72809]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 09 06:55:00 user nova-compute[72809]:     </interface>
Aug 09 06:55:00 user nova-compute[72809]:     <serial type='pty'>
Aug 09 06:55:00 user nova-compute[72809]:       <source path='/dev/pts/5'/>
Aug 09 06:55:00 user nova-compute[72809]:       <log file='/opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/console.log' append='off'/>
Aug 09 06:55:00 user nova-compute[72809]:       <target type='isa-serial' port='0'>
Aug 09 06:55:00 user nova-compute[72809]:         <model name='isa-serial'/>
Aug 09 06:55:00 user nova-compute[72809]:       </target>
Aug 09 06:55:00 user nova-compute[72809]:       <alias name='serial0'/>
Aug 09 06:55:00 user nova-compute[72809]:     </serial>
Aug 09 06:55:00 user nova-compute[72809]:     <console type='pty' tty='/dev/pts/5'>
Aug 09 06:55:00 user nova-compute[72809]:       <source path='/dev/pts/5'/>
Aug 09 06:55:00 user nova-compute[72809]:       <log file='/opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/console.log' append='off'/>
Aug 09 06:55:00 user nova-compute[72809]:       <target type='serial' port='0'/>
Aug 09 06:55:00 user nova-compute[72809]:       <alias name='serial0'/>
Aug 09 06:55:00 user nova-compute[72809]:     </console>
Aug 09 06:55:00 user nova-compute[72809]:     <input type='mouse' bus='ps2'>
Aug 09 06:55:00 user nova-compute[72809]:       <alias name='input0'/>
Aug 09 06:55:00 user nova-compute[72809]:     </input>
Aug 09 06:55:00 user nova-compute[72809]:     <input type='keyboard' bus='ps2'>
Aug 09 06:55:00 user nova-compute[72809]:       <alias name='input1'/>
Aug 09 06:55:00 user nova-compute[72809]:     </input>
Aug 09 06:55:00 user nova-compute[72809]:     <graphics type='vnc' port='5902' autoport='yes' listen='0.0.0.0'>
Aug 09 06:55:00 user nova-compute[72809]:       <listen type='address' address='0.0.0.0'/>
Aug 09 06:55:00 user nova-compute[72809]:     </graphics>
Aug 09 06:55:00 user nova-compute[72809]:     <audio id='1' type='none'/>
Aug 09 06:55:00 user nova-compute[72809]:     <video>
Aug 09 06:55:00 user nova-compute[72809]:       <model type='virtio' heads='1' primary='yes'/>
Aug 09 06:55:00 user nova-compute[72809]:       <alias name='video0'/>
Aug 09 06:55:00 user nova-compute[72809]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 09 06:55:00 user nova-compute[72809]:     </video>
Aug 09 06:55:00 user nova-compute[72809]:     <memballoon model='virtio'>
Aug 09 06:55:00 user nova-compute[72809]:       <stats period='10'/>
Aug 09 06:55:00 user nova-compute[72809]:       <alias name='balloon0'/>
Aug 09 06:55:00 user nova-compute[72809]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 09 06:55:00 user nova-compute[72809]:     </memballoon>
Aug 09 06:55:00 user nova-compute[72809]:     <rng model='virtio'>
Aug 09 06:55:00 user nova-compute[72809]:       <backend model='random'>/dev/urandom</backend>
Aug 09 06:55:00 user nova-compute[72809]:       <alias name='rng0'/>
Aug 09 06:55:00 user nova-compute[72809]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 09 06:55:00 user nova-compute[72809]:     </rng>
Aug 09 06:55:00 user nova-compute[72809]:   </devices>
Aug 09 06:55:00 user nova-compute[72809]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 09 06:55:00 user nova-compute[72809]:     <label>libvirt-c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed</label>
Aug 09 06:55:00 user nova-compute[72809]:     <imagelabel>libvirt-c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed</imagelabel>
Aug 09 06:55:00 user nova-compute[72809]:   </seclabel>
Aug 09 06:55:00 user nova-compute[72809]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 09 06:55:00 user nova-compute[72809]:     <label>+64055:+108</label>
Aug 09 06:55:00 user nova-compute[72809]:     <imagelabel>+64055:+108</imagelabel>
Aug 09 06:55:00 user nova-compute[72809]:   </seclabel>
Aug 09 06:55:00 user nova-compute[72809]: </domain>
Aug 09 06:55:00 user nova-compute[72809]:  {{(pid=72809) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 09 06:55:00 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-66ce3716-39e6-48e1-accb-0044e5293135 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Successfully detached device tapd47e67e7-9a from instance c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed from the persistent domain config.
Aug 09 06:55:00 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-66ce3716-39e6-48e1-accb-0044e5293135 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] (1/8): Attempting to detach device tapd47e67e7-9a with device alias net1 from instance c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed from the live domain config. {{(pid=72809) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 06:55:00 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-66ce3716-39e6-48e1-accb-0044e5293135 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] detach device xml: <interface type="ethernet">
Aug 09 06:55:00 user nova-compute[72809]:   <mac address="fa:16:3e:20:b3:43"/>
Aug 09 06:55:00 user nova-compute[72809]:   <model type="virtio"/>
Aug 09 06:55:00 user nova-compute[72809]:   <mtu size="1442"/>
Aug 09 06:55:00 user nova-compute[72809]:   <target dev="tapd47e67e7-9a"/>
Aug 09 06:55:00 user nova-compute[72809]: </interface>
Aug 09 06:55:00 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 06:55:00 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-39379e7f-b827-4ddf-8062-b242e47433d8 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Refreshing inventories for resource provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 06:55:00 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-39379e7f-b827-4ddf-8062-b242e47433d8 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Updating ProviderTree inventory for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 06:55:00 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-39379e7f-b827-4ddf-8062-b242e47433d8 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Updating inventory in ProviderTree for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-39379e7f-b827-4ddf-8062-b242e47433d8 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Refreshing aggregate associations for resource provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3, aggregates: None {{(pid=72809) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-39379e7f-b827-4ddf-8062-b242e47433d8 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Refreshing trait associations for resource provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI {{(pid=72809) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Acquiring lock "3640991e-8a5b-4674-af81-3117d4269a68" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "3640991e-8a5b-4674-af81-3117d4269a68" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:01 user nova-compute[72809]: INFO nova.compute.manager [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Detaching volume d187a33a-16e4-421a-890e-be960e85387d
Aug 09 06:55:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Received event <DeviceRemovedEvent: 1691564101.2034311, c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72809) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-66ce3716-39e6-48e1-accb-0044e5293135 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Start waiting for the detach event from libvirt for device tapd47e67e7-9a with device alias net1 for instance c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed {{(pid=72809) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-66ce3716-39e6-48e1-accb-0044e5293135 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:20:b3:43"/><model type="virtio"/><mtu size="1442"/><target dev="tapd47e67e7-9a"/></interface> {{(pid=72809) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 06:55:01 user nova-compute[72809]: INFO nova.virt.block_device [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Attempting to driver detach volume d187a33a-16e4-421a-890e-be960e85387d from mountpoint /dev/vdb
Aug 09 06:55:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-66ce3716-39e6-48e1-accb-0044e5293135 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:20:b3:43"/><model type="virtio"/><mtu size="1442"/><target dev="tapd47e67e7-9a"/></interface>not found in domain: <domain type='kvm' id='16'>
Aug 09 06:55:01 user nova-compute[72809]:   <name>instance-0000000e</name>
Aug 09 06:55:01 user nova-compute[72809]:   <uuid>c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed</uuid>
Aug 09 06:55:01 user nova-compute[72809]:   <metadata>
Aug 09 06:55:01 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:55:01 user nova-compute[72809]:   <nova:package version="0.0.0"/>
Aug 09 06:55:01 user nova-compute[72809]:   <nova:name>tempest-device-tagging-server-1988221204</nova:name>
Aug 09 06:55:01 user nova-compute[72809]:   <nova:creationTime>2023-08-09 06:54:44</nova:creationTime>
Aug 09 06:55:01 user nova-compute[72809]:   <nova:flavor name="m1.tiny">
Aug 09 06:55:01 user nova-compute[72809]:     <nova:memory>512</nova:memory>
Aug 09 06:55:01 user nova-compute[72809]:     <nova:disk>1</nova:disk>
Aug 09 06:55:01 user nova-compute[72809]:     <nova:swap>0</nova:swap>
Aug 09 06:55:01 user nova-compute[72809]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:55:01 user nova-compute[72809]:     <nova:vcpus>1</nova:vcpus>
Aug 09 06:55:01 user nova-compute[72809]:   </nova:flavor>
Aug 09 06:55:01 user nova-compute[72809]:   <nova:owner>
Aug 09 06:55:01 user nova-compute[72809]:     <nova:user uuid="c7924f8e3d85440b9e826c8c33d3f0dc">tempest-TaggedAttachmentsTest-722644131-project-member</nova:user>
Aug 09 06:55:01 user nova-compute[72809]:     <nova:project uuid="8f46d46622964063ba2425358469a36f">tempest-TaggedAttachmentsTest-722644131</nova:project>
Aug 09 06:55:01 user nova-compute[72809]:   </nova:owner>
Aug 09 06:55:01 user nova-compute[72809]:   <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:55:01 user nova-compute[72809]:   <nova:ports>
Aug 09 06:55:01 user nova-compute[72809]:     <nova:port uuid="947db6ff-ed42-4aca-a543-a929517ae8e4">
Aug 09 06:55:01 user nova-compute[72809]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 06:55:01 user nova-compute[72809]:     </nova:port>
Aug 09 06:55:01 user nova-compute[72809]:     <nova:port uuid="d47e67e7-9ad1-4670-9a22-a85ad34210a8">
Aug 09 06:55:01 user nova-compute[72809]:       <nova:ip type="fixed" address="10.10.10.164" ipVersion="4"/>
Aug 09 06:55:01 user nova-compute[72809]:     </nova:port>
Aug 09 06:55:01 user nova-compute[72809]:   </nova:ports>
Aug 09 06:55:01 user nova-compute[72809]: </nova:instance>
Aug 09 06:55:01 user nova-compute[72809]:   </metadata>
Aug 09 06:55:01 user nova-compute[72809]:   <memory unit='KiB'>524288</memory>
Aug 09 06:55:01 user nova-compute[72809]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 09 06:55:01 user nova-compute[72809]:   <vcpu placement='static'>1</vcpu>
Aug 09 06:55:01 user nova-compute[72809]:   <resource>
Aug 09 06:55:01 user nova-compute[72809]:     <partition>/machine</partition>
Aug 09 06:55:01 user nova-compute[72809]:   </resource>
Aug 09 06:55:01 user nova-compute[72809]:   <sysinfo type='smbios'>
Aug 09 06:55:01 user nova-compute[72809]:     <system>
Aug 09 06:55:01 user nova-compute[72809]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 09 06:55:01 user nova-compute[72809]:       <entry name='product'>OpenStack Nova</entry>
Aug 09 06:55:01 user nova-compute[72809]:       <entry name='version'>0.0.0</entry>
Aug 09 06:55:01 user nova-compute[72809]:       <entry name='serial'>c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed</entry>
Aug 09 06:55:01 user nova-compute[72809]:       <entry name='uuid'>c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed</entry>
Aug 09 06:55:01 user nova-compute[72809]:       <entry name='family'>Virtual Machine</entry>
Aug 09 06:55:01 user nova-compute[72809]:     </system>
Aug 09 06:55:01 user nova-compute[72809]:   </sysinfo>
Aug 09 06:55:01 user nova-compute[72809]:   <os>
Aug 09 06:55:01 user nova-compute[72809]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 09 06:55:01 user nova-compute[72809]:     <boot dev='hd'/>
Aug 09 06:55:01 user nova-compute[72809]:     <smbios mode='sysinfo'/>
Aug 09 06:55:01 user nova-compute[72809]:   </os>
Aug 09 06:55:01 user nova-compute[72809]:   <features>
Aug 09 06:55:01 user nova-compute[72809]:     <acpi/>
Aug 09 06:55:01 user nova-compute[72809]:     <apic/>
Aug 09 06:55:01 user nova-compute[72809]:     <vmcoreinfo state='on'/>
Aug 09 06:55:01 user nova-compute[72809]:   </features>
Aug 09 06:55:01 user nova-compute[72809]:   <cpu mode='custom' match='exact' check='full'>
Aug 09 06:55:01 user nova-compute[72809]:     <model fallback='forbid'>Nehalem</model>
Aug 09 06:55:01 user nova-compute[72809]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 09 06:55:01 user nova-compute[72809]:     <feature policy='require' name='vme'/>
Aug 09 06:55:01 user nova-compute[72809]:     <feature policy='require' name='x2apic'/>
Aug 09 06:55:01 user nova-compute[72809]:     <feature policy='require' name='hypervisor'/>
Aug 09 06:55:01 user nova-compute[72809]:   </cpu>
Aug 09 06:55:01 user nova-compute[72809]:   <clock offset='utc'>
Aug 09 06:55:01 user nova-compute[72809]:     <timer name='pit' tickpolicy='delay'/>
Aug 09 06:55:01 user nova-compute[72809]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 09 06:55:01 user nova-compute[72809]:     <timer name='hpet' present='no'/>
Aug 09 06:55:01 user nova-compute[72809]:   </clock>
Aug 09 06:55:01 user nova-compute[72809]:   <on_poweroff>destroy</on_poweroff>
Aug 09 06:55:01 user nova-compute[72809]:   <on_reboot>restart</on_reboot>
Aug 09 06:55:01 user nova-compute[72809]:   <on_crash>destroy</on_crash>
Aug 09 06:55:01 user nova-compute[72809]:   <devices>
Aug 09 06:55:01 user nova-compute[72809]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 06:55:01 user nova-compute[72809]:     <disk type='file' device='disk'>
Aug 09 06:55:01 user nova-compute[72809]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 09 06:55:01 user nova-compute[72809]:       <source file='/opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/disk' index='2'/>
Aug 09 06:55:01 user nova-compute[72809]:       <backingStore type='file' index='3'>
Aug 09 06:55:01 user nova-compute[72809]:         <format type='raw'/>
Aug 09 06:55:01 user nova-compute[72809]:         <source file='/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8'/>
Aug 09 06:55:01 user nova-compute[72809]:         <backingStore/>
Aug 09 06:55:01 user nova-compute[72809]:       </backingStore>
Aug 09 06:55:01 user nova-compute[72809]:       <target dev='vda' bus='virtio'/>
Aug 09 06:55:01 user nova-compute[72809]:       <alias name='virtio-disk0'/>
Aug 09 06:55:01 user nova-compute[72809]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 09 06:55:01 user nova-compute[72809]:     </disk>
Aug 09 06:55:01 user nova-compute[72809]:     <disk type='file' device='cdrom'>
Aug 09 06:55:01 user nova-compute[72809]:       <driver name='qemu' type='raw' cache='none'/>
Aug 09 06:55:01 user nova-compute[72809]:       <source file='/opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/disk.config' index='1'/>
Aug 09 06:55:01 user nova-compute[72809]:       <backingStore/>
Aug 09 06:55:01 user nova-compute[72809]:       <target dev='hda' bus='ide'/>
Aug 09 06:55:01 user nova-compute[72809]:       <readonly/>
Aug 09 06:55:01 user nova-compute[72809]:       <alias name='ide0-0-0'/>
Aug 09 06:55:01 user nova-compute[72809]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 09 06:55:01 user nova-compute[72809]:     </disk>
Aug 09 06:55:01 user nova-compute[72809]:     <controller type='usb' index='0' model='none'>
Aug 09 06:55:01 user nova-compute[72809]:       <alias name='usb'/>
Aug 09 06:55:01 user nova-compute[72809]:     </controller>
Aug 09 06:55:01 user nova-compute[72809]:     <controller type='pci' index='0' model='pci-root'>
Aug 09 06:55:01 user nova-compute[72809]:       <alias name='pci.0'/>
Aug 09 06:55:01 user nova-compute[72809]:     </controller>
Aug 09 06:55:01 user nova-compute[72809]:     <controller type='ide' index='0'>
Aug 09 06:55:01 user nova-compute[72809]:       <alias name='ide'/>
Aug 09 06:55:01 user nova-compute[72809]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 09 06:55:01 user nova-compute[72809]:     </controller>
Aug 09 06:55:01 user nova-compute[72809]:     <interface type='ethernet'>
Aug 09 06:55:01 user nova-compute[72809]:       <mac address='fa:16:3e:5d:13:2e'/>
Aug 09 06:55:01 user nova-compute[72809]:       <target dev='tap947db6ff-ed'/>
Aug 09 06:55:01 user nova-compute[72809]:       <model type='virtio'/>
Aug 09 06:55:01 user nova-compute[72809]:       <mtu size='1442'/>
Aug 09 06:55:01 user nova-compute[72809]:       <alias name='net0'/>
Aug 09 06:55:01 user nova-compute[72809]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 09 06:55:01 user nova-compute[72809]:     </interface>
Aug 09 06:55:01 user nova-compute[72809]:     <serial type='pty'>
Aug 09 06:55:01 user nova-compute[72809]:       <source path='/dev/pts/5'/>
Aug 09 06:55:01 user nova-compute[72809]:       <log file='/opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/console.log' append='off'/>
Aug 09 06:55:01 user nova-compute[72809]:       <target type='isa-serial' port='0'>
Aug 09 06:55:01 user nova-compute[72809]:         <model name='isa-serial'/>
Aug 09 06:55:01 user nova-compute[72809]:       </target>
Aug 09 06:55:01 user nova-compute[72809]:       <alias name='serial0'/>
Aug 09 06:55:01 user nova-compute[72809]:     </serial>
Aug 09 06:55:01 user nova-compute[72809]:     <console type='pty' tty='/dev/pts/5'>
Aug 09 06:55:01 user nova-compute[72809]:       <source path='/dev/pts/5'/>
Aug 09 06:55:01 user nova-compute[72809]:       <log file='/opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/console.log' append='off'/>
Aug 09 06:55:01 user nova-compute[72809]:       <target type='serial' port='0'/>
Aug 09 06:55:01 user nova-compute[72809]:       <alias name='serial0'/>
Aug 09 06:55:01 user nova-compute[72809]:     </console>
Aug 09 06:55:01 user nova-compute[72809]:     <input type='mouse' bus='ps2'>
Aug 09 06:55:01 user nova-compute[72809]:       <alias name='input0'/>
Aug 09 06:55:01 user nova-compute[72809]:     </input>
Aug 09 06:55:01 user nova-compute[72809]:     <input type='keyboard' bus='ps2'>
Aug 09 06:55:01 user nova-compute[72809]:       <alias name='input1'/>
Aug 09 06:55:01 user nova-compute[72809]:     </input>
Aug 09 06:55:01 user nova-compute[72809]:     <graphics type='vnc' port='5902' autoport='yes' listen='0.0.0.0'>
Aug 09 06:55:01 user nova-compute[72809]:       <listen type='address' address='0.0.0.0'/>
Aug 09 06:55:01 user nova-compute[72809]:     </graphics>
Aug 09 06:55:01 user nova-compute[72809]:     <audio id='1' type='none'/>
Aug 09 06:55:01 user nova-compute[72809]:     <video>
Aug 09 06:55:01 user nova-compute[72809]:       <model type='virtio' heads='1' primary='yes'/>
Aug 09 06:55:01 user nova-compute[72809]:       <alias name='video0'/>
Aug 09 06:55:01 user nova-compute[72809]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 09 06:55:01 user nova-compute[72809]:     </video>
Aug 09 06:55:01 user nova-compute[72809]:     <memballoon model='virtio'>
Aug 09 06:55:01 user nova-compute[72809]:       <stats period='10'/>
Aug 09 06:55:01 user nova-compute[72809]:       <alias name='balloon0'/>
Aug 09 06:55:01 user nova-compute[72809]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 09 06:55:01 user nova-compute[72809]:     </memballoon>
Aug 09 06:55:01 user nova-compute[72809]:     <rng model='virtio'>
Aug 09 06:55:01 user nova-compute[72809]:       <backend model='random'>/dev/urandom</backend>
Aug 09 06:55:01 user nova-compute[72809]:       <alias name='rng0'/>
Aug 09 06:55:01 user nova-compute[72809]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 09 06:55:01 user nova-compute[72809]:     </rng>
Aug 09 06:55:01 user nova-compute[72809]:   </devices>
Aug 09 06:55:01 user nova-compute[72809]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 09 06:55:01 user nova-compute[72809]:     <label>libvirt-c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed</label>
Aug 09 06:55:01 user nova-compute[72809]:     <imagelabel>libvirt-c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed</imagelabel>
Aug 09 06:55:01 user nova-compute[72809]:   </seclabel>
Aug 09 06:55:01 user nova-compute[72809]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 09 06:55:01 user nova-compute[72809]:     <label>+64055:+108</label>
Aug 09 06:55:01 user nova-compute[72809]:     <imagelabel>+64055:+108</imagelabel>
Aug 09 06:55:01 user nova-compute[72809]:   </seclabel>
Aug 09 06:55:01 user nova-compute[72809]: </domain>
Aug 09 06:55:01 user nova-compute[72809]:  {{(pid=72809) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 09 06:55:01 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-66ce3716-39e6-48e1-accb-0044e5293135 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Successfully detached device tapd47e67e7-9a from instance c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed from the live domain config.
Aug 09 06:55:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-66ce3716-39e6-48e1-accb-0044e5293135 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:52:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1988221204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1988221204',id=14,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPK9vq6/OkHd2yVdt3nXYH448++2AjnbM8TBYy+YeBzYamc/s5ulP19NzFTO2SUzL2nV3SSIjRSpQ5e91AAsiRiFQ7Uv2icWJyZYAAM4/eghMaXNHw3fgBL4murRC+Qesw==',key_name='tempest-keypair-387388256',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:52:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f46d46622964063ba2425358469a36f',ramdisk_id='',reservation_id='r-8bvspqp6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-722644131',owner_user_name='tempest-TaggedAttachmentsTest-722644131-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:52:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7924f8e3d85440b9e826c8c33d3f0dc',uuid=c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d47e67e7-9ad1-4670-9a22-a85ad34210a8", "address": "fa:16:3e:20:b3:43", "network": {"id": "d4350fc1-44b6-4863-9fe0-9f3f31f339ba", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1127515905", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8f46d46622964063ba2425358469a36f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd47e67e7-9a", "ovs_interfaceid": "d47e67e7-9ad1-4670-9a22-a85ad34210a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-66ce3716-39e6-48e1-accb-0044e5293135 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Converting VIF {"id": "d47e67e7-9ad1-4670-9a22-a85ad34210a8", "address": "fa:16:3e:20:b3:43", "network": {"id": "d4350fc1-44b6-4863-9fe0-9f3f31f339ba", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1127515905", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8f46d46622964063ba2425358469a36f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd47e67e7-9a", "ovs_interfaceid": "d47e67e7-9ad1-4670-9a22-a85ad34210a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-66ce3716-39e6-48e1-accb-0044e5293135 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:b3:43,bridge_name='br-int',has_traffic_filtering=True,id=d47e67e7-9ad1-4670-9a22-a85ad34210a8,network=Network(d4350fc1-44b6-4863-9fe0-9f3f31f339ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd47e67e7-9a') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG os_vif [None req-66ce3716-39e6-48e1-accb-0044e5293135 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:b3:43,bridge_name='br-int',has_traffic_filtering=True,id=d47e67e7-9ad1-4670-9a22-a85ad34210a8,network=Network(d4350fc1-44b6-4863-9fe0-9f3f31f339ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd47e67e7-9a') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd47e67e7-9a, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Attempting to detach device vdb from instance 3640991e-8a5b-4674-af81-3117d4269a68 from the persistent domain config. {{(pid=72809) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 06:55:01 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:55:01 user nova-compute[72809]:   <source dev="/dev/sdb"/>
Aug 09 06:55:01 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 06:55:01 user nova-compute[72809]:   <serial>d187a33a-16e4-421a-890e-be960e85387d</serial>
Aug 09 06:55:01 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 06:55:01 user nova-compute[72809]: </disk>
Aug 09 06:55:01 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:01 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Successfully detached device vdb from instance 3640991e-8a5b-4674-af81-3117d4269a68 from the persistent domain config.
Aug 09 06:55:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3640991e-8a5b-4674-af81-3117d4269a68 from the live domain config. {{(pid=72809) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 06:55:01 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:55:01 user nova-compute[72809]:   <source dev="/dev/sdb"/>
Aug 09 06:55:01 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 06:55:01 user nova-compute[72809]:   <serial>d187a33a-16e4-421a-890e-be960e85387d</serial>
Aug 09 06:55:01 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 06:55:01 user nova-compute[72809]: </disk>
Aug 09 06:55:01 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 06:55:01 user nova-compute[72809]: INFO os_vif [None req-66ce3716-39e6-48e1-accb-0044e5293135 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:b3:43,bridge_name='br-int',has_traffic_filtering=True,id=d47e67e7-9ad1-4670-9a22-a85ad34210a8,network=Network(d4350fc1-44b6-4863-9fe0-9f3f31f339ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd47e67e7-9a')
Aug 09 06:55:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-66ce3716-39e6-48e1-accb-0044e5293135 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:55:01 user nova-compute[72809]:   <nova:package version="0.0.0"/>
Aug 09 06:55:01 user nova-compute[72809]:   <nova:name>tempest-device-tagging-server-1988221204</nova:name>
Aug 09 06:55:01 user nova-compute[72809]:   <nova:creationTime>2023-08-09 06:55:01</nova:creationTime>
Aug 09 06:55:01 user nova-compute[72809]:   <nova:flavor name="m1.tiny">
Aug 09 06:55:01 user nova-compute[72809]:     <nova:memory>512</nova:memory>
Aug 09 06:55:01 user nova-compute[72809]:     <nova:disk>1</nova:disk>
Aug 09 06:55:01 user nova-compute[72809]:     <nova:swap>0</nova:swap>
Aug 09 06:55:01 user nova-compute[72809]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:55:01 user nova-compute[72809]:     <nova:vcpus>1</nova:vcpus>
Aug 09 06:55:01 user nova-compute[72809]:   </nova:flavor>
Aug 09 06:55:01 user nova-compute[72809]:   <nova:owner>
Aug 09 06:55:01 user nova-compute[72809]:     <nova:user uuid="c7924f8e3d85440b9e826c8c33d3f0dc">tempest-TaggedAttachmentsTest-722644131-project-member</nova:user>
Aug 09 06:55:01 user nova-compute[72809]:     <nova:project uuid="8f46d46622964063ba2425358469a36f">tempest-TaggedAttachmentsTest-722644131</nova:project>
Aug 09 06:55:01 user nova-compute[72809]:   </nova:owner>
Aug 09 06:55:01 user nova-compute[72809]:   <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:55:01 user nova-compute[72809]:   <nova:ports>
Aug 09 06:55:01 user nova-compute[72809]:     <nova:port uuid="947db6ff-ed42-4aca-a543-a929517ae8e4">
Aug 09 06:55:01 user nova-compute[72809]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 06:55:01 user nova-compute[72809]:     </nova:port>
Aug 09 06:55:01 user nova-compute[72809]:   </nova:ports>
Aug 09 06:55:01 user nova-compute[72809]: </nova:instance>
Aug 09 06:55:01 user nova-compute[72809]:  {{(pid=72809) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-39379e7f-b827-4ddf-8062-b242e47433d8 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-39379e7f-b827-4ddf-8062-b242e47433d8 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-39379e7f-b827-4ddf-8062-b242e47433d8 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.565s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:01 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-39379e7f-b827-4ddf-8062-b242e47433d8 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Deleted allocations for instance 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8
Aug 09 06:55:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-39379e7f-b827-4ddf-8062-b242e47433d8 tempest-VolumesActionsTest-812095692 tempest-VolumesActionsTest-812095692-project-member] Lock "1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.196s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Received event <DeviceRemovedEvent: 1691564101.8173947, 3640991e-8a5b-4674-af81-3117d4269a68 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72809) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3640991e-8a5b-4674-af81-3117d4269a68 {{(pid=72809) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 06:55:01 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Successfully detached device vdb from instance 3640991e-8a5b-4674-af81-3117d4269a68 from the live domain config.
Aug 09 06:55:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwOMyJVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:55:01 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:55:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4746b757-83e2-4363-992f-3c5313f2bef6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG nova.compute.manager [req-4074afd7-67cd-4532-835f-365c7bca2959 req-a690798a-6909-4c08-bd73-130e5eb7c819 service nova] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Received event network-vif-plugged-be2444ce-562d-44c8-9707-4908e0f8cc4a {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-4074afd7-67cd-4532-835f-365c7bca2959 req-a690798a-6909-4c08-bd73-130e5eb7c819 service nova] Acquiring lock "1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-4074afd7-67cd-4532-835f-365c7bca2959 req-a690798a-6909-4c08-bd73-130e5eb7c819 service nova] Lock "1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-4074afd7-67cd-4532-835f-365c7bca2959 req-a690798a-6909-4c08-bd73-130e5eb7c819 service nova] Lock "1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG nova.compute.manager [req-4074afd7-67cd-4532-835f-365c7bca2959 req-a690798a-6909-4c08-bd73-130e5eb7c819 service nova] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] No waiting events found dispatching network-vif-plugged-be2444ce-562d-44c8-9707-4908e0f8cc4a {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:55:01 user nova-compute[72809]: WARNING nova.compute.manager [req-4074afd7-67cd-4532-835f-365c7bca2959 req-a690798a-6909-4c08-bd73-130e5eb7c819 service nova] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Received unexpected event network-vif-plugged-be2444ce-562d-44c8-9707-4908e0f8cc4a for instance with vm_state deleted and task_state None.
Aug 09 06:55:01 user nova-compute[72809]: DEBUG nova.compute.manager [req-4074afd7-67cd-4532-835f-365c7bca2959 req-a690798a-6909-4c08-bd73-130e5eb7c819 service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Received event network-vif-unplugged-d47e67e7-9ad1-4670-9a22-a85ad34210a8 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-4074afd7-67cd-4532-835f-365c7bca2959 req-a690798a-6909-4c08-bd73-130e5eb7c819 service nova] Acquiring lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-4074afd7-67cd-4532-835f-365c7bca2959 req-a690798a-6909-4c08-bd73-130e5eb7c819 service nova] Lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-4074afd7-67cd-4532-835f-365c7bca2959 req-a690798a-6909-4c08-bd73-130e5eb7c819 service nova] Lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG nova.compute.manager [req-4074afd7-67cd-4532-835f-365c7bca2959 req-a690798a-6909-4c08-bd73-130e5eb7c819 service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] No waiting events found dispatching network-vif-unplugged-d47e67e7-9ad1-4670-9a22-a85ad34210a8 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:55:01 user nova-compute[72809]: WARNING nova.compute.manager [req-4074afd7-67cd-4532-835f-365c7bca2959 req-a690798a-6909-4c08-bd73-130e5eb7c819 service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Received unexpected event network-vif-unplugged-d47e67e7-9ad1-4670-9a22-a85ad34210a8 for instance with vm_state active and task_state None.
Aug 09 06:55:01 user nova-compute[72809]: DEBUG nova.compute.manager [req-4074afd7-67cd-4532-835f-365c7bca2959 req-a690798a-6909-4c08-bd73-130e5eb7c819 service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Received event network-vif-plugged-d47e67e7-9ad1-4670-9a22-a85ad34210a8 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-4074afd7-67cd-4532-835f-365c7bca2959 req-a690798a-6909-4c08-bd73-130e5eb7c819 service nova] Acquiring lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-4074afd7-67cd-4532-835f-365c7bca2959 req-a690798a-6909-4c08-bd73-130e5eb7c819 service nova] Lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-4074afd7-67cd-4532-835f-365c7bca2959 req-a690798a-6909-4c08-bd73-130e5eb7c819 service nova] Lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG nova.compute.manager [req-4074afd7-67cd-4532-835f-365c7bca2959 req-a690798a-6909-4c08-bd73-130e5eb7c819 service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] No waiting events found dispatching network-vif-plugged-d47e67e7-9ad1-4670-9a22-a85ad34210a8 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:55:01 user nova-compute[72809]: WARNING nova.compute.manager [req-4074afd7-67cd-4532-835f-365c7bca2959 req-a690798a-6909-4c08-bd73-130e5eb7c819 service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Received unexpected event network-vif-plugged-d47e67e7-9ad1-4670-9a22-a85ad34210a8 for instance with vm_state active and task_state None.
Aug 09 06:55:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b379dd1-f867-447d-bee0-842eae3aa547]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:55:01 user nova-compute[72809]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)
Aug 09 06:55:01 user nova-compute[72809]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)
Aug 09 06:55:01 user nova-compute[72809]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)
Aug 09 06:55:01 user nova-compute[72809]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:55:01 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d (non-flash)
Aug 09 06:55:01 user nova-compute[72809]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)
Aug 09 06:55:01 user nova-compute[72809]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)
Aug 09 06:55:01 user nova-compute[72809]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)
Aug 09 06:55:01 user nova-compute[72809]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:55:01 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc1386e4040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d'): ({'sdb'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Removing single pathed devices sdb {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebcf8a4-5d59-4cf1-b36a-89352b316352]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d754a500-8a5c-49c9-848a-845d86de01d9]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Flushing IO for device /dev/sdb {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-66ce3716-39e6-48e1-accb-0044e5293135 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Acquiring lock "refresh_cache-c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-66ce3716-39e6-48e1-accb-0044e5293135 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Acquired lock "refresh_cache-c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG nova.network.neutron [None req-66ce3716-39e6-48e1-accb-0044e5293135 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b11c72-7980-4b4d-8195-5fd231b4608e]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 06:55:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:02 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7012b89-3cb9-4332-b31f-ac413902065f]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:02 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 06:55:02 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] SCSI volumes sdb have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 06:55:02 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 06:55:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:02 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6188606d-92e7-4717-88bb-d697cd8edea1]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:02 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:55:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:02 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[213a811e-e8e1-43cb-8980-b95760a85c6e]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:02 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d, portal: 172.16.0.220,3260]
Aug 09 06:55:02 user nova-compute[72809]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d, portal: 172.16.0.220,3260] successful.
Aug 09 06:55:02 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:55:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d187a33a-16e4-421a-890e-be960e85387d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:02 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d647e7-c297-418f-9224-b2a6a0803734]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:02 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:55:02 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:55:02 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] <== disconnect_volume: return (320ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:55:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 06:55:02 user nova-compute[72809]: INFO nova.network.neutron [None req-66ce3716-39e6-48e1-accb-0044e5293135 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Port d47e67e7-9ad1-4670-9a22-a85ad34210a8 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 09 06:55:02 user nova-compute[72809]: DEBUG nova.network.neutron [None req-66ce3716-39e6-48e1-accb-0044e5293135 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Updating instance_info_cache with network_info: [{"id": "947db6ff-ed42-4aca-a543-a929517ae8e4", "address": "fa:16:3e:5d:13:2e", "network": {"id": "1e8ee49b-483d-4c93-839e-c0e80a98012f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1381031589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f46d46622964063ba2425358469a36f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap947db6ff-ed", "ovs_interfaceid": "947db6ff-ed42-4aca-a543-a929517ae8e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:55:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-66ce3716-39e6-48e1-accb-0044e5293135 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Releasing lock "refresh_cache-c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:55:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-66ce3716-39e6-48e1-accb-0044e5293135 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lock "interface-c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed-d47e67e7-9ad1-4670-9a22-a85ad34210a8" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.654s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:02 user nova-compute[72809]: DEBUG nova.compute.manager [req-fa304d94-a3c6-4f1b-bd25-f776849b0bb4 req-30579270-d6b5-4485-97f8-ddcb4fd12408 service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Received event network-vif-deleted-d47e67e7-9ad1-4670-9a22-a85ad34210a8 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a3823774-c273-4ec2-9da7-9b0b36ed10ef tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Acquiring lock "b64e7169-044c-4d0a-9ee5-f2914f1f5529" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a3823774-c273-4ec2-9da7-9b0b36ed10ef tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "b64e7169-044c-4d0a-9ee5-f2914f1f5529" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a3823774-c273-4ec2-9da7-9b0b36ed10ef tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Acquiring lock "b64e7169-044c-4d0a-9ee5-f2914f1f5529-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a3823774-c273-4ec2-9da7-9b0b36ed10ef tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "b64e7169-044c-4d0a-9ee5-f2914f1f5529-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a3823774-c273-4ec2-9da7-9b0b36ed10ef tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "b64e7169-044c-4d0a-9ee5-f2914f1f5529-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:04 user nova-compute[72809]: INFO nova.compute.manager [None req-a3823774-c273-4ec2-9da7-9b0b36ed10ef tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Terminating instance
Aug 09 06:55:04 user nova-compute[72809]: DEBUG nova.compute.manager [None req-a3823774-c273-4ec2-9da7-9b0b36ed10ef tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 06:55:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:04 user nova-compute[72809]: DEBUG nova.compute.manager [req-25c1f393-c2d8-43cb-8132-4156bef9df16 req-2b59bd02-b4c8-46bf-a01a-3f799fd24770 service nova] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Received event network-vif-unplugged-d83214ef-f913-4ab9-b9b5-4bcd171b1656 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-25c1f393-c2d8-43cb-8132-4156bef9df16 req-2b59bd02-b4c8-46bf-a01a-3f799fd24770 service nova] Acquiring lock "b64e7169-044c-4d0a-9ee5-f2914f1f5529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-25c1f393-c2d8-43cb-8132-4156bef9df16 req-2b59bd02-b4c8-46bf-a01a-3f799fd24770 service nova] Lock "b64e7169-044c-4d0a-9ee5-f2914f1f5529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-25c1f393-c2d8-43cb-8132-4156bef9df16 req-2b59bd02-b4c8-46bf-a01a-3f799fd24770 service nova] Lock "b64e7169-044c-4d0a-9ee5-f2914f1f5529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:04 user nova-compute[72809]: DEBUG nova.compute.manager [req-25c1f393-c2d8-43cb-8132-4156bef9df16 req-2b59bd02-b4c8-46bf-a01a-3f799fd24770 service nova] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] No waiting events found dispatching network-vif-unplugged-d83214ef-f913-4ab9-b9b5-4bcd171b1656 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:55:04 user nova-compute[72809]: DEBUG nova.compute.manager [req-25c1f393-c2d8-43cb-8132-4156bef9df16 req-2b59bd02-b4c8-46bf-a01a-3f799fd24770 service nova] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Received event network-vif-unplugged-d83214ef-f913-4ab9-b9b5-4bcd171b1656 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 06:55:05 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Instance destroyed successfully.
Aug 09 06:55:05 user nova-compute[72809]: DEBUG nova.objects.instance [None req-a3823774-c273-4ec2-9da7-9b0b36ed10ef tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lazy-loading 'resources' on Instance uuid b64e7169-044c-4d0a-9ee5-f2914f1f5529 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:55:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-a3823774-c273-4ec2-9da7-9b0b36ed10ef tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-560642077',display_name='tempest-VolumesAdminNegativeTest-server-560642077',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-560642077',id=6,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLkSAG5AK/BoN6SJjuI6pyRB/CdhDINWb1oNRFuASCnzT1E1AdotJc6Wp7P+GVE46MuMaQ+y16AC5HUbGTLCt93nj+QHFbC4+0wVe6tnKkOGZ8B7kxVVAd+dRL3ZNmhnA==',key_name='tempest-keypair-228576492',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:49:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06d061b94c6548d88d8c3cae6751d937',ramdisk_id='',reservation_id='r-2vyg439q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2043800207',owner_user_name='tempest-VolumesAdminNegativeTest-2043800207-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:49:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6cd5e6af221a4c0d996b4da1cce17f55',uuid=b64e7169-044c-4d0a-9ee5-f2914f1f5529,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d83214ef-f913-4ab9-b9b5-4bcd171b1656", "address": "fa:16:3e:7b:70:28", "network": {"id": "9d98057f-37e6-42f0-9a94-2240979d38f4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-490582380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06d061b94c6548d88d8c3cae6751d937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd83214ef-f9", "ovs_interfaceid": "d83214ef-f913-4ab9-b9b5-4bcd171b1656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:55:05 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-a3823774-c273-4ec2-9da7-9b0b36ed10ef tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Converting VIF {"id": "d83214ef-f913-4ab9-b9b5-4bcd171b1656", "address": "fa:16:3e:7b:70:28", "network": {"id": "9d98057f-37e6-42f0-9a94-2240979d38f4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-490582380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06d061b94c6548d88d8c3cae6751d937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd83214ef-f9", "ovs_interfaceid": "d83214ef-f913-4ab9-b9b5-4bcd171b1656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:55:05 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-a3823774-c273-4ec2-9da7-9b0b36ed10ef tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:70:28,bridge_name='br-int',has_traffic_filtering=True,id=d83214ef-f913-4ab9-b9b5-4bcd171b1656,network=Network(9d98057f-37e6-42f0-9a94-2240979d38f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd83214ef-f9') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:55:05 user nova-compute[72809]: DEBUG os_vif [None req-a3823774-c273-4ec2-9da7-9b0b36ed10ef tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:70:28,bridge_name='br-int',has_traffic_filtering=True,id=d83214ef-f913-4ab9-b9b5-4bcd171b1656,network=Network(9d98057f-37e6-42f0-9a94-2240979d38f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd83214ef-f9') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:55:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd83214ef-f9, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:55:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:55:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:05 user nova-compute[72809]: INFO os_vif [None req-a3823774-c273-4ec2-9da7-9b0b36ed10ef tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:70:28,bridge_name='br-int',has_traffic_filtering=True,id=d83214ef-f913-4ab9-b9b5-4bcd171b1656,network=Network(9d98057f-37e6-42f0-9a94-2240979d38f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd83214ef-f9')
Aug 09 06:55:05 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-a3823774-c273-4ec2-9da7-9b0b36ed10ef tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Deleting instance files /opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529_del
Aug 09 06:55:05 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-a3823774-c273-4ec2-9da7-9b0b36ed10ef tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Deletion of /opt/stack/data/nova/instances/b64e7169-044c-4d0a-9ee5-f2914f1f5529_del complete
Aug 09 06:55:05 user nova-compute[72809]: INFO nova.compute.manager [None req-a3823774-c273-4ec2-9da7-9b0b36ed10ef tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 09 06:55:05 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-a3823774-c273-4ec2-9da7-9b0b36ed10ef tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 06:55:05 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 06:55:05 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 06:55:06 user nova-compute[72809]: DEBUG nova.objects.instance [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lazy-loading 'flavor' on Instance uuid 3640991e-8a5b-4674-af81-3117d4269a68 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:55:06 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:55:06 user nova-compute[72809]: DEBUG nova.compute.manager [req-8ff12fad-35d1-4e89-b686-4ef1389ef55c req-da58a5f5-9704-4275-8513-820a18aa7ad7 service nova] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Received event network-vif-deleted-d83214ef-f913-4ab9-b9b5-4bcd171b1656 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:06 user nova-compute[72809]: INFO nova.compute.manager [req-8ff12fad-35d1-4e89-b686-4ef1389ef55c req-da58a5f5-9704-4275-8513-820a18aa7ad7 service nova] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Neutron deleted interface d83214ef-f913-4ab9-b9b5-4bcd171b1656; detaching it from the instance and deleting it from the info cache
Aug 09 06:55:06 user nova-compute[72809]: DEBUG nova.network.neutron [req-8ff12fad-35d1-4e89-b686-4ef1389ef55c req-da58a5f5-9704-4275-8513-820a18aa7ad7 service nova] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:55:06 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Took 0.92 seconds to deallocate network for instance.
Aug 09 06:55:06 user nova-compute[72809]: DEBUG nova.compute.manager [req-8ff12fad-35d1-4e89-b686-4ef1389ef55c req-da58a5f5-9704-4275-8513-820a18aa7ad7 service nova] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Detach interface failed, port_id=d83214ef-f913-4ab9-b9b5-4bcd171b1656, reason: Instance b64e7169-044c-4d0a-9ee5-f2914f1f5529 could not be found. {{(pid=72809) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 06:55:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b6ac64b6-5332-469c-a9c4-4ed61bbd9922 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "3640991e-8a5b-4674-af81-3117d4269a68" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.229s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a3823774-c273-4ec2-9da7-9b0b36ed10ef tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a3823774-c273-4ec2-9da7-9b0b36ed10ef tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:06 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-a3823774-c273-4ec2-9da7-9b0b36ed10ef tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:55:06 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-a3823774-c273-4ec2-9da7-9b0b36ed10ef tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:55:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a3823774-c273-4ec2-9da7-9b0b36ed10ef tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.592s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-31710120-8483-42d8-8b69-4e6fe887fdda req-1857d6f5-8bab-4c47-992b-79643d50da41 service nova] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Received event network-vif-plugged-d83214ef-f913-4ab9-b9b5-4bcd171b1656 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-31710120-8483-42d8-8b69-4e6fe887fdda req-1857d6f5-8bab-4c47-992b-79643d50da41 service nova] Acquiring lock "b64e7169-044c-4d0a-9ee5-f2914f1f5529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-31710120-8483-42d8-8b69-4e6fe887fdda req-1857d6f5-8bab-4c47-992b-79643d50da41 service nova] Lock "b64e7169-044c-4d0a-9ee5-f2914f1f5529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-31710120-8483-42d8-8b69-4e6fe887fdda req-1857d6f5-8bab-4c47-992b-79643d50da41 service nova] Lock "b64e7169-044c-4d0a-9ee5-f2914f1f5529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-31710120-8483-42d8-8b69-4e6fe887fdda req-1857d6f5-8bab-4c47-992b-79643d50da41 service nova] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] No waiting events found dispatching network-vif-plugged-d83214ef-f913-4ab9-b9b5-4bcd171b1656 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:55:07 user nova-compute[72809]: WARNING nova.compute.manager [req-31710120-8483-42d8-8b69-4e6fe887fdda req-1857d6f5-8bab-4c47-992b-79643d50da41 service nova] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Received unexpected event network-vif-plugged-d83214ef-f913-4ab9-b9b5-4bcd171b1656 for instance with vm_state deleted and task_state None.
Aug 09 06:55:07 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-a3823774-c273-4ec2-9da7-9b0b36ed10ef tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Deleted allocations for instance b64e7169-044c-4d0a-9ee5-f2914f1f5529
Aug 09 06:55:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a3823774-c273-4ec2-9da7-9b0b36ed10ef tempest-VolumesAdminNegativeTest-2043800207 tempest-VolumesAdminNegativeTest-2043800207-project-member] Lock "b64e7169-044c-4d0a-9ee5-f2914f1f5529" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.703s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:15 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691564100.0332084, 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:55:15 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] VM Stopped (Lifecycle Event)
Aug 09 06:55:15 user nova-compute[72809]: DEBUG nova.compute.manager [None req-a88da0d5-637a-4351-9043-3b358b23274a None None] [instance: 1c6aa869-62a0-4638-b9bd-3ca4dcf90ba8] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:55:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:15 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._sync_power_states {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:55:15 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Triggering sync for uuid 24ba9b41-d0bf-4a84-9f04-bfda9525b154 {{(pid=72809) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 06:55:15 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Triggering sync for uuid 3640991e-8a5b-4674-af81-3117d4269a68 {{(pid=72809) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 06:55:15 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Triggering sync for uuid 15dda080-3487-4316-ab7b-f7185f0a4519 {{(pid=72809) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 06:55:15 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Triggering sync for uuid c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed {{(pid=72809) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 06:55:15 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Triggering sync for uuid 336770eb-4f09-4134-92ef-f96039bf4fa9 {{(pid=72809) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 06:55:15 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Triggering sync for uuid f69df9a2-e8ed-4bec-8c01-cd005432a373 {{(pid=72809) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 06:55:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "3640991e-8a5b-4674-af81-3117d4269a68" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "3640991e-8a5b-4674-af81-3117d4269a68" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "15dda080-3487-4316-ab7b-f7185f0a4519" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "15dda080-3487-4316-ab7b-f7185f0a4519" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "336770eb-4f09-4134-92ef-f96039bf4fa9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "336770eb-4f09-4134-92ef-f96039bf4fa9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "f69df9a2-e8ed-4bec-8c01-cd005432a373" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "3640991e-8a5b-4674-af81-3117d4269a68" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "15dda080-3487-4316-ab7b-f7185f0a4519" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "336770eb-4f09-4134-92ef-f96039bf4fa9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:20 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691564105.2958055, b64e7169-044c-4d0a-9ee5-f2914f1f5529 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:55:20 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] VM Stopped (Lifecycle Event)
Aug 09 06:55:20 user nova-compute[72809]: DEBUG nova.compute.manager [None req-6a948420-0dec-4703-81f1-330ab6b1b22c None None] [instance: b64e7169-044c-4d0a-9ee5-f2914f1f5529] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:55:20 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "5251cef4-9a49-4220-984e-75d1198f95b6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "5251cef4-9a49-4220-984e-75d1198f95b6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:22 user nova-compute[72809]: DEBUG nova.compute.manager [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 06:55:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:22 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 06:55:22 user nova-compute[72809]: INFO nova.compute.claims [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Claim successful on node user
Aug 09 06:55:22 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:55:22 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:55:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.317s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:22 user nova-compute[72809]: DEBUG nova.compute.manager [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 06:55:22 user nova-compute[72809]: DEBUG nova.compute.manager [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 06:55:22 user nova-compute[72809]: DEBUG nova.network.neutron [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 06:55:22 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 06:55:22 user nova-compute[72809]: DEBUG nova.compute.manager [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 06:55:22 user nova-compute[72809]: DEBUG nova.policy [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f85a1f2a88fd40a48d1c4dba13f0ac09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce7c486aaca4ef89eb7e392b717e3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 06:55:22 user nova-compute[72809]: DEBUG nova.compute.manager [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 06:55:22 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 06:55:22 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Creating image(s)
Aug 09 06:55:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "/opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "/opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "/opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.135s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.133s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk 1073741824" returned: 0 in 0.177s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.132s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:23 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 06:55:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:23 user nova-compute[72809]: DEBUG nova.network.neutron [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Successfully created port: 0a2076a0-d9a0-4c09-9fcd-68011828f5e0 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:55:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:23 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Cannot resize image /opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 06:55:23 user nova-compute[72809]: DEBUG nova.objects.instance [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lazy-loading 'migration_context' on Instance uuid 5251cef4-9a49-4220-984e-75d1198f95b6 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:55:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 06:55:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Ensure instance console log exists: /opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 06:55:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.network.neutron [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Successfully updated port: 0a2076a0-d9a0-4c09-9fcd-68011828f5e0 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "refresh_cache-5251cef4-9a49-4220-984e-75d1198f95b6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquired lock "refresh_cache-5251cef4-9a49-4220-984e-75d1198f95b6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.network.neutron [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.compute.manager [req-ca7828ac-b8af-4610-b137-3e0c719191d8 req-270579ad-5065-4c15-ac15-3192ea61579c service nova] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Received event network-changed-0a2076a0-d9a0-4c09-9fcd-68011828f5e0 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.compute.manager [req-ca7828ac-b8af-4610-b137-3e0c719191d8 req-270579ad-5065-4c15-ac15-3192ea61579c service nova] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Refreshing instance network info cache due to event network-changed-0a2076a0-d9a0-4c09-9fcd-68011828f5e0. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ca7828ac-b8af-4610-b137-3e0c719191d8 req-270579ad-5065-4c15-ac15-3192ea61579c service nova] Acquiring lock "refresh_cache-5251cef4-9a49-4220-984e-75d1198f95b6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.network.neutron [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.network.neutron [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Updating instance_info_cache with network_info: [{"id": "0a2076a0-d9a0-4c09-9fcd-68011828f5e0", "address": "fa:16:3e:6d:d2:82", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2076a0-d9", "ovs_interfaceid": "0a2076a0-d9a0-4c09-9fcd-68011828f5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Releasing lock "refresh_cache-5251cef4-9a49-4220-984e-75d1198f95b6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.compute.manager [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Instance network_info: |[{"id": "0a2076a0-d9a0-4c09-9fcd-68011828f5e0", "address": "fa:16:3e:6d:d2:82", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2076a0-d9", "ovs_interfaceid": "0a2076a0-d9a0-4c09-9fcd-68011828f5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ca7828ac-b8af-4610-b137-3e0c719191d8 req-270579ad-5065-4c15-ac15-3192ea61579c service nova] Acquired lock "refresh_cache-5251cef4-9a49-4220-984e-75d1198f95b6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.network.neutron [req-ca7828ac-b8af-4610-b137-3e0c719191d8 req-270579ad-5065-4c15-ac15-3192ea61579c service nova] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Refreshing network info cache for port 0a2076a0-d9a0-4c09-9fcd-68011828f5e0 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Start _get_guest_xml network_info=[{"id": "0a2076a0-d9a0-4c09-9fcd-68011828f5e0", "address": "fa:16:3e:6d:d2:82", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2076a0-d9", "ovs_interfaceid": "0a2076a0-d9a0-4c09-9fcd-68011828f5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:55:24 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:55:24 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:55:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1816948191',display_name='tempest-AttachVolumeNegativeTest-server-1816948191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1816948191',id=18,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcGNkIj35E7oBNNVLCFShzvinhbD5YvCftAPLGVTgZpmyQVeLrSOektcCwSa0DgZRS2k9lYpf4F71nGWrX14bBJXFI0I+mEUon3aSLWhsX54ct2cJs40V7L+87XSGYvfw==',key_name='tempest-keypair-449720676',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ce7c486aaca4ef89eb7e392b717e3d7',ramdisk_id='',reservation_id='r-d0fle55b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2066250801',owner_user_name='tempest-AttachVolumeNegativeTest-2066250801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:55:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f85a1f2a88fd40a48d1c4dba13f0ac09',uuid=5251cef4-9a49-4220-984e-75d1198f95b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a2076a0-d9a0-4c09-9fcd-68011828f5e0", "address": "fa:16:3e:6d:d2:82", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2076a0-d9", "ovs_interfaceid": "0a2076a0-d9a0-4c09-9fcd-68011828f5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Converting VIF {"id": "0a2076a0-d9a0-4c09-9fcd-68011828f5e0", "address": "fa:16:3e:6d:d2:82", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2076a0-d9", "ovs_interfaceid": "0a2076a0-d9a0-4c09-9fcd-68011828f5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:d2:82,bridge_name='br-int',has_traffic_filtering=True,id=0a2076a0-d9a0-4c09-9fcd-68011828f5e0,network=Network(1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a2076a0-d9') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.objects.instance [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lazy-loading 'pci_devices' on Instance uuid 5251cef4-9a49-4220-984e-75d1198f95b6 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:55:24 user nova-compute[72809]:   <uuid>5251cef4-9a49-4220-984e-75d1198f95b6</uuid>
Aug 09 06:55:24 user nova-compute[72809]:   <name>instance-00000012</name>
Aug 09 06:55:24 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:55:24 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:55:24 user nova-compute[72809]:   <metadata>
Aug 09 06:55:24 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:55:24 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:55:24 user nova-compute[72809]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1816948191</nova:name>
Aug 09 06:55:24 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:55:24</nova:creationTime>
Aug 09 06:55:24 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:55:24 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:55:24 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:55:24 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:55:24 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:55:24 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:55:24 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:55:24 user nova-compute[72809]:       <nova:owner>
Aug 09 06:55:24 user nova-compute[72809]:         <nova:user uuid="f85a1f2a88fd40a48d1c4dba13f0ac09">tempest-AttachVolumeNegativeTest-2066250801-project-member</nova:user>
Aug 09 06:55:24 user nova-compute[72809]:         <nova:project uuid="8ce7c486aaca4ef89eb7e392b717e3d7">tempest-AttachVolumeNegativeTest-2066250801</nova:project>
Aug 09 06:55:24 user nova-compute[72809]:       </nova:owner>
Aug 09 06:55:24 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:55:24 user nova-compute[72809]:       <nova:ports>
Aug 09 06:55:24 user nova-compute[72809]:         <nova:port uuid="0a2076a0-d9a0-4c09-9fcd-68011828f5e0">
Aug 09 06:55:24 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 06:55:24 user nova-compute[72809]:         </nova:port>
Aug 09 06:55:24 user nova-compute[72809]:       </nova:ports>
Aug 09 06:55:24 user nova-compute[72809]:     </nova:instance>
Aug 09 06:55:24 user nova-compute[72809]:   </metadata>
Aug 09 06:55:24 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:55:24 user nova-compute[72809]:     <system>
Aug 09 06:55:24 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:55:24 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:55:24 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:55:24 user nova-compute[72809]:       <entry name="serial">5251cef4-9a49-4220-984e-75d1198f95b6</entry>
Aug 09 06:55:24 user nova-compute[72809]:       <entry name="uuid">5251cef4-9a49-4220-984e-75d1198f95b6</entry>
Aug 09 06:55:24 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:55:24 user nova-compute[72809]:     </system>
Aug 09 06:55:24 user nova-compute[72809]:   </sysinfo>
Aug 09 06:55:24 user nova-compute[72809]:   <os>
Aug 09 06:55:24 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:55:24 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 06:55:24 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:55:24 user nova-compute[72809]:   </os>
Aug 09 06:55:24 user nova-compute[72809]:   <features>
Aug 09 06:55:24 user nova-compute[72809]:     <acpi/>
Aug 09 06:55:24 user nova-compute[72809]:     <apic/>
Aug 09 06:55:24 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:55:24 user nova-compute[72809]:   </features>
Aug 09 06:55:24 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:55:24 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:55:24 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:55:24 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:55:24 user nova-compute[72809]:   </clock>
Aug 09 06:55:24 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:55:24 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:55:24 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:55:24 user nova-compute[72809]:   </cpu>
Aug 09 06:55:24 user nova-compute[72809]:   <devices>
Aug 09 06:55:24 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:55:24 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:55:24 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk"/>
Aug 09 06:55:24 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:55:24 user nova-compute[72809]:     </disk>
Aug 09 06:55:24 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:55:24 user nova-compute[72809]:       <mac address="fa:16:3e:6d:d2:82"/>
Aug 09 06:55:24 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:55:24 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:55:24 user nova-compute[72809]:       <target dev="tap0a2076a0-d9"/>
Aug 09 06:55:24 user nova-compute[72809]:     </interface>
Aug 09 06:55:24 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:55:24 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/console.log" append="off"/>
Aug 09 06:55:24 user nova-compute[72809]:     </serial>
Aug 09 06:55:24 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:55:24 user nova-compute[72809]:     <video>
Aug 09 06:55:24 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:55:24 user nova-compute[72809]:     </video>
Aug 09 06:55:24 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:55:24 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:55:24 user nova-compute[72809]:     </rng>
Aug 09 06:55:24 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:55:24 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:55:24 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:55:24 user nova-compute[72809]:     </memballoon>
Aug 09 06:55:24 user nova-compute[72809]:   </devices>
Aug 09 06:55:24 user nova-compute[72809]: </domain>
Aug 09 06:55:24 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:55:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1816948191',display_name='tempest-AttachVolumeNegativeTest-server-1816948191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1816948191',id=18,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcGNkIj35E7oBNNVLCFShzvinhbD5YvCftAPLGVTgZpmyQVeLrSOektcCwSa0DgZRS2k9lYpf4F71nGWrX14bBJXFI0I+mEUon3aSLWhsX54ct2cJs40V7L+87XSGYvfw==',key_name='tempest-keypair-449720676',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ce7c486aaca4ef89eb7e392b717e3d7',ramdisk_id='',reservation_id='r-d0fle55b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2066250801',owner_user_name='tempest-AttachVolumeNegativeTest-2066250801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:55:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f85a1f2a88fd40a48d1c4dba13f0ac09',uuid=5251cef4-9a49-4220-984e-75d1198f95b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a2076a0-d9a0-4c09-9fcd-68011828f5e0", "address": "fa:16:3e:6d:d2:82", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2076a0-d9", "ovs_interfaceid": "0a2076a0-d9a0-4c09-9fcd-68011828f5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Converting VIF {"id": "0a2076a0-d9a0-4c09-9fcd-68011828f5e0", "address": "fa:16:3e:6d:d2:82", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2076a0-d9", "ovs_interfaceid": "0a2076a0-d9a0-4c09-9fcd-68011828f5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:d2:82,bridge_name='br-int',has_traffic_filtering=True,id=0a2076a0-d9a0-4c09-9fcd-68011828f5e0,network=Network(1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a2076a0-d9') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG os_vif [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:d2:82,bridge_name='br-int',has_traffic_filtering=True,id=0a2076a0-d9a0-4c09-9fcd-68011828f5e0,network=Network(1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a2076a0-d9') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a2076a0-d9, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0a2076a0-d9, col_values=(('external_ids', {'iface-id': '0a2076a0-d9a0-4c09-9fcd-68011828f5e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:d2:82', 'vm-uuid': '5251cef4-9a49-4220-984e-75d1198f95b6'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:24 user nova-compute[72809]: INFO os_vif [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:d2:82,bridge_name='br-int',has_traffic_filtering=True,id=0a2076a0-d9a0-4c09-9fcd-68011828f5e0,network=Network(1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a2076a0-d9')
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:55:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] No VIF found with MAC fa:16:3e:6d:d2:82, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:55:25 user nova-compute[72809]: DEBUG nova.network.neutron [req-ca7828ac-b8af-4610-b137-3e0c719191d8 req-270579ad-5065-4c15-ac15-3192ea61579c service nova] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Updated VIF entry in instance network info cache for port 0a2076a0-d9a0-4c09-9fcd-68011828f5e0. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:55:25 user nova-compute[72809]: DEBUG nova.network.neutron [req-ca7828ac-b8af-4610-b137-3e0c719191d8 req-270579ad-5065-4c15-ac15-3192ea61579c service nova] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Updating instance_info_cache with network_info: [{"id": "0a2076a0-d9a0-4c09-9fcd-68011828f5e0", "address": "fa:16:3e:6d:d2:82", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2076a0-d9", "ovs_interfaceid": "0a2076a0-d9a0-4c09-9fcd-68011828f5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:55:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ca7828ac-b8af-4610-b137-3e0c719191d8 req-270579ad-5065-4c15-ac15-3192ea61579c service nova] Releasing lock "refresh_cache-5251cef4-9a49-4220-984e-75d1198f95b6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:55:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:26 user nova-compute[72809]: DEBUG nova.compute.manager [req-7b7ab19d-52e8-4f3f-baab-5c1bbc3c6ad9 req-98325897-2b97-42a3-97ba-73da00e7291b service nova] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Received event network-vif-plugged-0a2076a0-d9a0-4c09-9fcd-68011828f5e0 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7b7ab19d-52e8-4f3f-baab-5c1bbc3c6ad9 req-98325897-2b97-42a3-97ba-73da00e7291b service nova] Acquiring lock "5251cef4-9a49-4220-984e-75d1198f95b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7b7ab19d-52e8-4f3f-baab-5c1bbc3c6ad9 req-98325897-2b97-42a3-97ba-73da00e7291b service nova] Lock "5251cef4-9a49-4220-984e-75d1198f95b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7b7ab19d-52e8-4f3f-baab-5c1bbc3c6ad9 req-98325897-2b97-42a3-97ba-73da00e7291b service nova] Lock "5251cef4-9a49-4220-984e-75d1198f95b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:26 user nova-compute[72809]: DEBUG nova.compute.manager [req-7b7ab19d-52e8-4f3f-baab-5c1bbc3c6ad9 req-98325897-2b97-42a3-97ba-73da00e7291b service nova] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] No waiting events found dispatching network-vif-plugged-0a2076a0-d9a0-4c09-9fcd-68011828f5e0 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:55:26 user nova-compute[72809]: WARNING nova.compute.manager [req-7b7ab19d-52e8-4f3f-baab-5c1bbc3c6ad9 req-98325897-2b97-42a3-97ba-73da00e7291b service nova] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Received unexpected event network-vif-plugged-0a2076a0-d9a0-4c09-9fcd-68011828f5e0 for instance with vm_state building and task_state spawning.
Aug 09 06:55:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:27 user nova-compute[72809]: DEBUG nova.compute.manager [req-f4e7fa17-7621-477d-84cb-067e0fc04eeb req-585d2872-b7ab-46db-a852-ea72791cc20f service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Received event network-changed-8ac68313-9d94-449d-87e1-9fb135c7bab5 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:27 user nova-compute[72809]: DEBUG nova.compute.manager [req-f4e7fa17-7621-477d-84cb-067e0fc04eeb req-585d2872-b7ab-46db-a852-ea72791cc20f service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Refreshing instance network info cache due to event network-changed-8ac68313-9d94-449d-87e1-9fb135c7bab5. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:55:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f4e7fa17-7621-477d-84cb-067e0fc04eeb req-585d2872-b7ab-46db-a852-ea72791cc20f service nova] Acquiring lock "refresh_cache-336770eb-4f09-4134-92ef-f96039bf4fa9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:55:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f4e7fa17-7621-477d-84cb-067e0fc04eeb req-585d2872-b7ab-46db-a852-ea72791cc20f service nova] Acquired lock "refresh_cache-336770eb-4f09-4134-92ef-f96039bf4fa9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:55:27 user nova-compute[72809]: DEBUG nova.network.neutron [req-f4e7fa17-7621-477d-84cb-067e0fc04eeb req-585d2872-b7ab-46db-a852-ea72791cc20f service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Refreshing network info cache for port 8ac68313-9d94-449d-87e1-9fb135c7bab5 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:55:27 user nova-compute[72809]: DEBUG nova.network.neutron [req-f4e7fa17-7621-477d-84cb-067e0fc04eeb req-585d2872-b7ab-46db-a852-ea72791cc20f service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Updated VIF entry in instance network info cache for port 8ac68313-9d94-449d-87e1-9fb135c7bab5. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:55:27 user nova-compute[72809]: DEBUG nova.network.neutron [req-f4e7fa17-7621-477d-84cb-067e0fc04eeb req-585d2872-b7ab-46db-a852-ea72791cc20f service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Updating instance_info_cache with network_info: [{"id": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "address": "fa:16:3e:b9:56:8d", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac68313-9d", "ovs_interfaceid": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:55:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f4e7fa17-7621-477d-84cb-067e0fc04eeb req-585d2872-b7ab-46db-a852-ea72791cc20f service nova] Releasing lock "refresh_cache-336770eb-4f09-4134-92ef-f96039bf4fa9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:55:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:28 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564128.1438088, 5251cef4-9a49-4220-984e-75d1198f95b6 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:55:28 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] VM Resumed (Lifecycle Event)
Aug 09 06:55:28 user nova-compute[72809]: DEBUG nova.compute.manager [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:55:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 06:55:28 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Instance spawned successfully.
Aug 09 06:55:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 06:55:28 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:55:28 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:55:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:55:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:55:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:55:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:55:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:55:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:55:28 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:55:28 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564128.1481376, 5251cef4-9a49-4220-984e-75d1198f95b6 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:55:28 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] VM Started (Lifecycle Event)
Aug 09 06:55:28 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:55:28 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:55:28 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:55:28 user nova-compute[72809]: INFO nova.compute.manager [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Took 5.33 seconds to spawn the instance on the hypervisor.
Aug 09 06:55:28 user nova-compute[72809]: DEBUG nova.compute.manager [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:55:28 user nova-compute[72809]: INFO nova.compute.manager [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Took 5.97 seconds to build instance.
Aug 09 06:55:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9963efbb-284d-4a2e-a344-bcf3c0579c80 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "5251cef4-9a49-4220-984e-75d1198f95b6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.073s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:28 user nova-compute[72809]: DEBUG nova.compute.manager [req-c60b4ae6-f92b-4789-a047-aaded90465c6 req-e3f2e623-dee5-41f6-bea8-7c555afce81a service nova] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Received event network-vif-plugged-0a2076a0-d9a0-4c09-9fcd-68011828f5e0 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c60b4ae6-f92b-4789-a047-aaded90465c6 req-e3f2e623-dee5-41f6-bea8-7c555afce81a service nova] Acquiring lock "5251cef4-9a49-4220-984e-75d1198f95b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c60b4ae6-f92b-4789-a047-aaded90465c6 req-e3f2e623-dee5-41f6-bea8-7c555afce81a service nova] Lock "5251cef4-9a49-4220-984e-75d1198f95b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c60b4ae6-f92b-4789-a047-aaded90465c6 req-e3f2e623-dee5-41f6-bea8-7c555afce81a service nova] Lock "5251cef4-9a49-4220-984e-75d1198f95b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:28 user nova-compute[72809]: DEBUG nova.compute.manager [req-c60b4ae6-f92b-4789-a047-aaded90465c6 req-e3f2e623-dee5-41f6-bea8-7c555afce81a service nova] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] No waiting events found dispatching network-vif-plugged-0a2076a0-d9a0-4c09-9fcd-68011828f5e0 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:55:28 user nova-compute[72809]: WARNING nova.compute.manager [req-c60b4ae6-f92b-4789-a047-aaded90465c6 req-e3f2e623-dee5-41f6-bea8-7c555afce81a service nova] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Received unexpected event network-vif-plugged-0a2076a0-d9a0-4c09-9fcd-68011828f5e0 for instance with vm_state active and task_state None.
Aug 09 06:55:28 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:55:29 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:55:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:29 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 06:55:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:30 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 06:55:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:31 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:31 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:31 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:31 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:31 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:31 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 06:55:31 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 06:55:31 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 06:55:31 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:31 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:31 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:31 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:32 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:55:32 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:55:32 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=7804MB free_disk=25.484050750732422GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 06:55:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:32 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 24ba9b41-d0bf-4a84-9f04-bfda9525b154 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:55:32 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 3640991e-8a5b-4674-af81-3117d4269a68 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:55:32 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 15dda080-3487-4316-ab7b-f7185f0a4519 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:55:32 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:55:32 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 336770eb-4f09-4134-92ef-f96039bf4fa9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:55:32 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance f69df9a2-e8ed-4bec-8c01-cd005432a373 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:55:32 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 5251cef4-9a49-4220-984e-75d1198f95b6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:55:32 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 06:55:32 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 06:55:32 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:55:32 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:55:32 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 06:55:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.360s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:33 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:55:33 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 06:55:33 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Didn't find any instances for network info cache update. {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 06:55:33 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:55:33 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:55:33 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:55:33 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:55:33 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 06:55:34 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:35 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:55:35 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:55:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:42 user nova-compute[72809]: DEBUG nova.compute.manager [req-76336ce5-09a7-43ae-802b-ac8e7df5169b req-76aa7a58-50d1-4a41-83a8-cffe0ec6a41c service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-changed-a54c2c6b-acf2-43b8-b6cd-314710baa6fb {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:42 user nova-compute[72809]: DEBUG nova.compute.manager [req-76336ce5-09a7-43ae-802b-ac8e7df5169b req-76aa7a58-50d1-4a41-83a8-cffe0ec6a41c service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Refreshing instance network info cache due to event network-changed-a54c2c6b-acf2-43b8-b6cd-314710baa6fb. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:55:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-76336ce5-09a7-43ae-802b-ac8e7df5169b req-76aa7a58-50d1-4a41-83a8-cffe0ec6a41c service nova] Acquiring lock "refresh_cache-f69df9a2-e8ed-4bec-8c01-cd005432a373" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:55:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-76336ce5-09a7-43ae-802b-ac8e7df5169b req-76aa7a58-50d1-4a41-83a8-cffe0ec6a41c service nova] Acquired lock "refresh_cache-f69df9a2-e8ed-4bec-8c01-cd005432a373" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:55:42 user nova-compute[72809]: DEBUG nova.network.neutron [req-76336ce5-09a7-43ae-802b-ac8e7df5169b req-76aa7a58-50d1-4a41-83a8-cffe0ec6a41c service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Refreshing network info cache for port a54c2c6b-acf2-43b8-b6cd-314710baa6fb {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:55:43 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:43 user nova-compute[72809]: DEBUG nova.network.neutron [req-76336ce5-09a7-43ae-802b-ac8e7df5169b req-76aa7a58-50d1-4a41-83a8-cffe0ec6a41c service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Updated VIF entry in instance network info cache for port a54c2c6b-acf2-43b8-b6cd-314710baa6fb. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:55:43 user nova-compute[72809]: DEBUG nova.network.neutron [req-76336ce5-09a7-43ae-802b-ac8e7df5169b req-76aa7a58-50d1-4a41-83a8-cffe0ec6a41c service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Updating instance_info_cache with network_info: [{"id": "a54c2c6b-acf2-43b8-b6cd-314710baa6fb", "address": "fa:16:3e:68:e2:17", "network": {"id": "8bb81854-eb04-46fe-99b4-dcd0b0f6845f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-129357522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54c2c6b-ac", "ovs_interfaceid": "a54c2c6b-acf2-43b8-b6cd-314710baa6fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1db9e576-a5f0-40ac-8bf6-181eec5c2d85", "address": "fa:16:3e:3b:48:01", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db9e576-a5", "ovs_interfaceid": "1db9e576-a5f0-40ac-8bf6-181eec5c2d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a076857-c138-4c63-955c-e3a9396f825f", "address": "fa:16:3e:51:09:9b", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a076857-c1", "ovs_interfaceid": "4a076857-c138-4c63-955c-e3a9396f825f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773", "address": "fa:16:3e:76:c8:43", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbbcf7b-60", "ovs_interfaceid": "8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "264f2093-5827-43e1-80a4-1a9190478f3f", "address": "fa:16:3e:3c:31:50", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264f2093-58", "ovs_interfaceid": "264f2093-5827-43e1-80a4-1a9190478f3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "153083da-b420-4260-ae35-edae5a4d37b8", "address": "fa:16:3e:2c:4b:aa", "network": {"id": "f6db78c1-51ff-449e-89e2-5b5f3df83e93", "bridge": "br-int", "label": "tempest-device-tagging-net2-538371520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153083da-b4", "ovs_interfaceid": "153083da-b420-4260-ae35-edae5a4d37b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6231c01e-c6ec-4103-8899-4cb730945ad0", "address": "fa:16:3e:ca:40:34", "network": {"id": "f6db78c1-51ff-449e-89e2-5b5f3df83e93", "bridge": "br-int", "label": "tempest-device-tagging-net2-538371520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6231c01e-c6", "ovs_interfaceid": "6231c01e-c6ec-4103-8899-4cb730945ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:55:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-76336ce5-09a7-43ae-802b-ac8e7df5169b req-76aa7a58-50d1-4a41-83a8-cffe0ec6a41c service nova] Releasing lock "refresh_cache-f69df9a2-e8ed-4bec-8c01-cd005432a373" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:55:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Acquiring lock "f69df9a2-e8ed-4bec-8c01-cd005432a373" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Acquiring lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:45 user nova-compute[72809]: INFO nova.compute.manager [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Terminating instance
Aug 09 06:55:45 user nova-compute[72809]: DEBUG nova.compute.manager [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 06:55:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:45 user nova-compute[72809]: DEBUG nova.compute.manager [req-ec8abf34-000b-4340-aee2-33e78260126d req-e01ce58b-3af7-4177-b8ce-1488bd1e880c service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-unplugged-a54c2c6b-acf2-43b8-b6cd-314710baa6fb {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ec8abf34-000b-4340-aee2-33e78260126d req-e01ce58b-3af7-4177-b8ce-1488bd1e880c service nova] Acquiring lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ec8abf34-000b-4340-aee2-33e78260126d req-e01ce58b-3af7-4177-b8ce-1488bd1e880c service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ec8abf34-000b-4340-aee2-33e78260126d req-e01ce58b-3af7-4177-b8ce-1488bd1e880c service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:45 user nova-compute[72809]: DEBUG nova.compute.manager [req-ec8abf34-000b-4340-aee2-33e78260126d req-e01ce58b-3af7-4177-b8ce-1488bd1e880c service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] No waiting events found dispatching network-vif-unplugged-a54c2c6b-acf2-43b8-b6cd-314710baa6fb {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:55:45 user nova-compute[72809]: DEBUG nova.compute.manager [req-ec8abf34-000b-4340-aee2-33e78260126d req-e01ce58b-3af7-4177-b8ce-1488bd1e880c service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-unplugged-a54c2c6b-acf2-43b8-b6cd-314710baa6fb for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 06:55:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:45 user nova-compute[72809]: DEBUG nova.compute.manager [req-246c99c3-a362-4fdc-b1a2-111360f3fed0 req-1e474f9d-6269-4afe-bea7-ae7ee43a4ecf service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-unplugged-1db9e576-a5f0-40ac-8bf6-181eec5c2d85 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-246c99c3-a362-4fdc-b1a2-111360f3fed0 req-1e474f9d-6269-4afe-bea7-ae7ee43a4ecf service nova] Acquiring lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-246c99c3-a362-4fdc-b1a2-111360f3fed0 req-1e474f9d-6269-4afe-bea7-ae7ee43a4ecf service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-246c99c3-a362-4fdc-b1a2-111360f3fed0 req-1e474f9d-6269-4afe-bea7-ae7ee43a4ecf service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:45 user nova-compute[72809]: DEBUG nova.compute.manager [req-246c99c3-a362-4fdc-b1a2-111360f3fed0 req-1e474f9d-6269-4afe-bea7-ae7ee43a4ecf service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] No waiting events found dispatching network-vif-unplugged-1db9e576-a5f0-40ac-8bf6-181eec5c2d85 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:55:45 user nova-compute[72809]: DEBUG nova.compute.manager [req-246c99c3-a362-4fdc-b1a2-111360f3fed0 req-1e474f9d-6269-4afe-bea7-ae7ee43a4ecf service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-unplugged-1db9e576-a5f0-40ac-8bf6-181eec5c2d85 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 06:55:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:46 user nova-compute[72809]: DEBUG nova.compute.manager [req-7f2c3de3-feda-475e-9760-14c1d65ad5c9 req-1f9f43c3-848c-408a-ac93-7a320caa0074 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-unplugged-153083da-b420-4260-ae35-edae5a4d37b8 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7f2c3de3-feda-475e-9760-14c1d65ad5c9 req-1f9f43c3-848c-408a-ac93-7a320caa0074 service nova] Acquiring lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7f2c3de3-feda-475e-9760-14c1d65ad5c9 req-1f9f43c3-848c-408a-ac93-7a320caa0074 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7f2c3de3-feda-475e-9760-14c1d65ad5c9 req-1f9f43c3-848c-408a-ac93-7a320caa0074 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:46 user nova-compute[72809]: DEBUG nova.compute.manager [req-7f2c3de3-feda-475e-9760-14c1d65ad5c9 req-1f9f43c3-848c-408a-ac93-7a320caa0074 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] No waiting events found dispatching network-vif-unplugged-153083da-b420-4260-ae35-edae5a4d37b8 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:55:46 user nova-compute[72809]: DEBUG nova.compute.manager [req-7f2c3de3-feda-475e-9760-14c1d65ad5c9 req-1f9f43c3-848c-408a-ac93-7a320caa0074 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-unplugged-153083da-b420-4260-ae35-edae5a4d37b8 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 06:55:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:47 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Instance destroyed successfully.
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.objects.instance [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Lazy-loading 'resources' on Instance uuid f69df9a2-e8ed-4bec-8c01-cd005432a373 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:53:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802868567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802868567',id=17,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7vsFRH8+QDNzfaJco48VmChAa1NTjfgrxrKV+K3cyOBxdBmpRm8dtdBfKusTNZw+eF3Jox4xjZZl93GKy+irR0T4OrQJ5DlVZ2As7Kz7Ef5hFmacrwCFHQpY+LYq12Wg==',key_name='tempest-keypair-1117604385',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:54:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71b6463729fb40a7ae708ac0f188263b',ramdisk_id='',reservation_id='r-24nqzfoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1529004159',owner_user_name='tempest-TaggedBootDevicesTest-1529004159-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:54:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99e1c9eec3e6402482269c9878ac9987',uuid=f69df9a2-e8ed-4bec-8c01-cd005432a373,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a54c2c6b-acf2-43b8-b6cd-314710baa6fb", "address": "fa:16:3e:68:e2:17", "network": {"id": "8bb81854-eb04-46fe-99b4-dcd0b0f6845f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-129357522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54c2c6b-ac", "ovs_interfaceid": "a54c2c6b-acf2-43b8-b6cd-314710baa6fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converting VIF {"id": "a54c2c6b-acf2-43b8-b6cd-314710baa6fb", "address": "fa:16:3e:68:e2:17", "network": {"id": "8bb81854-eb04-46fe-99b4-dcd0b0f6845f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-129357522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54c2c6b-ac", "ovs_interfaceid": "a54c2c6b-acf2-43b8-b6cd-314710baa6fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:e2:17,bridge_name='br-int',has_traffic_filtering=True,id=a54c2c6b-acf2-43b8-b6cd-314710baa6fb,network=Network(8bb81854-eb04-46fe-99b4-dcd0b0f6845f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54c2c6b-ac') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_vif [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:e2:17,bridge_name='br-int',has_traffic_filtering=True,id=a54c2c6b-acf2-43b8-b6cd-314710baa6fb,network=Network(8bb81854-eb04-46fe-99b4-dcd0b0f6845f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54c2c6b-ac') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa54c2c6b-ac, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:47 user nova-compute[72809]: INFO os_vif [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:e2:17,bridge_name='br-int',has_traffic_filtering=True,id=a54c2c6b-acf2-43b8-b6cd-314710baa6fb,network=Network(8bb81854-eb04-46fe-99b4-dcd0b0f6845f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54c2c6b-ac')
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:53:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802868567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802868567',id=17,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7vsFRH8+QDNzfaJco48VmChAa1NTjfgrxrKV+K3cyOBxdBmpRm8dtdBfKusTNZw+eF3Jox4xjZZl93GKy+irR0T4OrQJ5DlVZ2As7Kz7Ef5hFmacrwCFHQpY+LYq12Wg==',key_name='tempest-keypair-1117604385',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:54:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71b6463729fb40a7ae708ac0f188263b',ramdisk_id='',reservation_id='r-24nqzfoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1529004159',owner_user_name='tempest-TaggedBootDevicesTest-1529004159-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:54:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99e1c9eec3e6402482269c9878ac9987',uuid=f69df9a2-e8ed-4bec-8c01-cd005432a373,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1db9e576-a5f0-40ac-8bf6-181eec5c2d85", "address": "fa:16:3e:3b:48:01", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db9e576-a5", "ovs_interfaceid": "1db9e576-a5f0-40ac-8bf6-181eec5c2d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converting VIF {"id": "1db9e576-a5f0-40ac-8bf6-181eec5c2d85", "address": "fa:16:3e:3b:48:01", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db9e576-a5", "ovs_interfaceid": "1db9e576-a5f0-40ac-8bf6-181eec5c2d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:48:01,bridge_name='br-int',has_traffic_filtering=True,id=1db9e576-a5f0-40ac-8bf6-181eec5c2d85,network=Network(201c59b3-f13e-4692-9b61-8cc4c753b3af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1db9e576-a5') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_vif [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:48:01,bridge_name='br-int',has_traffic_filtering=True,id=1db9e576-a5f0-40ac-8bf6-181eec5c2d85,network=Network(201c59b3-f13e-4692-9b61-8cc4c753b3af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1db9e576-a5') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1db9e576-a5, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:47 user nova-compute[72809]: INFO os_vif [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:48:01,bridge_name='br-int',has_traffic_filtering=True,id=1db9e576-a5f0-40ac-8bf6-181eec5c2d85,network=Network(201c59b3-f13e-4692-9b61-8cc4c753b3af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1db9e576-a5')
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:53:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802868567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802868567',id=17,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7vsFRH8+QDNzfaJco48VmChAa1NTjfgrxrKV+K3cyOBxdBmpRm8dtdBfKusTNZw+eF3Jox4xjZZl93GKy+irR0T4OrQJ5DlVZ2As7Kz7Ef5hFmacrwCFHQpY+LYq12Wg==',key_name='tempest-keypair-1117604385',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:54:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71b6463729fb40a7ae708ac0f188263b',ramdisk_id='',reservation_id='r-24nqzfoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1529004159',owner_user_name='tempest-TaggedBootDevicesTest-1529004159-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:54:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99e1c9eec3e6402482269c9878ac9987',uuid=f69df9a2-e8ed-4bec-8c01-cd005432a373,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a076857-c138-4c63-955c-e3a9396f825f", "address": "fa:16:3e:51:09:9b", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a076857-c1", "ovs_interfaceid": "4a076857-c138-4c63-955c-e3a9396f825f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converting VIF {"id": "4a076857-c138-4c63-955c-e3a9396f825f", "address": "fa:16:3e:51:09:9b", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a076857-c1", "ovs_interfaceid": "4a076857-c138-4c63-955c-e3a9396f825f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:09:9b,bridge_name='br-int',has_traffic_filtering=True,id=4a076857-c138-4c63-955c-e3a9396f825f,network=Network(201c59b3-f13e-4692-9b61-8cc4c753b3af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4a076857-c1') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_vif [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:09:9b,bridge_name='br-int',has_traffic_filtering=True,id=4a076857-c138-4c63-955c-e3a9396f825f,network=Network(201c59b3-f13e-4692-9b61-8cc4c753b3af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4a076857-c1') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a076857-c1, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:47 user nova-compute[72809]: INFO os_vif [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:09:9b,bridge_name='br-int',has_traffic_filtering=True,id=4a076857-c138-4c63-955c-e3a9396f825f,network=Network(201c59b3-f13e-4692-9b61-8cc4c753b3af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4a076857-c1')
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:53:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802868567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802868567',id=17,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7vsFRH8+QDNzfaJco48VmChAa1NTjfgrxrKV+K3cyOBxdBmpRm8dtdBfKusTNZw+eF3Jox4xjZZl93GKy+irR0T4OrQJ5DlVZ2As7Kz7Ef5hFmacrwCFHQpY+LYq12Wg==',key_name='tempest-keypair-1117604385',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:54:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71b6463729fb40a7ae708ac0f188263b',ramdisk_id='',reservation_id='r-24nqzfoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1529004159',owner_user_name='tempest-TaggedBootDevicesTest-1529004159-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:54:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99e1c9eec3e6402482269c9878ac9987',uuid=f69df9a2-e8ed-4bec-8c01-cd005432a373,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773", "address": "fa:16:3e:76:c8:43", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbbcf7b-60", "ovs_interfaceid": "8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converting VIF {"id": "8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773", "address": "fa:16:3e:76:c8:43", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbbcf7b-60", "ovs_interfaceid": "8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:c8:43,bridge_name='br-int',has_traffic_filtering=True,id=8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773,network=Network(201c59b3-f13e-4692-9b61-8cc4c753b3af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbbcf7b-60') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_vif [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:c8:43,bridge_name='br-int',has_traffic_filtering=True,id=8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773,network=Network(201c59b3-f13e-4692-9b61-8cc4c753b3af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbbcf7b-60') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fbbcf7b-60, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:47 user nova-compute[72809]: INFO os_vif [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:c8:43,bridge_name='br-int',has_traffic_filtering=True,id=8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773,network=Network(201c59b3-f13e-4692-9b61-8cc4c753b3af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbbcf7b-60')
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:53:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802868567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802868567',id=17,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7vsFRH8+QDNzfaJco48VmChAa1NTjfgrxrKV+K3cyOBxdBmpRm8dtdBfKusTNZw+eF3Jox4xjZZl93GKy+irR0T4OrQJ5DlVZ2As7Kz7Ef5hFmacrwCFHQpY+LYq12Wg==',key_name='tempest-keypair-1117604385',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:54:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71b6463729fb40a7ae708ac0f188263b',ramdisk_id='',reservation_id='r-24nqzfoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1529004159',owner_user_name='tempest-TaggedBootDevicesTest-1529004159-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:54:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99e1c9eec3e6402482269c9878ac9987',uuid=f69df9a2-e8ed-4bec-8c01-cd005432a373,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "264f2093-5827-43e1-80a4-1a9190478f3f", "address": "fa:16:3e:3c:31:50", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264f2093-58", "ovs_interfaceid": "264f2093-5827-43e1-80a4-1a9190478f3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converting VIF {"id": "264f2093-5827-43e1-80a4-1a9190478f3f", "address": "fa:16:3e:3c:31:50", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264f2093-58", "ovs_interfaceid": "264f2093-5827-43e1-80a4-1a9190478f3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:31:50,bridge_name='br-int',has_traffic_filtering=True,id=264f2093-5827-43e1-80a4-1a9190478f3f,network=Network(201c59b3-f13e-4692-9b61-8cc4c753b3af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap264f2093-58') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_vif [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:31:50,bridge_name='br-int',has_traffic_filtering=True,id=264f2093-5827-43e1-80a4-1a9190478f3f,network=Network(201c59b3-f13e-4692-9b61-8cc4c753b3af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap264f2093-58') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap264f2093-58, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:47 user nova-compute[72809]: INFO os_vif [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:31:50,bridge_name='br-int',has_traffic_filtering=True,id=264f2093-5827-43e1-80a4-1a9190478f3f,network=Network(201c59b3-f13e-4692-9b61-8cc4c753b3af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap264f2093-58')
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:53:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802868567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802868567',id=17,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7vsFRH8+QDNzfaJco48VmChAa1NTjfgrxrKV+K3cyOBxdBmpRm8dtdBfKusTNZw+eF3Jox4xjZZl93GKy+irR0T4OrQJ5DlVZ2As7Kz7Ef5hFmacrwCFHQpY+LYq12Wg==',key_name='tempest-keypair-1117604385',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:54:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71b6463729fb40a7ae708ac0f188263b',ramdisk_id='',reservation_id='r-24nqzfoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1529004159',owner_user_name='tempest-TaggedBootDevicesTest-1529004159-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:54:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99e1c9eec3e6402482269c9878ac9987',uuid=f69df9a2-e8ed-4bec-8c01-cd005432a373,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "153083da-b420-4260-ae35-edae5a4d37b8", "address": "fa:16:3e:2c:4b:aa", "network": {"id": "f6db78c1-51ff-449e-89e2-5b5f3df83e93", "bridge": "br-int", "label": "tempest-device-tagging-net2-538371520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153083da-b4", "ovs_interfaceid": "153083da-b420-4260-ae35-edae5a4d37b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converting VIF {"id": "153083da-b420-4260-ae35-edae5a4d37b8", "address": "fa:16:3e:2c:4b:aa", "network": {"id": "f6db78c1-51ff-449e-89e2-5b5f3df83e93", "bridge": "br-int", "label": "tempest-device-tagging-net2-538371520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153083da-b4", "ovs_interfaceid": "153083da-b420-4260-ae35-edae5a4d37b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:4b:aa,bridge_name='br-int',has_traffic_filtering=True,id=153083da-b420-4260-ae35-edae5a4d37b8,network=Network(f6db78c1-51ff-449e-89e2-5b5f3df83e93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap153083da-b4') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_vif [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:4b:aa,bridge_name='br-int',has_traffic_filtering=True,id=153083da-b420-4260-ae35-edae5a4d37b8,network=Network(f6db78c1-51ff-449e-89e2-5b5f3df83e93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap153083da-b4') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap153083da-b4, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:47 user nova-compute[72809]: INFO os_vif [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:4b:aa,bridge_name='br-int',has_traffic_filtering=True,id=153083da-b420-4260-ae35-edae5a4d37b8,network=Network(f6db78c1-51ff-449e-89e2-5b5f3df83e93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap153083da-b4')
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:53:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802868567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802868567',id=17,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7vsFRH8+QDNzfaJco48VmChAa1NTjfgrxrKV+K3cyOBxdBmpRm8dtdBfKusTNZw+eF3Jox4xjZZl93GKy+irR0T4OrQJ5DlVZ2As7Kz7Ef5hFmacrwCFHQpY+LYq12Wg==',key_name='tempest-keypair-1117604385',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:54:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71b6463729fb40a7ae708ac0f188263b',ramdisk_id='',reservation_id='r-24nqzfoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1529004159',owner_user_name='tempest-TaggedBootDevicesTest-1529004159-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:54:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99e1c9eec3e6402482269c9878ac9987',uuid=f69df9a2-e8ed-4bec-8c01-cd005432a373,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6231c01e-c6ec-4103-8899-4cb730945ad0", "address": "fa:16:3e:ca:40:34", "network": {"id": "f6db78c1-51ff-449e-89e2-5b5f3df83e93", "bridge": "br-int", "label": "tempest-device-tagging-net2-538371520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6231c01e-c6", "ovs_interfaceid": "6231c01e-c6ec-4103-8899-4cb730945ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converting VIF {"id": "6231c01e-c6ec-4103-8899-4cb730945ad0", "address": "fa:16:3e:ca:40:34", "network": {"id": "f6db78c1-51ff-449e-89e2-5b5f3df83e93", "bridge": "br-int", "label": "tempest-device-tagging-net2-538371520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6231c01e-c6", "ovs_interfaceid": "6231c01e-c6ec-4103-8899-4cb730945ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:40:34,bridge_name='br-int',has_traffic_filtering=True,id=6231c01e-c6ec-4103-8899-4cb730945ad0,network=Network(f6db78c1-51ff-449e-89e2-5b5f3df83e93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6231c01e-c6') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_vif [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:40:34,bridge_name='br-int',has_traffic_filtering=True,id=6231c01e-c6ec-4103-8899-4cb730945ad0,network=Network(f6db78c1-51ff-449e-89e2-5b5f3df83e93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6231c01e-c6') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6231c01e-c6, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:47 user nova-compute[72809]: INFO os_vif [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:40:34,bridge_name='br-int',has_traffic_filtering=True,id=6231c01e-c6ec-4103-8899-4cb730945ad0,network=Network(f6db78c1-51ff-449e-89e2-5b5f3df83e93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6231c01e-c6')
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KsPeaXqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:55:47 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3b6d48-f9dc-49bf-b2b1-9e82c1cbf535]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d94869a-c316-4a23-aae9-6af62f4355d9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)
Aug 09 06:55:47 user nova-compute[72809]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)
Aug 09 06:55:47 user nova-compute[72809]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)
Aug 09 06:55:47 user nova-compute[72809]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:55:47 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb (non-flash)
Aug 09 06:55:47 user nova-compute[72809]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)
Aug 09 06:55:47 user nova-compute[72809]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)
Aug 09 06:55:47 user nova-compute[72809]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:55:47 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc1386c5900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb'): ({'sde'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Removing single pathed devices sde {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.compute.manager [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-plugged-a54c2c6b-acf2-43b8-b6cd-314710baa6fb {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] Acquiring lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.compute.manager [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] No waiting events found dispatching network-vif-plugged-a54c2c6b-acf2-43b8-b6cd-314710baa6fb {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:55:47 user nova-compute[72809]: WARNING nova.compute.manager [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received unexpected event network-vif-plugged-a54c2c6b-acf2-43b8-b6cd-314710baa6fb for instance with vm_state active and task_state deleting.
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.compute.manager [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-unplugged-8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] Acquiring lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.compute.manager [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] No waiting events found dispatching network-vif-unplugged-8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.compute.manager [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-unplugged-8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.compute.manager [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-plugged-8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] Acquiring lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.compute.manager [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] No waiting events found dispatching network-vif-plugged-8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:55:47 user nova-compute[72809]: WARNING nova.compute.manager [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received unexpected event network-vif-plugged-8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773 for instance with vm_state active and task_state deleting.
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.compute.manager [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-unplugged-264f2093-5827-43e1-80a4-1a9190478f3f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] Acquiring lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.compute.manager [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] No waiting events found dispatching network-vif-unplugged-264f2093-5827-43e1-80a4-1a9190478f3f {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.compute.manager [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-unplugged-264f2093-5827-43e1-80a4-1a9190478f3f for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.compute.manager [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-plugged-264f2093-5827-43e1-80a4-1a9190478f3f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] Acquiring lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.compute.manager [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] No waiting events found dispatching network-vif-plugged-264f2093-5827-43e1-80a4-1a9190478f3f {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:55:47 user nova-compute[72809]: WARNING nova.compute.manager [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received unexpected event network-vif-plugged-264f2093-5827-43e1-80a4-1a9190478f3f for instance with vm_state active and task_state deleting.
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.compute.manager [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-unplugged-6231c01e-c6ec-4103-8899-4cb730945ad0 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] Acquiring lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.compute.manager [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] No waiting events found dispatching network-vif-unplugged-6231c01e-c6ec-4103-8899-4cb730945ad0 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.compute.manager [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-unplugged-6231c01e-c6ec-4103-8899-4cb730945ad0 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.compute.manager [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-plugged-6231c01e-c6ec-4103-8899-4cb730945ad0 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] Acquiring lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.compute.manager [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] No waiting events found dispatching network-vif-plugged-6231c01e-c6ec-4103-8899-4cb730945ad0 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:55:47 user nova-compute[72809]: WARNING nova.compute.manager [req-17330071-0132-4a0a-83fe-38560d1cc512 req-d8d0dbf5-15e1-4d85-a283-7fe408029086 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received unexpected event network-vif-plugged-6231c01e-c6ec-4103-8899-4cb730945ad0 for instance with vm_state active and task_state deleting.
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[164c5f11-69f7-4302-9803-4acb55fdb89d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9f9b14-c764-4b85-abae-7027afe5b9ff]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Flushing IO for device /dev/sde {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb70c476-f368-4593-8aa1-9e890208bce7]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[408c6a73-6287-4a5f-80e7-9c090d2cb8cd]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] SCSI volumes sde have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a3c332-56c3-4fb4-aa11-6a1931ecf835]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.compute.manager [req-0a817d4d-f6eb-4fc2-84e2-74c6a58dea8d req-b1531484-7a7b-4a00-8dae-17a660476404 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-plugged-1db9e576-a5f0-40ac-8bf6-181eec5c2d85 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0a817d4d-f6eb-4fc2-84e2-74c6a58dea8d req-b1531484-7a7b-4a00-8dae-17a660476404 service nova] Acquiring lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0a817d4d-f6eb-4fc2-84e2-74c6a58dea8d req-b1531484-7a7b-4a00-8dae-17a660476404 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0a817d4d-f6eb-4fc2-84e2-74c6a58dea8d req-b1531484-7a7b-4a00-8dae-17a660476404 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.compute.manager [req-0a817d4d-f6eb-4fc2-84e2-74c6a58dea8d req-b1531484-7a7b-4a00-8dae-17a660476404 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] No waiting events found dispatching network-vif-plugged-1db9e576-a5f0-40ac-8bf6-181eec5c2d85 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:55:47 user nova-compute[72809]: WARNING nova.compute.manager [req-0a817d4d-f6eb-4fc2-84e2-74c6a58dea8d req-b1531484-7a7b-4a00-8dae-17a660476404 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received unexpected event network-vif-plugged-1db9e576-a5f0-40ac-8bf6-181eec5c2d85 for instance with vm_state active and task_state deleting.
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.compute.manager [req-0a817d4d-f6eb-4fc2-84e2-74c6a58dea8d req-b1531484-7a7b-4a00-8dae-17a660476404 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-unplugged-4a076857-c138-4c63-955c-e3a9396f825f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0a817d4d-f6eb-4fc2-84e2-74c6a58dea8d req-b1531484-7a7b-4a00-8dae-17a660476404 service nova] Acquiring lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0a817d4d-f6eb-4fc2-84e2-74c6a58dea8d req-b1531484-7a7b-4a00-8dae-17a660476404 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0a817d4d-f6eb-4fc2-84e2-74c6a58dea8d req-b1531484-7a7b-4a00-8dae-17a660476404 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.compute.manager [req-0a817d4d-f6eb-4fc2-84e2-74c6a58dea8d req-b1531484-7a7b-4a00-8dae-17a660476404 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] No waiting events found dispatching network-vif-unplugged-4a076857-c138-4c63-955c-e3a9396f825f {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.compute.manager [req-0a817d4d-f6eb-4fc2-84e2-74c6a58dea8d req-b1531484-7a7b-4a00-8dae-17a660476404 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-unplugged-4a076857-c138-4c63-955c-e3a9396f825f for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.compute.manager [req-0a817d4d-f6eb-4fc2-84e2-74c6a58dea8d req-b1531484-7a7b-4a00-8dae-17a660476404 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-plugged-4a076857-c138-4c63-955c-e3a9396f825f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0a817d4d-f6eb-4fc2-84e2-74c6a58dea8d req-b1531484-7a7b-4a00-8dae-17a660476404 service nova] Acquiring lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0a817d4d-f6eb-4fc2-84e2-74c6a58dea8d req-b1531484-7a7b-4a00-8dae-17a660476404 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0a817d4d-f6eb-4fc2-84e2-74c6a58dea8d req-b1531484-7a7b-4a00-8dae-17a660476404 service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.compute.manager [req-0a817d4d-f6eb-4fc2-84e2-74c6a58dea8d req-b1531484-7a7b-4a00-8dae-17a660476404 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] No waiting events found dispatching network-vif-plugged-4a076857-c138-4c63-955c-e3a9396f825f {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:55:47 user nova-compute[72809]: WARNING nova.compute.manager [req-0a817d4d-f6eb-4fc2-84e2-74c6a58dea8d req-b1531484-7a7b-4a00-8dae-17a660476404 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received unexpected event network-vif-plugged-4a076857-c138-4c63-955c-e3a9396f825f for instance with vm_state active and task_state deleting.
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c27fa9c-7026-4701-8730-ae9c3bc456db]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb, portal: 172.16.0.220,3260]
Aug 09 06:55:47 user nova-compute[72809]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb, portal: 172.16.0.220,3260] successful.
Aug 09 06:55:47 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:607e8c3a-2fac-41e7-98b9-f5dec95d58cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9947fc-d588-4521-824c-535dad30b429]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] <== disconnect_volume: return (324ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYHOxVPf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:55:47 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f23a07b-b7f8-4267-9576-262e4e96954d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4f808c-a0da-4d84-9455-5e918e52cf3c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)
Aug 09 06:55:47 user nova-compute[72809]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)
Aug 09 06:55:47 user nova-compute[72809]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:55:47 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd (non-flash)
Aug 09 06:55:47 user nova-compute[72809]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)
Aug 09 06:55:47 user nova-compute[72809]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:55:47 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc1386c6200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd'): ({'sdf'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Removing single pathed devices sdf {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[337121bd-c84b-4f89-9559-c801c83ab05e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e1bbc7-0447-4b8a-9fce-cea5017c7e9f]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Flushing IO for device /dev/sdf {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe11340-6e88-4391-af9f-f1db65240ab0]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 06:55:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9434b6-87ad-41f0-8bf6-94dce0035e88]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] SCSI volumes sdf have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e017d774-8bf9-4d2f-8d49-9726d8846063]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[770cfc11-3bc0-40ba-b67b-b275537e0ee3]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd, portal: 172.16.0.220,3260]
Aug 09 06:55:48 user nova-compute[72809]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd, portal: 172.16.0.220,3260] successful.
Aug 09 06:55:48 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8b0e7d8-187c-44b9-a029-076cfd62a9dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c89bc73-99e0-4a0f-aea8-e9b2cc997019]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] <== disconnect_volume: return (286ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kfOpFoZn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:55:48 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:55:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbaa4b48-7f4f-4868-be88-dff7693a1856]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4e1b84-c51a-4f71-bc30-af406e904bc4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)
Aug 09 06:55:48 user nova-compute[72809]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:55:48 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce (non-flash)
Aug 09 06:55:48 user nova-compute[72809]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:55:48 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc158328670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce'): ({'sdg'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Removing single pathed devices sdg {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02036fa-1287-438b-a22a-ea0008659118]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6afdc1-92ba-4b11-88f9-28245c0ecbe0]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Flushing IO for device /dev/sdg {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cc57b2-52a5-4d12-906d-92ae94da1e2c]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b44983d-7135-4074-addc-7ecb84b5354a]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] SCSI volumes sdg have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[977b253e-23cd-4e34-80e0-3b9e11bcb245]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG nova.compute.manager [req-83a5a646-0a2d-460e-80d9-6d1aac979c00 req-80fdca21-3578-4418-8957-63fd800f584d service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-plugged-153083da-b420-4260-ae35-edae5a4d37b8 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-83a5a646-0a2d-460e-80d9-6d1aac979c00 req-80fdca21-3578-4418-8957-63fd800f584d service nova] Acquiring lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-83a5a646-0a2d-460e-80d9-6d1aac979c00 req-80fdca21-3578-4418-8957-63fd800f584d service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-83a5a646-0a2d-460e-80d9-6d1aac979c00 req-80fdca21-3578-4418-8957-63fd800f584d service nova] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG nova.compute.manager [req-83a5a646-0a2d-460e-80d9-6d1aac979c00 req-80fdca21-3578-4418-8957-63fd800f584d service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] No waiting events found dispatching network-vif-plugged-153083da-b420-4260-ae35-edae5a4d37b8 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:55:48 user nova-compute[72809]: WARNING nova.compute.manager [req-83a5a646-0a2d-460e-80d9-6d1aac979c00 req-80fdca21-3578-4418-8957-63fd800f584d service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received unexpected event network-vif-plugged-153083da-b420-4260-ae35-edae5a4d37b8 for instance with vm_state active and task_state deleting.
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5820b60-4008-40e5-8e04-456b3cc6e29a]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce, portal: 172.16.0.220,3260]
Aug 09 06:55:48 user nova-compute[72809]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce, portal: 172.16.0.220,3260] successful.
Aug 09 06:55:48 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff653a94-36f6-4aff-9f9b-aca88282c8ce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[117029aa-b3ee-470e-9abc-c83829dc04cc]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] <== disconnect_volume: return (301ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 06:55:48 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Deleting instance files /opt/stack/data/nova/instances/f69df9a2-e8ed-4bec-8c01-cd005432a373_del
Aug 09 06:55:48 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Deletion of /opt/stack/data/nova/instances/f69df9a2-e8ed-4bec-8c01-cd005432a373_del complete
Aug 09 06:55:48 user nova-compute[72809]: INFO nova.compute.manager [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Took 3.25 seconds to destroy the instance on the hypervisor.
Aug 09 06:55:48 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 06:55:48 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 06:55:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:49 user nova-compute[72809]: INFO nova.compute.manager [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Unshelving
Aug 09 06:55:49 user nova-compute[72809]: INFO nova.virt.block_device [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Booting with volume ed384adf-9851-4d4f-9ca4-998e3b064a44 at /dev/vdc
Aug 09 06:55:49 user nova-compute[72809]: DEBUG os_brick.utils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:55:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:49 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a03fd9-574e-4c4b-b572-2e349aa371a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:49 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d843f85d-0ae6-402d-9949-9d6ab76753fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:55:49 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d0ad98-5c6b-4ce2-b337-0ff28558bf30]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:49 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f358e19c-e7bc-40c5-83e5-c93673c302d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:55:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 06:55:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:55:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:55:49 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 06:55:49 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6359f07-483f-4aef-82cd-f1c5303cfa6d]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:55:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 06:55:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 06:55:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 06:55:49 user nova-compute[72809]: DEBUG os_brick.utils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:55:49 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Updating existing volume attachment record: e4b2e89f-0b62-4094-a5a9-5b97b5df31d2 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 06:55:50 user nova-compute[72809]: DEBUG nova.compute.manager [req-e1ad2904-05e2-40c1-a442-ffeef8786a39 req-42e6c4b2-6c9b-4881-b33e-22a6ccb6b62f service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-deleted-6231c01e-c6ec-4103-8899-4cb730945ad0 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:50 user nova-compute[72809]: INFO nova.compute.manager [req-e1ad2904-05e2-40c1-a442-ffeef8786a39 req-42e6c4b2-6c9b-4881-b33e-22a6ccb6b62f service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Neutron deleted interface 6231c01e-c6ec-4103-8899-4cb730945ad0; detaching it from the instance and deleting it from the info cache
Aug 09 06:55:50 user nova-compute[72809]: DEBUG nova.network.neutron [req-e1ad2904-05e2-40c1-a442-ffeef8786a39 req-42e6c4b2-6c9b-4881-b33e-22a6ccb6b62f service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Updating instance_info_cache with network_info: [{"id": "a54c2c6b-acf2-43b8-b6cd-314710baa6fb", "address": "fa:16:3e:68:e2:17", "network": {"id": "8bb81854-eb04-46fe-99b4-dcd0b0f6845f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-129357522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54c2c6b-ac", "ovs_interfaceid": "a54c2c6b-acf2-43b8-b6cd-314710baa6fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1db9e576-a5f0-40ac-8bf6-181eec5c2d85", "address": "fa:16:3e:3b:48:01", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db9e576-a5", "ovs_interfaceid": "1db9e576-a5f0-40ac-8bf6-181eec5c2d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a076857-c138-4c63-955c-e3a9396f825f", "address": "fa:16:3e:51:09:9b", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a076857-c1", "ovs_interfaceid": "4a076857-c138-4c63-955c-e3a9396f825f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773", "address": "fa:16:3e:76:c8:43", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbbcf7b-60", "ovs_interfaceid": "8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "264f2093-5827-43e1-80a4-1a9190478f3f", "address": "fa:16:3e:3c:31:50", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264f2093-58", "ovs_interfaceid": "264f2093-5827-43e1-80a4-1a9190478f3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "153083da-b420-4260-ae35-edae5a4d37b8", "address": "fa:16:3e:2c:4b:aa", "network": {"id": "f6db78c1-51ff-449e-89e2-5b5f3df83e93", "bridge": "br-int", "label": "tempest-device-tagging-net2-538371520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153083da-b4", "ovs_interfaceid": "153083da-b420-4260-ae35-edae5a4d37b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:55:50 user nova-compute[72809]: DEBUG nova.compute.manager [req-e1ad2904-05e2-40c1-a442-ffeef8786a39 req-42e6c4b2-6c9b-4881-b33e-22a6ccb6b62f service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Detach interface failed, port_id=6231c01e-c6ec-4103-8899-4cb730945ad0, reason: Instance f69df9a2-e8ed-4bec-8c01-cd005432a373 could not be found. {{(pid=72809) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 06:55:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-dcc631ba-02bd-4068-a704-92c2b8ec4992 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Acquiring lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-dcc631ba-02bd-4068-a704-92c2b8ec4992 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-dcc631ba-02bd-4068-a704-92c2b8ec4992 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Acquiring lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-dcc631ba-02bd-4068-a704-92c2b8ec4992 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-dcc631ba-02bd-4068-a704-92c2b8ec4992 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:51 user nova-compute[72809]: INFO nova.compute.manager [None req-dcc631ba-02bd-4068-a704-92c2b8ec4992 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Terminating instance
Aug 09 06:55:51 user nova-compute[72809]: DEBUG nova.compute.manager [None req-dcc631ba-02bd-4068-a704-92c2b8ec4992 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 06:55:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6921a5e6-20fc-4cfc-a98d-65400165b3f2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Acquiring lock "3640991e-8a5b-4674-af81-3117d4269a68" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6921a5e6-20fc-4cfc-a98d-65400165b3f2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "3640991e-8a5b-4674-af81-3117d4269a68" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6921a5e6-20fc-4cfc-a98d-65400165b3f2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Acquiring lock "3640991e-8a5b-4674-af81-3117d4269a68-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6921a5e6-20fc-4cfc-a98d-65400165b3f2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6921a5e6-20fc-4cfc-a98d-65400165b3f2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:51 user nova-compute[72809]: INFO nova.compute.manager [None req-6921a5e6-20fc-4cfc-a98d-65400165b3f2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Terminating instance
Aug 09 06:55:51 user nova-compute[72809]: DEBUG nova.compute.manager [None req-6921a5e6-20fc-4cfc-a98d-65400165b3f2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 06:55:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG nova.compute.manager [req-1235856e-f2da-4b47-9598-9f9fe4074994 req-57b81811-36f2-4aac-ad51-05cfe7be18b6 service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Received event network-vif-unplugged-947db6ff-ed42-4aca-a543-a929517ae8e4 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1235856e-f2da-4b47-9598-9f9fe4074994 req-57b81811-36f2-4aac-ad51-05cfe7be18b6 service nova] Acquiring lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1235856e-f2da-4b47-9598-9f9fe4074994 req-57b81811-36f2-4aac-ad51-05cfe7be18b6 service nova] Lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1235856e-f2da-4b47-9598-9f9fe4074994 req-57b81811-36f2-4aac-ad51-05cfe7be18b6 service nova] Lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG nova.compute.manager [req-1235856e-f2da-4b47-9598-9f9fe4074994 req-57b81811-36f2-4aac-ad51-05cfe7be18b6 service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] No waiting events found dispatching network-vif-unplugged-947db6ff-ed42-4aca-a543-a929517ae8e4 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG nova.compute.manager [req-1235856e-f2da-4b47-9598-9f9fe4074994 req-57b81811-36f2-4aac-ad51-05cfe7be18b6 service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Received event network-vif-unplugged-947db6ff-ed42-4aca-a543-a929517ae8e4 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG nova.compute.manager [req-bc7f7f7c-b67b-40f2-a124-e674b0ed1b08 req-8f54ced1-6f5e-4315-b56e-ef68cc8b83b8 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-deleted-8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:52 user nova-compute[72809]: INFO nova.compute.manager [req-bc7f7f7c-b67b-40f2-a124-e674b0ed1b08 req-8f54ced1-6f5e-4315-b56e-ef68cc8b83b8 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Neutron deleted interface 8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773; detaching it from the instance and deleting it from the info cache
Aug 09 06:55:52 user nova-compute[72809]: DEBUG nova.network.neutron [req-bc7f7f7c-b67b-40f2-a124-e674b0ed1b08 req-8f54ced1-6f5e-4315-b56e-ef68cc8b83b8 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Updating instance_info_cache with network_info: [{"id": "a54c2c6b-acf2-43b8-b6cd-314710baa6fb", "address": "fa:16:3e:68:e2:17", "network": {"id": "8bb81854-eb04-46fe-99b4-dcd0b0f6845f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-129357522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54c2c6b-ac", "ovs_interfaceid": "a54c2c6b-acf2-43b8-b6cd-314710baa6fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1db9e576-a5f0-40ac-8bf6-181eec5c2d85", "address": "fa:16:3e:3b:48:01", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db9e576-a5", "ovs_interfaceid": "1db9e576-a5f0-40ac-8bf6-181eec5c2d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a076857-c138-4c63-955c-e3a9396f825f", "address": "fa:16:3e:51:09:9b", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a076857-c1", "ovs_interfaceid": "4a076857-c138-4c63-955c-e3a9396f825f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "264f2093-5827-43e1-80a4-1a9190478f3f", "address": "fa:16:3e:3c:31:50", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264f2093-58", "ovs_interfaceid": "264f2093-5827-43e1-80a4-1a9190478f3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "153083da-b420-4260-ae35-edae5a4d37b8", "address": "fa:16:3e:2c:4b:aa", "network": {"id": "f6db78c1-51ff-449e-89e2-5b5f3df83e93", "bridge": "br-int", "label": "tempest-device-tagging-net2-538371520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153083da-b4", "ovs_interfaceid": "153083da-b420-4260-ae35-edae5a4d37b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG nova.compute.manager [req-bc7f7f7c-b67b-40f2-a124-e674b0ed1b08 req-8f54ced1-6f5e-4315-b56e-ef68cc8b83b8 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Detach interface failed, port_id=8fbbcf7b-60a7-444c-8c8e-d27f4e6f7773, reason: Instance f69df9a2-e8ed-4bec-8c01-cd005432a373 could not be found. {{(pid=72809) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG nova.compute.manager [req-bc7f7f7c-b67b-40f2-a124-e674b0ed1b08 req-8f54ced1-6f5e-4315-b56e-ef68cc8b83b8 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received event network-vif-unplugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-bc7f7f7c-b67b-40f2-a124-e674b0ed1b08 req-8f54ced1-6f5e-4315-b56e-ef68cc8b83b8 service nova] Acquiring lock "3640991e-8a5b-4674-af81-3117d4269a68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-bc7f7f7c-b67b-40f2-a124-e674b0ed1b08 req-8f54ced1-6f5e-4315-b56e-ef68cc8b83b8 service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-bc7f7f7c-b67b-40f2-a124-e674b0ed1b08 req-8f54ced1-6f5e-4315-b56e-ef68cc8b83b8 service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG nova.compute.manager [req-bc7f7f7c-b67b-40f2-a124-e674b0ed1b08 req-8f54ced1-6f5e-4315-b56e-ef68cc8b83b8 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] No waiting events found dispatching network-vif-unplugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG nova.compute.manager [req-bc7f7f7c-b67b-40f2-a124-e674b0ed1b08 req-8f54ced1-6f5e-4315-b56e-ef68cc8b83b8 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received event network-vif-unplugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG nova.compute.manager [req-bc7f7f7c-b67b-40f2-a124-e674b0ed1b08 req-8f54ced1-6f5e-4315-b56e-ef68cc8b83b8 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-deleted-a54c2c6b-acf2-43b8-b6cd-314710baa6fb {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:52 user nova-compute[72809]: INFO nova.compute.manager [req-bc7f7f7c-b67b-40f2-a124-e674b0ed1b08 req-8f54ced1-6f5e-4315-b56e-ef68cc8b83b8 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Neutron deleted interface a54c2c6b-acf2-43b8-b6cd-314710baa6fb; detaching it from the instance and deleting it from the info cache
Aug 09 06:55:52 user nova-compute[72809]: DEBUG nova.network.neutron [req-bc7f7f7c-b67b-40f2-a124-e674b0ed1b08 req-8f54ced1-6f5e-4315-b56e-ef68cc8b83b8 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Updating instance_info_cache with network_info: [{"id": "1db9e576-a5f0-40ac-8bf6-181eec5c2d85", "address": "fa:16:3e:3b:48:01", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db9e576-a5", "ovs_interfaceid": "1db9e576-a5f0-40ac-8bf6-181eec5c2d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a076857-c138-4c63-955c-e3a9396f825f", "address": "fa:16:3e:51:09:9b", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a076857-c1", "ovs_interfaceid": "4a076857-c138-4c63-955c-e3a9396f825f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "264f2093-5827-43e1-80a4-1a9190478f3f", "address": "fa:16:3e:3c:31:50", "network": {"id": "201c59b3-f13e-4692-9b61-8cc4c753b3af", "bridge": "br-int", "label": "tempest-device-tagging-net1-1866681314", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264f2093-58", "ovs_interfaceid": "264f2093-5827-43e1-80a4-1a9190478f3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "153083da-b420-4260-ae35-edae5a4d37b8", "address": "fa:16:3e:2c:4b:aa", "network": {"id": "f6db78c1-51ff-449e-89e2-5b5f3df83e93", "bridge": "br-int", "label": "tempest-device-tagging-net2-538371520", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b6463729fb40a7ae708ac0f188263b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153083da-b4", "ovs_interfaceid": "153083da-b420-4260-ae35-edae5a4d37b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG nova.compute.manager [req-bc7f7f7c-b67b-40f2-a124-e674b0ed1b08 req-8f54ced1-6f5e-4315-b56e-ef68cc8b83b8 service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Detach interface failed, port_id=a54c2c6b-acf2-43b8-b6cd-314710baa6fb, reason: Instance f69df9a2-e8ed-4bec-8c01-cd005432a373 could not be found. {{(pid=72809) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:52 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Instance destroyed successfully.
Aug 09 06:55:52 user nova-compute[72809]: DEBUG nova.objects.instance [None req-dcc631ba-02bd-4068-a704-92c2b8ec4992 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lazy-loading 'resources' on Instance uuid c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:55:52 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Instance destroyed successfully.
Aug 09 06:55:52 user nova-compute[72809]: DEBUG nova.objects.instance [None req-6921a5e6-20fc-4cfc-a98d-65400165b3f2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lazy-loading 'resources' on Instance uuid 3640991e-8a5b-4674-af81-3117d4269a68 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-dcc631ba-02bd-4068-a704-92c2b8ec4992 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T06:52:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1988221204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1988221204',id=14,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPK9vq6/OkHd2yVdt3nXYH448++2AjnbM8TBYy+YeBzYamc/s5ulP19NzFTO2SUzL2nV3SSIjRSpQ5e91AAsiRiFQ7Uv2icWJyZYAAM4/eghMaXNHw3fgBL4murRC+Qesw==',key_name='tempest-keypair-387388256',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:52:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f46d46622964063ba2425358469a36f',ramdisk_id='',reservation_id='r-8bvspqp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-722644131',owner_user_name='tempest-TaggedAttachmentsTest-722644131-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:52:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7924f8e3d85440b9e826c8c33d3f0dc',uuid=c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "947db6ff-ed42-4aca-a543-a929517ae8e4", "address": "fa:16:3e:5d:13:2e", "network": {"id": "1e8ee49b-483d-4c93-839e-c0e80a98012f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1381031589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f46d46622964063ba2425358469a36f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap947db6ff-ed", "ovs_interfaceid": "947db6ff-ed42-4aca-a543-a929517ae8e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-dcc631ba-02bd-4068-a704-92c2b8ec4992 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Converting VIF {"id": "947db6ff-ed42-4aca-a543-a929517ae8e4", "address": "fa:16:3e:5d:13:2e", "network": {"id": "1e8ee49b-483d-4c93-839e-c0e80a98012f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1381031589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f46d46622964063ba2425358469a36f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap947db6ff-ed", "ovs_interfaceid": "947db6ff-ed42-4aca-a543-a929517ae8e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-dcc631ba-02bd-4068-a704-92c2b8ec4992 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:13:2e,bridge_name='br-int',has_traffic_filtering=True,id=947db6ff-ed42-4aca-a543-a929517ae8e4,network=Network(1e8ee49b-483d-4c93-839e-c0e80a98012f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap947db6ff-ed') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG os_vif [None req-dcc631ba-02bd-4068-a704-92c2b8ec4992 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:13:2e,bridge_name='br-int',has_traffic_filtering=True,id=947db6ff-ed42-4aca-a543-a929517ae8e4,network=Network(1e8ee49b-483d-4c93-839e-c0e80a98012f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap947db6ff-ed') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-6921a5e6-20fc-4cfc-a98d-65400165b3f2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:48:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-995514485',display_name='tempest-ServerStableDeviceRescueTest-server-995514485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-995514485',id=3,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNIAOBtUHLY5RLLblzf2H9UgwHfkxVSsn0KqwvIq1wE2eV6oO4rG/G1/BgLg8+rUoZsnFfXiYTDv+fYrNnTfaCu6vpj0/PnCJDru2o8rKGymDnbKqG9XIaRxyfKqJHb7Q==',key_name='tempest-keypair-1989347577',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:52:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c04f60d3bd9a41fc930f728a74371a2c',ramdisk_id='',reservation_id='r-w3f3gjq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1178370555',owner_user_name='tempest-ServerStableDeviceRescueTest-1178370555-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:54:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98a58716cb5f4c86952ef9e1f555e6a7',uuid=3640991e-8a5b-4674-af81-3117d4269a68,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "address": "fa:16:3e:70:a1:b1", "network": {"id": "d6503417-7fd7-487b-8474-f23e4cc77845", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1134767045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04f60d3bd9a41fc930f728a74371a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030dd6f3-f7", "ovs_interfaceid": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-6921a5e6-20fc-4cfc-a98d-65400165b3f2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Converting VIF {"id": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "address": "fa:16:3e:70:a1:b1", "network": {"id": "d6503417-7fd7-487b-8474-f23e4cc77845", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1134767045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c04f60d3bd9a41fc930f728a74371a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030dd6f3-f7", "ovs_interfaceid": "030dd6f3-f758-4b5a-b9fb-be3c64cb9341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-6921a5e6-20fc-4cfc-a98d-65400165b3f2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:a1:b1,bridge_name='br-int',has_traffic_filtering=True,id=030dd6f3-f758-4b5a-b9fb-be3c64cb9341,network=Network(d6503417-7fd7-487b-8474-f23e4cc77845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030dd6f3-f7') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG os_vif [None req-6921a5e6-20fc-4cfc-a98d-65400165b3f2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:a1:b1,bridge_name='br-int',has_traffic_filtering=True,id=030dd6f3-f758-4b5a-b9fb-be3c64cb9341,network=Network(d6503417-7fd7-487b-8474-f23e4cc77845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030dd6f3-f7') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap947db6ff-ed, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:55:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap030dd6f3-f7, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:55:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:55:53 user nova-compute[72809]: INFO os_vif [None req-dcc631ba-02bd-4068-a704-92c2b8ec4992 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:13:2e,bridge_name='br-int',has_traffic_filtering=True,id=947db6ff-ed42-4aca-a543-a929517ae8e4,network=Network(1e8ee49b-483d-4c93-839e-c0e80a98012f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap947db6ff-ed')
Aug 09 06:55:53 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-dcc631ba-02bd-4068-a704-92c2b8ec4992 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Deleting instance files /opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed_del
Aug 09 06:55:53 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-dcc631ba-02bd-4068-a704-92c2b8ec4992 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Deletion of /opt/stack/data/nova/instances/c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed_del complete
Aug 09 06:55:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:53 user nova-compute[72809]: INFO os_vif [None req-6921a5e6-20fc-4cfc-a98d-65400165b3f2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:a1:b1,bridge_name='br-int',has_traffic_filtering=True,id=030dd6f3-f758-4b5a-b9fb-be3c64cb9341,network=Network(d6503417-7fd7-487b-8474-f23e4cc77845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030dd6f3-f7')
Aug 09 06:55:53 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-6921a5e6-20fc-4cfc-a98d-65400165b3f2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Deleting instance files /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68_del
Aug 09 06:55:53 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-6921a5e6-20fc-4cfc-a98d-65400165b3f2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Deletion of /opt/stack/data/nova/instances/3640991e-8a5b-4674-af81-3117d4269a68_del complete
Aug 09 06:55:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:53 user nova-compute[72809]: INFO nova.compute.manager [None req-dcc631ba-02bd-4068-a704-92c2b8ec4992 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Took 1.40 seconds to destroy the instance on the hypervisor.
Aug 09 06:55:53 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-dcc631ba-02bd-4068-a704-92c2b8ec4992 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 06:55:53 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 06:55:53 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 06:55:53 user nova-compute[72809]: INFO nova.compute.manager [None req-6921a5e6-20fc-4cfc-a98d-65400165b3f2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Took 1.33 seconds to destroy the instance on the hypervisor.
Aug 09 06:55:53 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-6921a5e6-20fc-4cfc-a98d-65400165b3f2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 06:55:53 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 06:55:53 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 06:55:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:53 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:55:53 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Took 5.39 seconds to deallocate network for instance.
Aug 09 06:55:54 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:55:54 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Took 1.04 seconds to deallocate network for instance.
Aug 09 06:55:54 user nova-compute[72809]: DEBUG nova.compute.manager [req-569ed8aa-04e0-40d1-81d7-5d18c84254dc req-c3dd553a-aad9-4f4f-a494-7ff5b7fc906d service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Received event network-vif-plugged-947db6ff-ed42-4aca-a543-a929517ae8e4 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-569ed8aa-04e0-40d1-81d7-5d18c84254dc req-c3dd553a-aad9-4f4f-a494-7ff5b7fc906d service nova] Acquiring lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-569ed8aa-04e0-40d1-81d7-5d18c84254dc req-c3dd553a-aad9-4f4f-a494-7ff5b7fc906d service nova] Lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-569ed8aa-04e0-40d1-81d7-5d18c84254dc req-c3dd553a-aad9-4f4f-a494-7ff5b7fc906d service nova] Lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG nova.compute.manager [req-569ed8aa-04e0-40d1-81d7-5d18c84254dc req-c3dd553a-aad9-4f4f-a494-7ff5b7fc906d service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] No waiting events found dispatching network-vif-plugged-947db6ff-ed42-4aca-a543-a929517ae8e4 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:55:54 user nova-compute[72809]: WARNING nova.compute.manager [req-569ed8aa-04e0-40d1-81d7-5d18c84254dc req-c3dd553a-aad9-4f4f-a494-7ff5b7fc906d service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Received unexpected event network-vif-plugged-947db6ff-ed42-4aca-a543-a929517ae8e4 for instance with vm_state active and task_state deleting.
Aug 09 06:55:54 user nova-compute[72809]: DEBUG nova.compute.manager [req-9264a365-7112-40b8-a982-8c898e49998b req-8245a7c3-5af5-42d4-a56d-f68ad72ffdca service nova] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Received event network-vif-deleted-947db6ff-ed42-4aca-a543-a929517ae8e4 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-dcc631ba-02bd-4068-a704-92c2b8ec4992 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-dcc631ba-02bd-4068-a704-92c2b8ec4992 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-dcc631ba-02bd-4068-a704-92c2b8ec4992 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-dcc631ba-02bd-4068-a704-92c2b8ec4992 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:55:54 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Took 1.46 seconds to deallocate network for instance.
Aug 09 06:55:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-dcc631ba-02bd-4068-a704-92c2b8ec4992 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6921a5e6-20fc-4cfc-a98d-65400165b3f2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6921a5e6-20fc-4cfc-a98d-65400165b3f2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:54 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-dcc631ba-02bd-4068-a704-92c2b8ec4992 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Deleted allocations for instance c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed
Aug 09 06:55:54 user nova-compute[72809]: DEBUG nova.compute.manager [req-71a3d495-4b7c-4b40-b899-4d5ffd0f64eb req-ebc33f4e-1f55-49f0-bae3-6cc7ac7b16ae service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received event network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-71a3d495-4b7c-4b40-b899-4d5ffd0f64eb req-ebc33f4e-1f55-49f0-bae3-6cc7ac7b16ae service nova] Acquiring lock "3640991e-8a5b-4674-af81-3117d4269a68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-71a3d495-4b7c-4b40-b899-4d5ffd0f64eb req-ebc33f4e-1f55-49f0-bae3-6cc7ac7b16ae service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-71a3d495-4b7c-4b40-b899-4d5ffd0f64eb req-ebc33f4e-1f55-49f0-bae3-6cc7ac7b16ae service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG nova.compute.manager [req-71a3d495-4b7c-4b40-b899-4d5ffd0f64eb req-ebc33f4e-1f55-49f0-bae3-6cc7ac7b16ae service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] No waiting events found dispatching network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:55:54 user nova-compute[72809]: WARNING nova.compute.manager [req-71a3d495-4b7c-4b40-b899-4d5ffd0f64eb req-ebc33f4e-1f55-49f0-bae3-6cc7ac7b16ae service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received unexpected event network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 for instance with vm_state deleted and task_state None.
Aug 09 06:55:54 user nova-compute[72809]: DEBUG nova.compute.manager [req-71a3d495-4b7c-4b40-b899-4d5ffd0f64eb req-ebc33f4e-1f55-49f0-bae3-6cc7ac7b16ae service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-deleted-264f2093-5827-43e1-80a4-1a9190478f3f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG nova.compute.manager [req-71a3d495-4b7c-4b40-b899-4d5ffd0f64eb req-ebc33f4e-1f55-49f0-bae3-6cc7ac7b16ae service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received event network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-71a3d495-4b7c-4b40-b899-4d5ffd0f64eb req-ebc33f4e-1f55-49f0-bae3-6cc7ac7b16ae service nova] Acquiring lock "3640991e-8a5b-4674-af81-3117d4269a68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-71a3d495-4b7c-4b40-b899-4d5ffd0f64eb req-ebc33f4e-1f55-49f0-bae3-6cc7ac7b16ae service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-71a3d495-4b7c-4b40-b899-4d5ffd0f64eb req-ebc33f4e-1f55-49f0-bae3-6cc7ac7b16ae service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG nova.compute.manager [req-71a3d495-4b7c-4b40-b899-4d5ffd0f64eb req-ebc33f4e-1f55-49f0-bae3-6cc7ac7b16ae service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] No waiting events found dispatching network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:55:54 user nova-compute[72809]: WARNING nova.compute.manager [req-71a3d495-4b7c-4b40-b899-4d5ffd0f64eb req-ebc33f4e-1f55-49f0-bae3-6cc7ac7b16ae service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received unexpected event network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 for instance with vm_state deleted and task_state None.
Aug 09 06:55:54 user nova-compute[72809]: DEBUG nova.compute.manager [req-71a3d495-4b7c-4b40-b899-4d5ffd0f64eb req-ebc33f4e-1f55-49f0-bae3-6cc7ac7b16ae service nova] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Received event network-vif-deleted-153083da-b420-4260-ae35-edae5a4d37b8 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG nova.compute.manager [req-71a3d495-4b7c-4b40-b899-4d5ffd0f64eb req-ebc33f4e-1f55-49f0-bae3-6cc7ac7b16ae service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received event network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-71a3d495-4b7c-4b40-b899-4d5ffd0f64eb req-ebc33f4e-1f55-49f0-bae3-6cc7ac7b16ae service nova] Acquiring lock "3640991e-8a5b-4674-af81-3117d4269a68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-71a3d495-4b7c-4b40-b899-4d5ffd0f64eb req-ebc33f4e-1f55-49f0-bae3-6cc7ac7b16ae service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-71a3d495-4b7c-4b40-b899-4d5ffd0f64eb req-ebc33f4e-1f55-49f0-bae3-6cc7ac7b16ae service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG nova.compute.manager [req-71a3d495-4b7c-4b40-b899-4d5ffd0f64eb req-ebc33f4e-1f55-49f0-bae3-6cc7ac7b16ae service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] No waiting events found dispatching network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:55:54 user nova-compute[72809]: WARNING nova.compute.manager [req-71a3d495-4b7c-4b40-b899-4d5ffd0f64eb req-ebc33f4e-1f55-49f0-bae3-6cc7ac7b16ae service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received unexpected event network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 for instance with vm_state deleted and task_state None.
Aug 09 06:55:54 user nova-compute[72809]: DEBUG nova.compute.manager [req-71a3d495-4b7c-4b40-b899-4d5ffd0f64eb req-ebc33f4e-1f55-49f0-bae3-6cc7ac7b16ae service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received event network-vif-unplugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-71a3d495-4b7c-4b40-b899-4d5ffd0f64eb req-ebc33f4e-1f55-49f0-bae3-6cc7ac7b16ae service nova] Acquiring lock "3640991e-8a5b-4674-af81-3117d4269a68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-71a3d495-4b7c-4b40-b899-4d5ffd0f64eb req-ebc33f4e-1f55-49f0-bae3-6cc7ac7b16ae service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-71a3d495-4b7c-4b40-b899-4d5ffd0f64eb req-ebc33f4e-1f55-49f0-bae3-6cc7ac7b16ae service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG nova.compute.manager [req-71a3d495-4b7c-4b40-b899-4d5ffd0f64eb req-ebc33f4e-1f55-49f0-bae3-6cc7ac7b16ae service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] No waiting events found dispatching network-vif-unplugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:55:54 user nova-compute[72809]: WARNING nova.compute.manager [req-71a3d495-4b7c-4b40-b899-4d5ffd0f64eb req-ebc33f4e-1f55-49f0-bae3-6cc7ac7b16ae service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received unexpected event network-vif-unplugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 for instance with vm_state deleted and task_state None.
Aug 09 06:55:54 user nova-compute[72809]: DEBUG nova.compute.manager [req-71a3d495-4b7c-4b40-b899-4d5ffd0f64eb req-ebc33f4e-1f55-49f0-bae3-6cc7ac7b16ae service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received event network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-71a3d495-4b7c-4b40-b899-4d5ffd0f64eb req-ebc33f4e-1f55-49f0-bae3-6cc7ac7b16ae service nova] Acquiring lock "3640991e-8a5b-4674-af81-3117d4269a68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-71a3d495-4b7c-4b40-b899-4d5ffd0f64eb req-ebc33f4e-1f55-49f0-bae3-6cc7ac7b16ae service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-71a3d495-4b7c-4b40-b899-4d5ffd0f64eb req-ebc33f4e-1f55-49f0-bae3-6cc7ac7b16ae service nova] Lock "3640991e-8a5b-4674-af81-3117d4269a68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG nova.compute.manager [req-71a3d495-4b7c-4b40-b899-4d5ffd0f64eb req-ebc33f4e-1f55-49f0-bae3-6cc7ac7b16ae service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] No waiting events found dispatching network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:55:54 user nova-compute[72809]: WARNING nova.compute.manager [req-71a3d495-4b7c-4b40-b899-4d5ffd0f64eb req-ebc33f4e-1f55-49f0-bae3-6cc7ac7b16ae service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received unexpected event network-vif-plugged-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 for instance with vm_state deleted and task_state None.
Aug 09 06:55:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-dcc631ba-02bd-4068-a704-92c2b8ec4992 tempest-TaggedAttachmentsTest-722644131 tempest-TaggedAttachmentsTest-722644131-project-member] Lock "c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.103s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-6921a5e6-20fc-4cfc-a98d-65400165b3f2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:55:54 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-6921a5e6-20fc-4cfc-a98d-65400165b3f2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:55:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6921a5e6-20fc-4cfc-a98d-65400165b3f2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:55 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-6921a5e6-20fc-4cfc-a98d-65400165b3f2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Deleted allocations for instance 3640991e-8a5b-4674-af81-3117d4269a68
Aug 09 06:55:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6921a5e6-20fc-4cfc-a98d-65400165b3f2 tempest-ServerStableDeviceRescueTest-1178370555 tempest-ServerStableDeviceRescueTest-1178370555-project-member] Lock "3640991e-8a5b-4674-af81-3117d4269a68" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.308s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:56 user nova-compute[72809]: INFO nova.compute.manager [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Took 2.44 seconds to detach 3 volumes for instance.
Aug 09 06:55:56 user nova-compute[72809]: DEBUG nova.compute.manager [req-667cf6f7-4089-421d-b870-4a924ab66cc8 req-2e3f2a72-7c35-48ce-9dc5-d7d28536aaa4 service nova] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Received event network-vif-deleted-030dd6f3-f758-4b5a-b9fb-be3c64cb9341 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:55:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:56 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:55:56 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:55:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.252s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:56 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Deleted allocations for instance f69df9a2-e8ed-4bec-8c01-cd005432a373
Aug 09 06:55:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d0b4dcf3-746a-4a83-bf86-0a8285fd1975 tempest-TaggedBootDevicesTest-1529004159 tempest-TaggedBootDevicesTest-1529004159-project-member] Lock "f69df9a2-e8ed-4bec-8c01-cd005432a373" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.542s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:55:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:55:58 user nova-compute[72809]: DEBUG nova.objects.instance [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lazy-loading 'pci_requests' on Instance uuid aec0a7ee-69e1-41cf-bfa8-5733bdedd70a {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:55:58 user nova-compute[72809]: DEBUG nova.objects.instance [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lazy-loading 'numa_topology' on Instance uuid aec0a7ee-69e1-41cf-bfa8-5733bdedd70a {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:55:58 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 06:55:58 user nova-compute[72809]: INFO nova.compute.claims [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Claim successful on node user
Aug 09 06:55:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:55:58 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:55:58 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:55:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.331s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:55:58 user nova-compute[72809]: INFO nova.network.neutron [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Updating port b94aa917-6963-4aee-9bc2-15b2720191be with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 09 06:55:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "refresh_cache-aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:55:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquired lock "refresh_cache-aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:55:59 user nova-compute[72809]: DEBUG nova.network.neutron [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:56:00 user nova-compute[72809]: DEBUG nova.compute.manager [req-bf313f54-83a2-4fbc-a373-da5896c6f2b4 req-43252d67-02fd-46ec-a1dd-7360b54af7d7 service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Received event network-changed-b94aa917-6963-4aee-9bc2-15b2720191be {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:56:00 user nova-compute[72809]: DEBUG nova.compute.manager [req-bf313f54-83a2-4fbc-a373-da5896c6f2b4 req-43252d67-02fd-46ec-a1dd-7360b54af7d7 service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Refreshing instance network info cache due to event network-changed-b94aa917-6963-4aee-9bc2-15b2720191be. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:56:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-bf313f54-83a2-4fbc-a373-da5896c6f2b4 req-43252d67-02fd-46ec-a1dd-7360b54af7d7 service nova] Acquiring lock "refresh_cache-aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:56:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:00 user nova-compute[72809]: DEBUG nova.network.neutron [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Updating instance_info_cache with network_info: [{"id": "b94aa917-6963-4aee-9bc2-15b2720191be", "address": "fa:16:3e:5c:5d:c2", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb94aa917-69", "ovs_interfaceid": "b94aa917-6963-4aee-9bc2-15b2720191be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:56:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Releasing lock "refresh_cache-aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:56:00 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 06:56:00 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Creating image(s)
Aug 09 06:56:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "/opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:56:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "/opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:56:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "/opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:56:00 user nova-compute[72809]: DEBUG nova.objects.instance [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lazy-loading 'trusted_certs' on Instance uuid aec0a7ee-69e1-41cf-bfa8-5733bdedd70a {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:56:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-bf313f54-83a2-4fbc-a373-da5896c6f2b4 req-43252d67-02fd-46ec-a1dd-7360b54af7d7 service nova] Acquired lock "refresh_cache-aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:56:00 user nova-compute[72809]: DEBUG nova.network.neutron [req-bf313f54-83a2-4fbc-a373-da5896c6f2b4 req-43252d67-02fd-46ec-a1dd-7360b54af7d7 service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Refreshing network info cache for port b94aa917-6963-4aee-9bc2-15b2720191be {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:56:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "db9e63e4eae382163c3ce930f6feb77b3089dfa0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:56:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "db9e63e4eae382163c3ce930f6feb77b3089dfa0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:56:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db9e63e4eae382163c3ce930f6feb77b3089dfa0.part --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:02 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691564147.1021645, f69df9a2-e8ed-4bec-8c01-cd005432a373 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:56:02 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] VM Stopped (Lifecycle Event)
Aug 09 06:56:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db9e63e4eae382163c3ce930f6feb77b3089dfa0.part --force-share --output=json" returned: 0 in 0.144s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:02 user nova-compute[72809]: DEBUG nova.virt.images [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] 4241f023-957d-42f4-afec-ae69b622b1a7 was qcow2, converting to raw {{(pid=72809) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 06:56:02 user nova-compute[72809]: DEBUG nova.privsep.utils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72809) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 06:56:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/db9e63e4eae382163c3ce930f6feb77b3089dfa0.part /opt/stack/data/nova/instances/_base/db9e63e4eae382163c3ce930f6feb77b3089dfa0.converted {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:02 user nova-compute[72809]: DEBUG nova.compute.manager [None req-d1940df1-97b9-44e4-81ea-fdd4576052e2 None None] [instance: f69df9a2-e8ed-4bec-8c01-cd005432a373] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:56:02 user nova-compute[72809]: DEBUG nova.network.neutron [req-bf313f54-83a2-4fbc-a373-da5896c6f2b4 req-43252d67-02fd-46ec-a1dd-7360b54af7d7 service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Updated VIF entry in instance network info cache for port b94aa917-6963-4aee-9bc2-15b2720191be. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:56:02 user nova-compute[72809]: DEBUG nova.network.neutron [req-bf313f54-83a2-4fbc-a373-da5896c6f2b4 req-43252d67-02fd-46ec-a1dd-7360b54af7d7 service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Updating instance_info_cache with network_info: [{"id": "b94aa917-6963-4aee-9bc2-15b2720191be", "address": "fa:16:3e:5c:5d:c2", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb94aa917-69", "ovs_interfaceid": "b94aa917-6963-4aee-9bc2-15b2720191be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:56:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-bf313f54-83a2-4fbc-a373-da5896c6f2b4 req-43252d67-02fd-46ec-a1dd-7360b54af7d7 service nova] Releasing lock "refresh_cache-aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:56:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/db9e63e4eae382163c3ce930f6feb77b3089dfa0.part /opt/stack/data/nova/instances/_base/db9e63e4eae382163c3ce930f6feb77b3089dfa0.converted" returned: 0 in 0.501s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db9e63e4eae382163c3ce930f6feb77b3089dfa0.converted --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db9e63e4eae382163c3ce930f6feb77b3089dfa0.converted --force-share --output=json" returned: 0 in 0.158s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "db9e63e4eae382163c3ce930f6feb77b3089dfa0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.887s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:56:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db9e63e4eae382163c3ce930f6feb77b3089dfa0 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db9e63e4eae382163c3ce930f6feb77b3089dfa0 --force-share --output=json" returned: 0 in 0.135s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "db9e63e4eae382163c3ce930f6feb77b3089dfa0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:56:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "db9e63e4eae382163c3ce930f6feb77b3089dfa0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:56:02 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db9e63e4eae382163c3ce930f6feb77b3089dfa0 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db9e63e4eae382163c3ce930f6feb77b3089dfa0 --force-share --output=json" returned: 0 in 0.139s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db9e63e4eae382163c3ce930f6feb77b3089dfa0,backing_fmt=raw /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db9e63e4eae382163c3ce930f6feb77b3089dfa0,backing_fmt=raw /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk 1073741824" returned: 0 in 0.050s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "db9e63e4eae382163c3ce930f6feb77b3089dfa0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:56:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db9e63e4eae382163c3ce930f6feb77b3089dfa0 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db9e63e4eae382163c3ce930f6feb77b3089dfa0 --force-share --output=json" returned: 0 in 0.131s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:03 user nova-compute[72809]: DEBUG nova.objects.instance [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lazy-loading 'migration_context' on Instance uuid aec0a7ee-69e1-41cf-bfa8-5733bdedd70a {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:56:03 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Rebasing disk image.
Aug 09 06:56:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.171s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 -F raw /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 -F raw /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk" returned: 0 in 2.440s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 06:56:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Ensure instance console log exists: /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 06:56:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:56:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:56:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:56:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Start _get_guest_xml network_info=[{"id": "b94aa917-6963-4aee-9bc2-15b2720191be", "address": "fa:16:3e:5c:5d:c2", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb94aa917-69", "ovs_interfaceid": "b94aa917-6963-4aee-9bc2-15b2720191be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='24bea0e2b8081123590e23a73602080f',container_format='bare',created_at=2023-08-09T06:53:57Z,direct_url=<?>,disk_format='qcow2',id=4241f023-957d-42f4-afec-ae69b622b1a7,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-913717240-shelved',owner='0ec36de19d984ff3a150db4fdd8ce327',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-09T06:54:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sjluIXaY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'aec0a7ee-69e1-41cf-bfa8-5733bdedd70a', 'attached_at': '', 'detached_at': '', 'volume_id': 'ed384adf-9851-4d4f-9ca4-998e3b064a44', 'serial': 'ed384adf-9851-4d4f-9ca4-998e3b064a44'}, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': None, 'attachment_id': 'e4b2e89f-0b62-4094-a5a9-5b97b5df31d2', 'volume_type': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:56:06 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:56:06 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:56:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='24bea0e2b8081123590e23a73602080f',container_format='bare',created_at=2023-08-09T06:53:57Z,direct_url=<?>,disk_format='qcow2',id=4241f023-957d-42f4-afec-ae69b622b1a7,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-913717240-shelved',owner='0ec36de19d984ff3a150db4fdd8ce327',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-09T06:54:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG nova.objects.instance [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lazy-loading 'vcpu_model' on Instance uuid aec0a7ee-69e1-41cf-bfa8-5733bdedd70a {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sjluIXaY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:56:06 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:56:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:56:06 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:56:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:56:06 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 06:56:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 -p 172.16.0.220:3260" returned: 21 in 0.075s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6114d83-c14a-4905-9e6d-a56cde6a7432]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 06:56:06 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.091s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bbf348-8e4d-46c5-b245-a2114ad0f047]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44] added
Aug 09 06:56:06 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa32715-af7a-4a7c-ab9c-89ce4b6f1e28]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.046s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fa9d5c-890e-4de7-8a6f-973c122d9986]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sjluIXaY {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sjluIXaY" returned: 0 in 0.030s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[194ca4a3-c374-41d7-ad59-2739b8a5458c]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sjluIXaY'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.065s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a607663-2dc0-4761-81ee-e8fd4951df52]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf08bcf5-0e00-4e49-a1bf-9b266eba482c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311f00db-1c51-4e1a-a955-6d91999dcd9f (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:56:06 user nova-compute[72809]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311f00db-1c51-4e1a-a955-6d91999dcd9f (non-flash)
Aug 09 06:56:06 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:56:06 user nova-compute[72809]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311f00db-1c51-4e1a-a955-6d91999dcd9f (non-flash)
Aug 09 06:56:06 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a3e432-b974-463c-ac96-a3ab4969d50a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44, portal: 172.16.0.220,3260]
Aug 09 06:56:06 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44, portal: 172.16.0.220,3260] successful.
Aug 09 06:56:06 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abbec8b-e285-4ffc-b9d4-c764c10caf3e]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f72177-93d4-41ae-93ca-45f8e34a814a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311f00db-1c51-4e1a-a955-6d91999dcd9f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:56:06 user nova-compute[72809]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311f00db-1c51-4e1a-a955-6d91999dcd9f (non-flash)
Aug 09 06:56:06 user nova-compute[72809]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 (non-flash)
Aug 09 06:56:06 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:56:06 user nova-compute[72809]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311f00db-1c51-4e1a-a955-6d91999dcd9f (non-flash)
Aug 09 06:56:06 user nova-compute[72809]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 (non-flash)
Aug 09 06:56:06 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.508s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[dade2aa9-5c94-42fe-8684-da5b99de8d9f]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 06:56:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sjluIXaY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 06:56:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.578s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:56:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] <== connect_volume: return (1580ms) {'type': 'block', 'scsi_wwn': '26134643035616135', 'path': '/dev/sdd'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:56:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134643035616135', 'path': '/dev/sdd'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 06:56:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T06:51:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-913717240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-913717240',id=12,image_ref='4241f023-957d-42f4-afec-ae69b622b1a7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-38606939',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:52:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0ec36de19d984ff3a150db4fdd8ce327',ramdisk_id='',reservation_id='r-3i0wy02j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1006961404',owner_user_name='tempest-AttachVolumeShelveTestJSON-1006961404-project-member',shelved_at='2023-08-09T06:54:01.262668',shelved_host='user',shelved_image_id='4241f023-957d-42f4-afec-ae69b622b1a7'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:55:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e51e8a984c724efe966662c14b0dbffc',uuid=aec0a7ee-69e1-41cf-bfa8-5733bdedd70a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b94aa917-6963-4aee-9bc2-15b2720191be", "address": "fa:16:3e:5c:5d:c2", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb94aa917-69", "ovs_interfaceid": "b94aa917-6963-4aee-9bc2-15b2720191be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:56:07 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Converting VIF {"id": "b94aa917-6963-4aee-9bc2-15b2720191be", "address": "fa:16:3e:5c:5d:c2", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb94aa917-69", "ovs_interfaceid": "b94aa917-6963-4aee-9bc2-15b2720191be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:56:07 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:5d:c2,bridge_name='br-int',has_traffic_filtering=True,id=b94aa917-6963-4aee-9bc2-15b2720191be,network=Network(39277410-6754-4b40-b1bc-9777841910ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb94aa917-69') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:56:07 user nova-compute[72809]: DEBUG nova.objects.instance [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lazy-loading 'pci_devices' on Instance uuid aec0a7ee-69e1-41cf-bfa8-5733bdedd70a {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:56:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:56:07 user nova-compute[72809]:   <uuid>aec0a7ee-69e1-41cf-bfa8-5733bdedd70a</uuid>
Aug 09 06:56:07 user nova-compute[72809]:   <name>instance-0000000c</name>
Aug 09 06:56:07 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:56:07 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:56:07 user nova-compute[72809]:   <metadata>
Aug 09 06:56:07 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:56:07 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:56:07 user nova-compute[72809]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-913717240</nova:name>
Aug 09 06:56:07 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:56:06</nova:creationTime>
Aug 09 06:56:07 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:56:07 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:56:07 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:56:07 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:56:07 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:56:07 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:56:07 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:56:07 user nova-compute[72809]:       <nova:owner>
Aug 09 06:56:07 user nova-compute[72809]:         <nova:user uuid="e51e8a984c724efe966662c14b0dbffc">tempest-AttachVolumeShelveTestJSON-1006961404-project-member</nova:user>
Aug 09 06:56:07 user nova-compute[72809]:         <nova:project uuid="0ec36de19d984ff3a150db4fdd8ce327">tempest-AttachVolumeShelveTestJSON-1006961404</nova:project>
Aug 09 06:56:07 user nova-compute[72809]:       </nova:owner>
Aug 09 06:56:07 user nova-compute[72809]:       <nova:root type="image" uuid="4241f023-957d-42f4-afec-ae69b622b1a7"/>
Aug 09 06:56:07 user nova-compute[72809]:       <nova:ports>
Aug 09 06:56:07 user nova-compute[72809]:         <nova:port uuid="b94aa917-6963-4aee-9bc2-15b2720191be">
Aug 09 06:56:07 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 06:56:07 user nova-compute[72809]:         </nova:port>
Aug 09 06:56:07 user nova-compute[72809]:       </nova:ports>
Aug 09 06:56:07 user nova-compute[72809]:     </nova:instance>
Aug 09 06:56:07 user nova-compute[72809]:   </metadata>
Aug 09 06:56:07 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:56:07 user nova-compute[72809]:     <system>
Aug 09 06:56:07 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:56:07 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:56:07 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:56:07 user nova-compute[72809]:       <entry name="serial">aec0a7ee-69e1-41cf-bfa8-5733bdedd70a</entry>
Aug 09 06:56:07 user nova-compute[72809]:       <entry name="uuid">aec0a7ee-69e1-41cf-bfa8-5733bdedd70a</entry>
Aug 09 06:56:07 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:56:07 user nova-compute[72809]:     </system>
Aug 09 06:56:07 user nova-compute[72809]:   </sysinfo>
Aug 09 06:56:07 user nova-compute[72809]:   <os>
Aug 09 06:56:07 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:56:07 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 06:56:07 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:56:07 user nova-compute[72809]:   </os>
Aug 09 06:56:07 user nova-compute[72809]:   <features>
Aug 09 06:56:07 user nova-compute[72809]:     <acpi/>
Aug 09 06:56:07 user nova-compute[72809]:     <apic/>
Aug 09 06:56:07 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:56:07 user nova-compute[72809]:   </features>
Aug 09 06:56:07 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:56:07 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:56:07 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:56:07 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:56:07 user nova-compute[72809]:   </clock>
Aug 09 06:56:07 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:56:07 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:56:07 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:56:07 user nova-compute[72809]:   </cpu>
Aug 09 06:56:07 user nova-compute[72809]:   <devices>
Aug 09 06:56:07 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:56:07 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:56:07 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk"/>
Aug 09 06:56:07 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:56:07 user nova-compute[72809]:     </disk>
Aug 09 06:56:07 user nova-compute[72809]:     <disk type="block" device="disk">
Aug 09 06:56:07 user nova-compute[72809]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:56:07 user nova-compute[72809]:       <source dev="/dev/sdd"/>
Aug 09 06:56:07 user nova-compute[72809]:       <target dev="vdc" bus="virtio"/>
Aug 09 06:56:07 user nova-compute[72809]:       <serial>ed384adf-9851-4d4f-9ca4-998e3b064a44</serial>
Aug 09 06:56:07 user nova-compute[72809]:     </disk>
Aug 09 06:56:07 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:56:07 user nova-compute[72809]:       <mac address="fa:16:3e:5c:5d:c2"/>
Aug 09 06:56:07 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:56:07 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:56:07 user nova-compute[72809]:       <target dev="tapb94aa917-69"/>
Aug 09 06:56:07 user nova-compute[72809]:     </interface>
Aug 09 06:56:07 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:56:07 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/console.log" append="off"/>
Aug 09 06:56:07 user nova-compute[72809]:     </serial>
Aug 09 06:56:07 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:56:07 user nova-compute[72809]:     <video>
Aug 09 06:56:07 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:56:07 user nova-compute[72809]:     </video>
Aug 09 06:56:07 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:56:07 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:56:07 user nova-compute[72809]:     </rng>
Aug 09 06:56:07 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:56:07 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:56:07 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:56:07 user nova-compute[72809]:     </memballoon>
Aug 09 06:56:07 user nova-compute[72809]:   </devices>
Aug 09 06:56:07 user nova-compute[72809]: </domain>
Aug 09 06:56:07 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:56:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T06:51:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-913717240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-913717240',id=12,image_ref='4241f023-957d-42f4-afec-ae69b622b1a7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-38606939',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:52:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0ec36de19d984ff3a150db4fdd8ce327',ramdisk_id='',reservation_id='r-3i0wy02j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1006961404',owner_user_name='tempest-AttachVolumeShelveTestJSON-1006961404-project-member',shelved_at='2023-08-09T06:54:01.262668',shelved_host='user',shelved_image_id='4241f023-957d-42f4-afec-ae69b622b1a7'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:55:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e51e8a984c724efe966662c14b0dbffc',uuid=aec0a7ee-69e1-41cf-bfa8-5733bdedd70a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b94aa917-6963-4aee-9bc2-15b2720191be", "address": "fa:16:3e:5c:5d:c2", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb94aa917-69", "ovs_interfaceid": "b94aa917-6963-4aee-9bc2-15b2720191be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:56:07 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Converting VIF {"id": "b94aa917-6963-4aee-9bc2-15b2720191be", "address": "fa:16:3e:5c:5d:c2", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb94aa917-69", "ovs_interfaceid": "b94aa917-6963-4aee-9bc2-15b2720191be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:56:07 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:5d:c2,bridge_name='br-int',has_traffic_filtering=True,id=b94aa917-6963-4aee-9bc2-15b2720191be,network=Network(39277410-6754-4b40-b1bc-9777841910ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb94aa917-69') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:56:07 user nova-compute[72809]: DEBUG os_vif [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:5d:c2,bridge_name='br-int',has_traffic_filtering=True,id=b94aa917-6963-4aee-9bc2-15b2720191be,network=Network(39277410-6754-4b40-b1bc-9777841910ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb94aa917-69') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:56:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:56:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:56:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb94aa917-69, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:56:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb94aa917-69, col_values=(('external_ids', {'iface-id': 'b94aa917-6963-4aee-9bc2-15b2720191be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:5d:c2', 'vm-uuid': 'aec0a7ee-69e1-41cf-bfa8-5733bdedd70a'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:56:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:56:07 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691564152.8828976, c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:56:07 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] VM Stopped (Lifecycle Event)
Aug 09 06:56:07 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691564152.8878253, 3640991e-8a5b-4674-af81-3117d4269a68 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:56:07 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] VM Stopped (Lifecycle Event)
Aug 09 06:56:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:07 user nova-compute[72809]: INFO os_vif [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:5d:c2,bridge_name='br-int',has_traffic_filtering=True,id=b94aa917-6963-4aee-9bc2-15b2720191be,network=Network(39277410-6754-4b40-b1bc-9777841910ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb94aa917-69')
Aug 09 06:56:07 user nova-compute[72809]: DEBUG nova.compute.manager [None req-4b4ec64f-bab9-4b7e-bd6d-a2522e995d9e None None] [instance: 3640991e-8a5b-4674-af81-3117d4269a68] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:56:07 user nova-compute[72809]: DEBUG nova.compute.manager [None req-dff4fae4-7824-453e-a7a5-54d02385742d None None] [instance: c0421c4c-3c7e-4fdd-8c95-06b25dfc02ed] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:56:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:56:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:56:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] No VIF found with MAC fa:16:3e:5c:5d:c2, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:56:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:09 user nova-compute[72809]: DEBUG nova.compute.manager [req-e8f91bd7-6c33-4298-9a2b-4f9d0e3360bf req-385cf4e9-1392-4bc0-8d4b-4d453fadc32d service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Received event network-vif-plugged-b94aa917-6963-4aee-9bc2-15b2720191be {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:56:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e8f91bd7-6c33-4298-9a2b-4f9d0e3360bf req-385cf4e9-1392-4bc0-8d4b-4d453fadc32d service nova] Acquiring lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:56:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e8f91bd7-6c33-4298-9a2b-4f9d0e3360bf req-385cf4e9-1392-4bc0-8d4b-4d453fadc32d service nova] Lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:56:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e8f91bd7-6c33-4298-9a2b-4f9d0e3360bf req-385cf4e9-1392-4bc0-8d4b-4d453fadc32d service nova] Lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:56:09 user nova-compute[72809]: DEBUG nova.compute.manager [req-e8f91bd7-6c33-4298-9a2b-4f9d0e3360bf req-385cf4e9-1392-4bc0-8d4b-4d453fadc32d service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] No waiting events found dispatching network-vif-plugged-b94aa917-6963-4aee-9bc2-15b2720191be {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:56:09 user nova-compute[72809]: WARNING nova.compute.manager [req-e8f91bd7-6c33-4298-9a2b-4f9d0e3360bf req-385cf4e9-1392-4bc0-8d4b-4d453fadc32d service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Received unexpected event network-vif-plugged-b94aa917-6963-4aee-9bc2-15b2720191be for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 06:56:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:11 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:11 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564171.7483587, aec0a7ee-69e1-41cf-bfa8-5733bdedd70a => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:56:11 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] VM Resumed (Lifecycle Event)
Aug 09 06:56:11 user nova-compute[72809]: DEBUG nova.compute.manager [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:56:11 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 06:56:11 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Instance spawned successfully.
Aug 09 06:56:11 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:56:11 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:56:11 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:56:11 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564171.7516696, aec0a7ee-69e1-41cf-bfa8-5733bdedd70a => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:56:11 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] VM Started (Lifecycle Event)
Aug 09 06:56:11 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:56:11 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:56:11 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:56:11 user nova-compute[72809]: DEBUG nova.compute.manager [req-9d2f5e55-b1a6-41b6-b8eb-bde48333e972 req-78022140-1059-4bf9-9ce6-4feadd3e481b service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Received event network-vif-plugged-b94aa917-6963-4aee-9bc2-15b2720191be {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:56:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9d2f5e55-b1a6-41b6-b8eb-bde48333e972 req-78022140-1059-4bf9-9ce6-4feadd3e481b service nova] Acquiring lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:56:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9d2f5e55-b1a6-41b6-b8eb-bde48333e972 req-78022140-1059-4bf9-9ce6-4feadd3e481b service nova] Lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:56:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9d2f5e55-b1a6-41b6-b8eb-bde48333e972 req-78022140-1059-4bf9-9ce6-4feadd3e481b service nova] Lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:56:11 user nova-compute[72809]: DEBUG nova.compute.manager [req-9d2f5e55-b1a6-41b6-b8eb-bde48333e972 req-78022140-1059-4bf9-9ce6-4feadd3e481b service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] No waiting events found dispatching network-vif-plugged-b94aa917-6963-4aee-9bc2-15b2720191be {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:56:11 user nova-compute[72809]: WARNING nova.compute.manager [req-9d2f5e55-b1a6-41b6-b8eb-bde48333e972 req-78022140-1059-4bf9-9ce6-4feadd3e481b service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Received unexpected event network-vif-plugged-b94aa917-6963-4aee-9bc2-15b2720191be for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 06:56:12 user nova-compute[72809]: DEBUG nova.compute.manager [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:56:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08f86c97-16c0-4e18-87f4-096c660bca3e tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 23.097s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:56:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:56:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:56:16 user nova-compute[72809]: DEBUG nova.compute.manager [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 06:56:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:56:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:56:16 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 06:56:16 user nova-compute[72809]: INFO nova.compute.claims [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Claim successful on node user
Aug 09 06:56:17 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:56:17 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:56:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:56:17 user nova-compute[72809]: DEBUG nova.compute.manager [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 06:56:17 user nova-compute[72809]: DEBUG nova.compute.manager [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 06:56:17 user nova-compute[72809]: DEBUG nova.network.neutron [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 06:56:17 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 06:56:17 user nova-compute[72809]: DEBUG nova.compute.manager [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 06:56:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:56:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:56:17 user nova-compute[72809]: DEBUG nova.compute.manager [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 06:56:17 user nova-compute[72809]: DEBUG nova.compute.manager [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 06:56:17 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 06:56:17 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Creating image(s)
Aug 09 06:56:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "/opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:56:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "/opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:56:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "/opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:56:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:17 user nova-compute[72809]: DEBUG nova.policy [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '740071d735364ce5b0e6a7bb0dbdffe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75b8536be334abba712e1c6f6886cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 06:56:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:56:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:56:17 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 06:56:17 user nova-compute[72809]: INFO nova.compute.claims [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Claim successful on node user
Aug 09 06:56:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.161s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:56:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:56:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.229s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk 1073741824" returned: 0 in 0.073s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:56:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.146s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Cannot resize image /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG nova.objects.instance [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lazy-loading 'migration_context' on Instance uuid 1bde423f-0b73-448f-bdce-8d6af96d8fc6 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.706s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG nova.compute.manager [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG nova.network.neutron [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Successfully created port: 81017ed8-c816-4a5d-aa4f-eb16d863571f {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Ensure instance console log exists: /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG nova.compute.manager [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG nova.network.neutron [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 06:56:18 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 06:56:18 user nova-compute[72809]: DEBUG nova.compute.manager [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG nova.policy [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '740071d735364ce5b0e6a7bb0dbdffe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75b8536be334abba712e1c6f6886cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG nova.compute.manager [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 06:56:18 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Creating image(s)
Aug 09 06:56:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "/opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "/opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "/opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.153s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.138s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk 1073741824" returned: 0 in 0.052s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:56:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.network.neutron [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Successfully created port: f3c034fd-3aaa-4f55-a25a-e5370456135c {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.165s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Cannot resize image /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.objects.instance [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lazy-loading 'migration_context' on Instance uuid bebd5a14-6272-4de1-a1a1-4fb45b867c7f {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.network.neutron [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Successfully updated port: 81017ed8-c816-4a5d-aa4f-eb16d863571f {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Ensure instance console log exists: /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "refresh_cache-1bde423f-0b73-448f-bdce-8d6af96d8fc6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquired lock "refresh_cache-1bde423f-0b73-448f-bdce-8d6af96d8fc6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.network.neutron [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.compute.manager [req-a6a513d0-177a-4fe2-b29c-2baae1e40e60 req-1596f0d1-4833-41a1-8470-2117f35bc264 service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Received event network-changed-81017ed8-c816-4a5d-aa4f-eb16d863571f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.compute.manager [req-a6a513d0-177a-4fe2-b29c-2baae1e40e60 req-1596f0d1-4833-41a1-8470-2117f35bc264 service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Refreshing instance network info cache due to event network-changed-81017ed8-c816-4a5d-aa4f-eb16d863571f. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a6a513d0-177a-4fe2-b29c-2baae1e40e60 req-1596f0d1-4833-41a1-8470-2117f35bc264 service nova] Acquiring lock "refresh_cache-1bde423f-0b73-448f-bdce-8d6af96d8fc6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.network.neutron [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.network.neutron [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Updating instance_info_cache with network_info: [{"id": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "address": "fa:16:3e:3b:e0:d8", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81017ed8-c8", "ovs_interfaceid": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Releasing lock "refresh_cache-1bde423f-0b73-448f-bdce-8d6af96d8fc6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.compute.manager [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Instance network_info: |[{"id": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "address": "fa:16:3e:3b:e0:d8", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81017ed8-c8", "ovs_interfaceid": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a6a513d0-177a-4fe2-b29c-2baae1e40e60 req-1596f0d1-4833-41a1-8470-2117f35bc264 service nova] Acquired lock "refresh_cache-1bde423f-0b73-448f-bdce-8d6af96d8fc6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.network.neutron [req-a6a513d0-177a-4fe2-b29c-2baae1e40e60 req-1596f0d1-4833-41a1-8470-2117f35bc264 service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Refreshing network info cache for port 81017ed8-c816-4a5d-aa4f-eb16d863571f {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Start _get_guest_xml network_info=[{"id": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "address": "fa:16:3e:3b:e0:d8", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81017ed8-c8", "ovs_interfaceid": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:56:19 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:56:19 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:56:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1321868338',display_name='tempest-ServerRescueNegativeTestJSON-server-1321868338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1321868338',id=19,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e75b8536be334abba712e1c6f6886cdf',ramdisk_id='',reservation_id='r-8i7rj3wa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1153742012',owner_user_name='tempest-ServerRescueNegativeTestJSON-1153742012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:56:17Z,user_data=None,user_id='740071d735364ce5b0e6a7bb0dbdffe3',uuid=1bde423f-0b73-448f-bdce-8d6af96d8fc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "address": "fa:16:3e:3b:e0:d8", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81017ed8-c8", "ovs_interfaceid": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Converting VIF {"id": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "address": "fa:16:3e:3b:e0:d8", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81017ed8-c8", "ovs_interfaceid": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:e0:d8,bridge_name='br-int',has_traffic_filtering=True,id=81017ed8-c816-4a5d-aa4f-eb16d863571f,network=Network(fb9ae39b-117a-4cca-8080-683f63e8a318),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81017ed8-c8') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.objects.instance [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lazy-loading 'pci_devices' on Instance uuid 1bde423f-0b73-448f-bdce-8d6af96d8fc6 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:56:19 user nova-compute[72809]:   <uuid>1bde423f-0b73-448f-bdce-8d6af96d8fc6</uuid>
Aug 09 06:56:19 user nova-compute[72809]:   <name>instance-00000013</name>
Aug 09 06:56:19 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:56:19 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:56:19 user nova-compute[72809]:   <metadata>
Aug 09 06:56:19 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:56:19 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:56:19 user nova-compute[72809]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1321868338</nova:name>
Aug 09 06:56:19 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:56:19</nova:creationTime>
Aug 09 06:56:19 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:56:19 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:56:19 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:56:19 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:56:19 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:56:19 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:56:19 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:56:19 user nova-compute[72809]:       <nova:owner>
Aug 09 06:56:19 user nova-compute[72809]:         <nova:user uuid="740071d735364ce5b0e6a7bb0dbdffe3">tempest-ServerRescueNegativeTestJSON-1153742012-project-member</nova:user>
Aug 09 06:56:19 user nova-compute[72809]:         <nova:project uuid="e75b8536be334abba712e1c6f6886cdf">tempest-ServerRescueNegativeTestJSON-1153742012</nova:project>
Aug 09 06:56:19 user nova-compute[72809]:       </nova:owner>
Aug 09 06:56:19 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:56:19 user nova-compute[72809]:       <nova:ports>
Aug 09 06:56:19 user nova-compute[72809]:         <nova:port uuid="81017ed8-c816-4a5d-aa4f-eb16d863571f">
Aug 09 06:56:19 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 06:56:19 user nova-compute[72809]:         </nova:port>
Aug 09 06:56:19 user nova-compute[72809]:       </nova:ports>
Aug 09 06:56:19 user nova-compute[72809]:     </nova:instance>
Aug 09 06:56:19 user nova-compute[72809]:   </metadata>
Aug 09 06:56:19 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:56:19 user nova-compute[72809]:     <system>
Aug 09 06:56:19 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:56:19 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:56:19 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:56:19 user nova-compute[72809]:       <entry name="serial">1bde423f-0b73-448f-bdce-8d6af96d8fc6</entry>
Aug 09 06:56:19 user nova-compute[72809]:       <entry name="uuid">1bde423f-0b73-448f-bdce-8d6af96d8fc6</entry>
Aug 09 06:56:19 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:56:19 user nova-compute[72809]:     </system>
Aug 09 06:56:19 user nova-compute[72809]:   </sysinfo>
Aug 09 06:56:19 user nova-compute[72809]:   <os>
Aug 09 06:56:19 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:56:19 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 06:56:19 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:56:19 user nova-compute[72809]:   </os>
Aug 09 06:56:19 user nova-compute[72809]:   <features>
Aug 09 06:56:19 user nova-compute[72809]:     <acpi/>
Aug 09 06:56:19 user nova-compute[72809]:     <apic/>
Aug 09 06:56:19 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:56:19 user nova-compute[72809]:   </features>
Aug 09 06:56:19 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:56:19 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:56:19 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:56:19 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:56:19 user nova-compute[72809]:   </clock>
Aug 09 06:56:19 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:56:19 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:56:19 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:56:19 user nova-compute[72809]:   </cpu>
Aug 09 06:56:19 user nova-compute[72809]:   <devices>
Aug 09 06:56:19 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:56:19 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:56:19 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk"/>
Aug 09 06:56:19 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:56:19 user nova-compute[72809]:     </disk>
Aug 09 06:56:19 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:56:19 user nova-compute[72809]:       <mac address="fa:16:3e:3b:e0:d8"/>
Aug 09 06:56:19 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:56:19 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:56:19 user nova-compute[72809]:       <target dev="tap81017ed8-c8"/>
Aug 09 06:56:19 user nova-compute[72809]:     </interface>
Aug 09 06:56:19 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:56:19 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/console.log" append="off"/>
Aug 09 06:56:19 user nova-compute[72809]:     </serial>
Aug 09 06:56:19 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:56:19 user nova-compute[72809]:     <video>
Aug 09 06:56:19 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:56:19 user nova-compute[72809]:     </video>
Aug 09 06:56:19 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:56:19 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:56:19 user nova-compute[72809]:     </rng>
Aug 09 06:56:19 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:56:19 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:56:19 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:56:19 user nova-compute[72809]:     </memballoon>
Aug 09 06:56:19 user nova-compute[72809]:   </devices>
Aug 09 06:56:19 user nova-compute[72809]: </domain>
Aug 09 06:56:19 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:56:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1321868338',display_name='tempest-ServerRescueNegativeTestJSON-server-1321868338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1321868338',id=19,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e75b8536be334abba712e1c6f6886cdf',ramdisk_id='',reservation_id='r-8i7rj3wa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1153742012',owner_user_name='tempest-ServerRescueNegativeTestJSON-1153742012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:56:17Z,user_data=None,user_id='740071d735364ce5b0e6a7bb0dbdffe3',uuid=1bde423f-0b73-448f-bdce-8d6af96d8fc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "address": "fa:16:3e:3b:e0:d8", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81017ed8-c8", "ovs_interfaceid": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Converting VIF {"id": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "address": "fa:16:3e:3b:e0:d8", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81017ed8-c8", "ovs_interfaceid": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:e0:d8,bridge_name='br-int',has_traffic_filtering=True,id=81017ed8-c816-4a5d-aa4f-eb16d863571f,network=Network(fb9ae39b-117a-4cca-8080-683f63e8a318),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81017ed8-c8') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG os_vif [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:e0:d8,bridge_name='br-int',has_traffic_filtering=True,id=81017ed8-c816-4a5d-aa4f-eb16d863571f,network=Network(fb9ae39b-117a-4cca-8080-683f63e8a318),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81017ed8-c8') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81017ed8-c8, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap81017ed8-c8, col_values=(('external_ids', {'iface-id': '81017ed8-c816-4a5d-aa4f-eb16d863571f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:e0:d8', 'vm-uuid': '1bde423f-0b73-448f-bdce-8d6af96d8fc6'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.network.neutron [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Successfully updated port: f3c034fd-3aaa-4f55-a25a-e5370456135c {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:19 user nova-compute[72809]: INFO os_vif [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:e0:d8,bridge_name='br-int',has_traffic_filtering=True,id=81017ed8-c816-4a5d-aa4f-eb16d863571f,network=Network(fb9ae39b-117a-4cca-8080-683f63e8a318),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81017ed8-c8')
Aug 09 06:56:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "refresh_cache-bebd5a14-6272-4de1-a1a1-4fb45b867c7f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquired lock "refresh_cache-bebd5a14-6272-4de1-a1a1-4fb45b867c7f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.network.neutron [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.compute.manager [req-252d505d-19f1-434f-8cf6-56c278cdb5cc req-da09068e-67b3-4e3f-85c7-89bcc2c23cd1 service nova] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Received event network-changed-f3c034fd-3aaa-4f55-a25a-e5370456135c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.compute.manager [req-252d505d-19f1-434f-8cf6-56c278cdb5cc req-da09068e-67b3-4e3f-85c7-89bcc2c23cd1 service nova] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Refreshing instance network info cache due to event network-changed-f3c034fd-3aaa-4f55-a25a-e5370456135c. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-252d505d-19f1-434f-8cf6-56c278cdb5cc req-da09068e-67b3-4e3f-85c7-89bcc2c23cd1 service nova] Acquiring lock "refresh_cache-bebd5a14-6272-4de1-a1a1-4fb45b867c7f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] No VIF found with MAC fa:16:3e:3b:e0:d8, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:56:19 user nova-compute[72809]: DEBUG nova.network.neutron [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.network.neutron [req-a6a513d0-177a-4fe2-b29c-2baae1e40e60 req-1596f0d1-4833-41a1-8470-2117f35bc264 service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Updated VIF entry in instance network info cache for port 81017ed8-c816-4a5d-aa4f-eb16d863571f. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.network.neutron [req-a6a513d0-177a-4fe2-b29c-2baae1e40e60 req-1596f0d1-4833-41a1-8470-2117f35bc264 service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Updating instance_info_cache with network_info: [{"id": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "address": "fa:16:3e:3b:e0:d8", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81017ed8-c8", "ovs_interfaceid": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a6a513d0-177a-4fe2-b29c-2baae1e40e60 req-1596f0d1-4833-41a1-8470-2117f35bc264 service nova] Releasing lock "refresh_cache-1bde423f-0b73-448f-bdce-8d6af96d8fc6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.network.neutron [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Updating instance_info_cache with network_info: [{"id": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "address": "fa:16:3e:95:65:6f", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c034fd-3a", "ovs_interfaceid": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Releasing lock "refresh_cache-bebd5a14-6272-4de1-a1a1-4fb45b867c7f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.compute.manager [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Instance network_info: |[{"id": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "address": "fa:16:3e:95:65:6f", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c034fd-3a", "ovs_interfaceid": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-252d505d-19f1-434f-8cf6-56c278cdb5cc req-da09068e-67b3-4e3f-85c7-89bcc2c23cd1 service nova] Acquired lock "refresh_cache-bebd5a14-6272-4de1-a1a1-4fb45b867c7f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.network.neutron [req-252d505d-19f1-434f-8cf6-56c278cdb5cc req-da09068e-67b3-4e3f-85c7-89bcc2c23cd1 service nova] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Refreshing network info cache for port f3c034fd-3aaa-4f55-a25a-e5370456135c {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Start _get_guest_xml network_info=[{"id": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "address": "fa:16:3e:95:65:6f", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c034fd-3a", "ovs_interfaceid": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:56:20 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:56:20 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:56:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1180037582',display_name='tempest-ServerRescueNegativeTestJSON-server-1180037582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1180037582',id=20,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e75b8536be334abba712e1c6f6886cdf',ramdisk_id='',reservation_id='r-6oy9lqdq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1153742012',owner_user_name='tempest-ServerRescueNegativeTestJSON-1153742012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:56:18Z,user_data=None,user_id='740071d735364ce5b0e6a7bb0dbdffe3',uuid=bebd5a14-6272-4de1-a1a1-4fb45b867c7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "address": "fa:16:3e:95:65:6f", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c034fd-3a", "ovs_interfaceid": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Converting VIF {"id": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "address": "fa:16:3e:95:65:6f", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c034fd-3a", "ovs_interfaceid": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:65:6f,bridge_name='br-int',has_traffic_filtering=True,id=f3c034fd-3aaa-4f55-a25a-e5370456135c,network=Network(fb9ae39b-117a-4cca-8080-683f63e8a318),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3c034fd-3a') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.objects.instance [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lazy-loading 'pci_devices' on Instance uuid bebd5a14-6272-4de1-a1a1-4fb45b867c7f {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:56:20 user nova-compute[72809]:   <uuid>bebd5a14-6272-4de1-a1a1-4fb45b867c7f</uuid>
Aug 09 06:56:20 user nova-compute[72809]:   <name>instance-00000014</name>
Aug 09 06:56:20 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:56:20 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:56:20 user nova-compute[72809]:   <metadata>
Aug 09 06:56:20 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:56:20 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:56:20 user nova-compute[72809]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1180037582</nova:name>
Aug 09 06:56:20 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:56:20</nova:creationTime>
Aug 09 06:56:20 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:56:20 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:56:20 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:56:20 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:56:20 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:56:20 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:56:20 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:56:20 user nova-compute[72809]:       <nova:owner>
Aug 09 06:56:20 user nova-compute[72809]:         <nova:user uuid="740071d735364ce5b0e6a7bb0dbdffe3">tempest-ServerRescueNegativeTestJSON-1153742012-project-member</nova:user>
Aug 09 06:56:20 user nova-compute[72809]:         <nova:project uuid="e75b8536be334abba712e1c6f6886cdf">tempest-ServerRescueNegativeTestJSON-1153742012</nova:project>
Aug 09 06:56:20 user nova-compute[72809]:       </nova:owner>
Aug 09 06:56:20 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:56:20 user nova-compute[72809]:       <nova:ports>
Aug 09 06:56:20 user nova-compute[72809]:         <nova:port uuid="f3c034fd-3aaa-4f55-a25a-e5370456135c">
Aug 09 06:56:20 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 06:56:20 user nova-compute[72809]:         </nova:port>
Aug 09 06:56:20 user nova-compute[72809]:       </nova:ports>
Aug 09 06:56:20 user nova-compute[72809]:     </nova:instance>
Aug 09 06:56:20 user nova-compute[72809]:   </metadata>
Aug 09 06:56:20 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:56:20 user nova-compute[72809]:     <system>
Aug 09 06:56:20 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:56:20 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:56:20 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:56:20 user nova-compute[72809]:       <entry name="serial">bebd5a14-6272-4de1-a1a1-4fb45b867c7f</entry>
Aug 09 06:56:20 user nova-compute[72809]:       <entry name="uuid">bebd5a14-6272-4de1-a1a1-4fb45b867c7f</entry>
Aug 09 06:56:20 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:56:20 user nova-compute[72809]:     </system>
Aug 09 06:56:20 user nova-compute[72809]:   </sysinfo>
Aug 09 06:56:20 user nova-compute[72809]:   <os>
Aug 09 06:56:20 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:56:20 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 06:56:20 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:56:20 user nova-compute[72809]:   </os>
Aug 09 06:56:20 user nova-compute[72809]:   <features>
Aug 09 06:56:20 user nova-compute[72809]:     <acpi/>
Aug 09 06:56:20 user nova-compute[72809]:     <apic/>
Aug 09 06:56:20 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:56:20 user nova-compute[72809]:   </features>
Aug 09 06:56:20 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:56:20 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:56:20 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:56:20 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:56:20 user nova-compute[72809]:   </clock>
Aug 09 06:56:20 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:56:20 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:56:20 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:56:20 user nova-compute[72809]:   </cpu>
Aug 09 06:56:20 user nova-compute[72809]:   <devices>
Aug 09 06:56:20 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:56:20 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:56:20 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk"/>
Aug 09 06:56:20 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:56:20 user nova-compute[72809]:     </disk>
Aug 09 06:56:20 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:56:20 user nova-compute[72809]:       <mac address="fa:16:3e:95:65:6f"/>
Aug 09 06:56:20 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:56:20 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:56:20 user nova-compute[72809]:       <target dev="tapf3c034fd-3a"/>
Aug 09 06:56:20 user nova-compute[72809]:     </interface>
Aug 09 06:56:20 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:56:20 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/console.log" append="off"/>
Aug 09 06:56:20 user nova-compute[72809]:     </serial>
Aug 09 06:56:20 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:56:20 user nova-compute[72809]:     <video>
Aug 09 06:56:20 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:56:20 user nova-compute[72809]:     </video>
Aug 09 06:56:20 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:56:20 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:56:20 user nova-compute[72809]:     </rng>
Aug 09 06:56:20 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:56:20 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:56:20 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:56:20 user nova-compute[72809]:     </memballoon>
Aug 09 06:56:20 user nova-compute[72809]:   </devices>
Aug 09 06:56:20 user nova-compute[72809]: </domain>
Aug 09 06:56:20 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:56:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1180037582',display_name='tempest-ServerRescueNegativeTestJSON-server-1180037582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1180037582',id=20,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e75b8536be334abba712e1c6f6886cdf',ramdisk_id='',reservation_id='r-6oy9lqdq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1153742012',owner_user_name='tempest-ServerRescueNegativeTestJSON-1153742012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:56:18Z,user_data=None,user_id='740071d735364ce5b0e6a7bb0dbdffe3',uuid=bebd5a14-6272-4de1-a1a1-4fb45b867c7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "address": "fa:16:3e:95:65:6f", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c034fd-3a", "ovs_interfaceid": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Converting VIF {"id": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "address": "fa:16:3e:95:65:6f", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c034fd-3a", "ovs_interfaceid": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:65:6f,bridge_name='br-int',has_traffic_filtering=True,id=f3c034fd-3aaa-4f55-a25a-e5370456135c,network=Network(fb9ae39b-117a-4cca-8080-683f63e8a318),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3c034fd-3a') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG os_vif [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:65:6f,bridge_name='br-int',has_traffic_filtering=True,id=f3c034fd-3aaa-4f55-a25a-e5370456135c,network=Network(fb9ae39b-117a-4cca-8080-683f63e8a318),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3c034fd-3a') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3c034fd-3a, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf3c034fd-3a, col_values=(('external_ids', {'iface-id': 'f3c034fd-3aaa-4f55-a25a-e5370456135c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:65:6f', 'vm-uuid': 'bebd5a14-6272-4de1-a1a1-4fb45b867c7f'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:20 user nova-compute[72809]: INFO os_vif [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:65:6f,bridge_name='br-int',has_traffic_filtering=True,id=f3c034fd-3aaa-4f55-a25a-e5370456135c,network=Network(fb9ae39b-117a-4cca-8080-683f63e8a318),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3c034fd-3a')
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] No VIF found with MAC fa:16:3e:95:65:6f, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.network.neutron [req-252d505d-19f1-434f-8cf6-56c278cdb5cc req-da09068e-67b3-4e3f-85c7-89bcc2c23cd1 service nova] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Updated VIF entry in instance network info cache for port f3c034fd-3aaa-4f55-a25a-e5370456135c. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG nova.network.neutron [req-252d505d-19f1-434f-8cf6-56c278cdb5cc req-da09068e-67b3-4e3f-85c7-89bcc2c23cd1 service nova] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Updating instance_info_cache with network_info: [{"id": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "address": "fa:16:3e:95:65:6f", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c034fd-3a", "ovs_interfaceid": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:56:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-252d505d-19f1-434f-8cf6-56c278cdb5cc req-da09068e-67b3-4e3f-85c7-89bcc2c23cd1 service nova] Releasing lock "refresh_cache-bebd5a14-6272-4de1-a1a1-4fb45b867c7f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:56:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:22 user nova-compute[72809]: DEBUG nova.compute.manager [req-03428393-ec3e-49d6-8f85-ef7f1d4a6a28 req-7eb4d6d4-9fee-4486-9d3d-2c7b20386437 service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Received event network-vif-plugged-81017ed8-c816-4a5d-aa4f-eb16d863571f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:56:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-03428393-ec3e-49d6-8f85-ef7f1d4a6a28 req-7eb4d6d4-9fee-4486-9d3d-2c7b20386437 service nova] Acquiring lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:56:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-03428393-ec3e-49d6-8f85-ef7f1d4a6a28 req-7eb4d6d4-9fee-4486-9d3d-2c7b20386437 service nova] Lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:56:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-03428393-ec3e-49d6-8f85-ef7f1d4a6a28 req-7eb4d6d4-9fee-4486-9d3d-2c7b20386437 service nova] Lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:56:22 user nova-compute[72809]: DEBUG nova.compute.manager [req-03428393-ec3e-49d6-8f85-ef7f1d4a6a28 req-7eb4d6d4-9fee-4486-9d3d-2c7b20386437 service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] No waiting events found dispatching network-vif-plugged-81017ed8-c816-4a5d-aa4f-eb16d863571f {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:56:22 user nova-compute[72809]: WARNING nova.compute.manager [req-03428393-ec3e-49d6-8f85-ef7f1d4a6a28 req-7eb4d6d4-9fee-4486-9d3d-2c7b20386437 service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Received unexpected event network-vif-plugged-81017ed8-c816-4a5d-aa4f-eb16d863571f for instance with vm_state building and task_state spawning.
Aug 09 06:56:22 user nova-compute[72809]: DEBUG nova.compute.manager [req-2d4727c2-6aaf-483d-8079-c9ea6e57207f req-0afa6cfc-b634-45a0-892e-c6eeff05789a service nova] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Received event network-vif-plugged-f3c034fd-3aaa-4f55-a25a-e5370456135c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:56:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2d4727c2-6aaf-483d-8079-c9ea6e57207f req-0afa6cfc-b634-45a0-892e-c6eeff05789a service nova] Acquiring lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:56:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2d4727c2-6aaf-483d-8079-c9ea6e57207f req-0afa6cfc-b634-45a0-892e-c6eeff05789a service nova] Lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:56:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2d4727c2-6aaf-483d-8079-c9ea6e57207f req-0afa6cfc-b634-45a0-892e-c6eeff05789a service nova] Lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:56:22 user nova-compute[72809]: DEBUG nova.compute.manager [req-2d4727c2-6aaf-483d-8079-c9ea6e57207f req-0afa6cfc-b634-45a0-892e-c6eeff05789a service nova] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] No waiting events found dispatching network-vif-plugged-f3c034fd-3aaa-4f55-a25a-e5370456135c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:56:22 user nova-compute[72809]: WARNING nova.compute.manager [req-2d4727c2-6aaf-483d-8079-c9ea6e57207f req-0afa6cfc-b634-45a0-892e-c6eeff05789a service nova] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Received unexpected event network-vif-plugged-f3c034fd-3aaa-4f55-a25a-e5370456135c for instance with vm_state building and task_state spawning.
Aug 09 06:56:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:24 user nova-compute[72809]: DEBUG nova.compute.manager [req-b0e8c875-f23b-4312-93f6-9d9ebee274b0 req-47af1aef-05d3-4e6f-b6e6-58f3ef8a647d service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Received event network-vif-plugged-81017ed8-c816-4a5d-aa4f-eb16d863571f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:56:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b0e8c875-f23b-4312-93f6-9d9ebee274b0 req-47af1aef-05d3-4e6f-b6e6-58f3ef8a647d service nova] Acquiring lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:56:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b0e8c875-f23b-4312-93f6-9d9ebee274b0 req-47af1aef-05d3-4e6f-b6e6-58f3ef8a647d service nova] Lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:56:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b0e8c875-f23b-4312-93f6-9d9ebee274b0 req-47af1aef-05d3-4e6f-b6e6-58f3ef8a647d service nova] Lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:56:24 user nova-compute[72809]: DEBUG nova.compute.manager [req-b0e8c875-f23b-4312-93f6-9d9ebee274b0 req-47af1aef-05d3-4e6f-b6e6-58f3ef8a647d service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] No waiting events found dispatching network-vif-plugged-81017ed8-c816-4a5d-aa4f-eb16d863571f {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:56:24 user nova-compute[72809]: WARNING nova.compute.manager [req-b0e8c875-f23b-4312-93f6-9d9ebee274b0 req-47af1aef-05d3-4e6f-b6e6-58f3ef8a647d service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Received unexpected event network-vif-plugged-81017ed8-c816-4a5d-aa4f-eb16d863571f for instance with vm_state building and task_state spawning.
Aug 09 06:56:24 user nova-compute[72809]: DEBUG nova.compute.manager [req-7a636d21-0991-46f6-8c50-4adac49e4f5f req-d3fab917-fe4e-41b5-be31-1dee3dacee29 service nova] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Received event network-vif-plugged-f3c034fd-3aaa-4f55-a25a-e5370456135c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:56:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7a636d21-0991-46f6-8c50-4adac49e4f5f req-d3fab917-fe4e-41b5-be31-1dee3dacee29 service nova] Acquiring lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:56:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7a636d21-0991-46f6-8c50-4adac49e4f5f req-d3fab917-fe4e-41b5-be31-1dee3dacee29 service nova] Lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:56:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7a636d21-0991-46f6-8c50-4adac49e4f5f req-d3fab917-fe4e-41b5-be31-1dee3dacee29 service nova] Lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:56:24 user nova-compute[72809]: DEBUG nova.compute.manager [req-7a636d21-0991-46f6-8c50-4adac49e4f5f req-d3fab917-fe4e-41b5-be31-1dee3dacee29 service nova] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] No waiting events found dispatching network-vif-plugged-f3c034fd-3aaa-4f55-a25a-e5370456135c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:56:24 user nova-compute[72809]: WARNING nova.compute.manager [req-7a636d21-0991-46f6-8c50-4adac49e4f5f req-d3fab917-fe4e-41b5-be31-1dee3dacee29 service nova] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Received unexpected event network-vif-plugged-f3c034fd-3aaa-4f55-a25a-e5370456135c for instance with vm_state building and task_state spawning.
Aug 09 06:56:25 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564185.0509744, bebd5a14-6272-4de1-a1a1-4fb45b867c7f => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:56:25 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] VM Resumed (Lifecycle Event)
Aug 09 06:56:25 user nova-compute[72809]: DEBUG nova.compute.manager [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:56:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 06:56:25 user nova-compute[72809]: DEBUG nova.compute.manager [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:56:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 06:56:25 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Instance spawned successfully.
Aug 09 06:56:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 06:56:25 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:56:25 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Instance spawned successfully.
Aug 09 06:56:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 06:56:25 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:56:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:56:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:56:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:56:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:56:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:56:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:56:25 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:56:25 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564185.0524223, 1bde423f-0b73-448f-bdce-8d6af96d8fc6 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:56:25 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] VM Resumed (Lifecycle Event)
Aug 09 06:56:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:56:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:56:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:56:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:56:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:56:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:56:25 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:56:25 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:56:25 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:56:25 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564185.0541184, 1bde423f-0b73-448f-bdce-8d6af96d8fc6 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:56:25 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] VM Started (Lifecycle Event)
Aug 09 06:56:25 user nova-compute[72809]: INFO nova.compute.manager [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Took 7.69 seconds to spawn the instance on the hypervisor.
Aug 09 06:56:25 user nova-compute[72809]: DEBUG nova.compute.manager [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:56:25 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:56:25 user nova-compute[72809]: INFO nova.compute.manager [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Took 6.65 seconds to spawn the instance on the hypervisor.
Aug 09 06:56:25 user nova-compute[72809]: DEBUG nova.compute.manager [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:56:25 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:56:25 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:56:25 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564185.0543308, bebd5a14-6272-4de1-a1a1-4fb45b867c7f => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:56:25 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] VM Started (Lifecycle Event)
Aug 09 06:56:25 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:56:25 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:56:25 user nova-compute[72809]: INFO nova.compute.manager [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Took 8.54 seconds to build instance.
Aug 09 06:56:25 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:56:25 user nova-compute[72809]: INFO nova.compute.manager [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Took 7.76 seconds to build instance.
Aug 09 06:56:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8f26e672-1107-4baa-a505-6b7a688e56da tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.645s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:56:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4396c96c-3770-497c-af91-94569c6f681f tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.878s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:56:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:26 user nova-compute[72809]: DEBUG nova.objects.instance [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lazy-loading 'flavor' on Instance uuid 24ba9b41-d0bf-4a84-9f04-bfda9525b154 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:56:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "refresh_cache-24ba9b41-d0bf-4a84-9f04-bfda9525b154" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:56:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquired lock "refresh_cache-24ba9b41-d0bf-4a84-9f04-bfda9525b154" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:56:26 user nova-compute[72809]: DEBUG nova.network.neutron [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:56:26 user nova-compute[72809]: DEBUG nova.objects.instance [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lazy-loading 'info_cache' on Instance uuid 24ba9b41-d0bf-4a84-9f04-bfda9525b154 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG nova.network.neutron [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Updating instance_info_cache with network_info: [{"id": "f12bff80-425f-42ba-804d-540ad751f70c", "address": "fa:16:3e:36:6c:27", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12bff80-42", "ovs_interfaceid": "f12bff80-425f-42ba-804d-540ad751f70c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Releasing lock "refresh_cache-24ba9b41-d0bf-4a84-9f04-bfda9525b154" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:56:27 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Instance destroyed successfully.
Aug 09 06:56:27 user nova-compute[72809]: DEBUG nova.objects.instance [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lazy-loading 'resources' on Instance uuid 24ba9b41-d0bf-4a84-9f04-bfda9525b154 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:48:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-450574580',display_name='tempest-AttachVolumeTestJSON-server-450574580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-450574580',id=2,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDJ0cgVVGdxmBusvy2LpBlTCELREPHX0PiRGBl4xUaShS+GxBoB6howy4sQdzJp5xGl40sCcx5e/0j2dhekoUvRjUbaKjJ/gVIKho4UvqK2B4IB5h/y1k8THmm8SIXqLw==',key_name='tempest-keypair-1151798744',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:48:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='55a7945f87914776a3f58bda58b7c90c',ramdisk_id='',reservation_id='r-0e3nfuh3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1328011883',owner_user_name='tempest-AttachVolumeTestJSON-1328011883-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:54:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87785e8362a14385a951638f4d7cf817',uuid=24ba9b41-d0bf-4a84-9f04-bfda9525b154,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f12bff80-425f-42ba-804d-540ad751f70c", "address": "fa:16:3e:36:6c:27", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12bff80-42", "ovs_interfaceid": "f12bff80-425f-42ba-804d-540ad751f70c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Converting VIF {"id": "f12bff80-425f-42ba-804d-540ad751f70c", "address": "fa:16:3e:36:6c:27", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12bff80-42", "ovs_interfaceid": "f12bff80-425f-42ba-804d-540ad751f70c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:6c:27,bridge_name='br-int',has_traffic_filtering=True,id=f12bff80-425f-42ba-804d-540ad751f70c,network=Network(3430cb1f-9729-4613-bc8b-0fcdafd88198),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12bff80-42') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG os_vif [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:6c:27,bridge_name='br-int',has_traffic_filtering=True,id=f12bff80-425f-42ba-804d-540ad751f70c,network=Network(3430cb1f-9729-4613-bc8b-0fcdafd88198),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12bff80-42') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf12bff80-42, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:56:27 user nova-compute[72809]: INFO os_vif [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:6c:27,bridge_name='br-int',has_traffic_filtering=True,id=f12bff80-425f-42ba-804d-540ad751f70c,network=Network(3430cb1f-9729-4613-bc8b-0fcdafd88198),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12bff80-42')
Aug 09 06:56:27 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Start _get_guest_xml network_info=[{"id": "f12bff80-425f-42ba-804d-540ad751f70c", "address": "fa:16:3e:36:6c:27", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12bff80-42", "ovs_interfaceid": "f12bff80-425f-42ba-804d-540ad751f70c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG nova.objects.instance [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lazy-loading 'numa_topology' on Instance uuid 24ba9b41-d0bf-4a84-9f04-bfda9525b154 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:56:27 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:56:27 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:56:27 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG nova.objects.instance [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lazy-loading 'vcpu_model' on Instance uuid 24ba9b41-d0bf-4a84-9f04-bfda9525b154 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:48:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-450574580',display_name='tempest-AttachVolumeTestJSON-server-450574580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-450574580',id=2,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDJ0cgVVGdxmBusvy2LpBlTCELREPHX0PiRGBl4xUaShS+GxBoB6howy4sQdzJp5xGl40sCcx5e/0j2dhekoUvRjUbaKjJ/gVIKho4UvqK2B4IB5h/y1k8THmm8SIXqLw==',key_name='tempest-keypair-1151798744',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:48:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='55a7945f87914776a3f58bda58b7c90c',ramdisk_id='',reservation_id='r-0e3nfuh3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1328011883',owner_user_name='tempest-AttachVolumeTestJSON-1328011883-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:54:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87785e8362a14385a951638f4d7cf817',uuid=24ba9b41-d0bf-4a84-9f04-bfda9525b154,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f12bff80-425f-42ba-804d-540ad751f70c", "address": "fa:16:3e:36:6c:27", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12bff80-42", "ovs_interfaceid": "f12bff80-425f-42ba-804d-540ad751f70c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Converting VIF {"id": "f12bff80-425f-42ba-804d-540ad751f70c", "address": "fa:16:3e:36:6c:27", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12bff80-42", "ovs_interfaceid": "f12bff80-425f-42ba-804d-540ad751f70c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:6c:27,bridge_name='br-int',has_traffic_filtering=True,id=f12bff80-425f-42ba-804d-540ad751f70c,network=Network(3430cb1f-9729-4613-bc8b-0fcdafd88198),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12bff80-42') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG nova.objects.instance [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lazy-loading 'pci_devices' on Instance uuid 24ba9b41-d0bf-4a84-9f04-bfda9525b154 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:56:27 user nova-compute[72809]:   <uuid>24ba9b41-d0bf-4a84-9f04-bfda9525b154</uuid>
Aug 09 06:56:27 user nova-compute[72809]:   <name>instance-00000002</name>
Aug 09 06:56:27 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:56:27 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:56:27 user nova-compute[72809]:   <metadata>
Aug 09 06:56:27 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:56:27 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:56:27 user nova-compute[72809]:       <nova:name>tempest-AttachVolumeTestJSON-server-450574580</nova:name>
Aug 09 06:56:27 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:56:27</nova:creationTime>
Aug 09 06:56:27 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:56:27 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:56:27 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:56:27 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:56:27 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:56:27 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:56:27 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:56:27 user nova-compute[72809]:       <nova:owner>
Aug 09 06:56:27 user nova-compute[72809]:         <nova:user uuid="87785e8362a14385a951638f4d7cf817">tempest-AttachVolumeTestJSON-1328011883-project-member</nova:user>
Aug 09 06:56:27 user nova-compute[72809]:         <nova:project uuid="55a7945f87914776a3f58bda58b7c90c">tempest-AttachVolumeTestJSON-1328011883</nova:project>
Aug 09 06:56:27 user nova-compute[72809]:       </nova:owner>
Aug 09 06:56:27 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:56:27 user nova-compute[72809]:       <nova:ports>
Aug 09 06:56:27 user nova-compute[72809]:         <nova:port uuid="f12bff80-425f-42ba-804d-540ad751f70c">
Aug 09 06:56:27 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 06:56:27 user nova-compute[72809]:         </nova:port>
Aug 09 06:56:27 user nova-compute[72809]:       </nova:ports>
Aug 09 06:56:27 user nova-compute[72809]:     </nova:instance>
Aug 09 06:56:27 user nova-compute[72809]:   </metadata>
Aug 09 06:56:27 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:56:27 user nova-compute[72809]:     <system>
Aug 09 06:56:27 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:56:27 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:56:27 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:56:27 user nova-compute[72809]:       <entry name="serial">24ba9b41-d0bf-4a84-9f04-bfda9525b154</entry>
Aug 09 06:56:27 user nova-compute[72809]:       <entry name="uuid">24ba9b41-d0bf-4a84-9f04-bfda9525b154</entry>
Aug 09 06:56:27 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:56:27 user nova-compute[72809]:     </system>
Aug 09 06:56:27 user nova-compute[72809]:   </sysinfo>
Aug 09 06:56:27 user nova-compute[72809]:   <os>
Aug 09 06:56:27 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:56:27 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 06:56:27 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:56:27 user nova-compute[72809]:   </os>
Aug 09 06:56:27 user nova-compute[72809]:   <features>
Aug 09 06:56:27 user nova-compute[72809]:     <acpi/>
Aug 09 06:56:27 user nova-compute[72809]:     <apic/>
Aug 09 06:56:27 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:56:27 user nova-compute[72809]:   </features>
Aug 09 06:56:27 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:56:27 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:56:27 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:56:27 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:56:27 user nova-compute[72809]:   </clock>
Aug 09 06:56:27 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:56:27 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:56:27 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:56:27 user nova-compute[72809]:   </cpu>
Aug 09 06:56:27 user nova-compute[72809]:   <devices>
Aug 09 06:56:27 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:56:27 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:56:27 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk"/>
Aug 09 06:56:27 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:56:27 user nova-compute[72809]:     </disk>
Aug 09 06:56:27 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:56:27 user nova-compute[72809]:       <mac address="fa:16:3e:36:6c:27"/>
Aug 09 06:56:27 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:56:27 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:56:27 user nova-compute[72809]:       <target dev="tapf12bff80-42"/>
Aug 09 06:56:27 user nova-compute[72809]:     </interface>
Aug 09 06:56:27 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:56:27 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/console.log" append="off"/>
Aug 09 06:56:27 user nova-compute[72809]:     </serial>
Aug 09 06:56:27 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:56:27 user nova-compute[72809]:     <video>
Aug 09 06:56:27 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:56:27 user nova-compute[72809]:     </video>
Aug 09 06:56:27 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:56:27 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:56:27 user nova-compute[72809]:     </rng>
Aug 09 06:56:27 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:56:27 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:56:27 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:56:27 user nova-compute[72809]:     </memballoon>
Aug 09 06:56:27 user nova-compute[72809]:   </devices>
Aug 09 06:56:27 user nova-compute[72809]: </domain>
Aug 09 06:56:27 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:28 user nova-compute[72809]: DEBUG nova.objects.instance [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lazy-loading 'trusted_certs' on Instance uuid 24ba9b41-d0bf-4a84-9f04-bfda9525b154 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:56:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.142s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:28 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Checking if we can resize image /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 06:56:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:28 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Cannot resize image /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 06:56:28 user nova-compute[72809]: DEBUG nova.objects.instance [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lazy-loading 'migration_context' on Instance uuid 24ba9b41-d0bf-4a84-9f04-bfda9525b154 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:56:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:48:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-450574580',display_name='tempest-AttachVolumeTestJSON-server-450574580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-450574580',id=2,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDJ0cgVVGdxmBusvy2LpBlTCELREPHX0PiRGBl4xUaShS+GxBoB6howy4sQdzJp5xGl40sCcx5e/0j2dhekoUvRjUbaKjJ/gVIKho4UvqK2B4IB5h/y1k8THmm8SIXqLw==',key_name='tempest-keypair-1151798744',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:48:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='55a7945f87914776a3f58bda58b7c90c',ramdisk_id='',reservation_id='r-0e3nfuh3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1328011883',owner_user_name='tempest-AttachVolumeTestJSON-1328011883-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:54:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87785e8362a14385a951638f4d7cf817',uuid=24ba9b41-d0bf-4a84-9f04-bfda9525b154,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f12bff80-425f-42ba-804d-540ad751f70c", "address": "fa:16:3e:36:6c:27", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12bff80-42", "ovs_interfaceid": "f12bff80-425f-42ba-804d-540ad751f70c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:56:28 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Converting VIF {"id": "f12bff80-425f-42ba-804d-540ad751f70c", "address": "fa:16:3e:36:6c:27", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12bff80-42", "ovs_interfaceid": "f12bff80-425f-42ba-804d-540ad751f70c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:56:28 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:6c:27,bridge_name='br-int',has_traffic_filtering=True,id=f12bff80-425f-42ba-804d-540ad751f70c,network=Network(3430cb1f-9729-4613-bc8b-0fcdafd88198),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12bff80-42') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:56:28 user nova-compute[72809]: DEBUG os_vif [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:6c:27,bridge_name='br-int',has_traffic_filtering=True,id=f12bff80-425f-42ba-804d-540ad751f70c,network=Network(3430cb1f-9729-4613-bc8b-0fcdafd88198),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12bff80-42') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:56:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:56:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:56:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf12bff80-42, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:56:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf12bff80-42, col_values=(('external_ids', {'iface-id': 'f12bff80-425f-42ba-804d-540ad751f70c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:6c:27', 'vm-uuid': '24ba9b41-d0bf-4a84-9f04-bfda9525b154'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:56:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:56:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:28 user nova-compute[72809]: INFO os_vif [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:6c:27,bridge_name='br-int',has_traffic_filtering=True,id=f12bff80-425f-42ba-804d-540ad751f70c,network=Network(3430cb1f-9729-4613-bc8b-0fcdafd88198),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12bff80-42')
Aug 09 06:56:28 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:56:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-5f1bb99b-b9db-4a66-aeae-72b2a11f101c req-084cd16f-f9a0-4dba-97e7-79d26c06ed5e service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Received event network-vif-plugged-f12bff80-425f-42ba-804d-540ad751f70c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:56:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5f1bb99b-b9db-4a66-aeae-72b2a11f101c req-084cd16f-f9a0-4dba-97e7-79d26c06ed5e service nova] Acquiring lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:56:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5f1bb99b-b9db-4a66-aeae-72b2a11f101c req-084cd16f-f9a0-4dba-97e7-79d26c06ed5e service nova] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:56:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5f1bb99b-b9db-4a66-aeae-72b2a11f101c req-084cd16f-f9a0-4dba-97e7-79d26c06ed5e service nova] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:56:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-5f1bb99b-b9db-4a66-aeae-72b2a11f101c req-084cd16f-f9a0-4dba-97e7-79d26c06ed5e service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] No waiting events found dispatching network-vif-plugged-f12bff80-425f-42ba-804d-540ad751f70c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:56:30 user nova-compute[72809]: WARNING nova.compute.manager [req-5f1bb99b-b9db-4a66-aeae-72b2a11f101c req-084cd16f-f9a0-4dba-97e7-79d26c06ed5e service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Received unexpected event network-vif-plugged-f12bff80-425f-42ba-804d-540ad751f70c for instance with vm_state stopped and task_state powering-on.
Aug 09 06:56:30 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:56:30 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 06:56:30 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Rebuilding the list of instances to heal {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 06:56:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-24ba9b41-d0bf-4a84-9f04-bfda9525b154" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:56:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-24ba9b41-d0bf-4a84-9f04-bfda9525b154" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:56:30 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 06:56:30 user nova-compute[72809]: DEBUG nova.objects.instance [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lazy-loading 'info_cache' on Instance uuid 24ba9b41-d0bf-4a84-9f04-bfda9525b154 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:56:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:31 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Updating instance_info_cache with network_info: [{"id": "f12bff80-425f-42ba-804d-540ad751f70c", "address": "fa:16:3e:36:6c:27", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12bff80-42", "ovs_interfaceid": "f12bff80-425f-42ba-804d-540ad751f70c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:56:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-24ba9b41-d0bf-4a84-9f04-bfda9525b154" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:56:31 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 06:56:31 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:56:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:56:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:56:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:56:31 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 06:56:32 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564192.44607, 24ba9b41-d0bf-4a84-9f04-bfda9525b154 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:56:32 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] VM Resumed (Lifecycle Event)
Aug 09 06:56:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:56:32 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Instance rebooted successfully.
Aug 09 06:56:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-2b801e92-d2ed-4f84-8eaf-f887ecc2d52a tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:56:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:56:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:56:32 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 09 06:56:32 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564192.44738, 24ba9b41-d0bf-4a84-9f04-bfda9525b154 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:56:32 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] VM Started (Lifecycle Event)
Aug 09 06:56:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:56:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:56:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:32 user nova-compute[72809]: DEBUG nova.compute.manager [req-e1e59c69-8fd9-47fa-8ca3-7aee94b727f1 req-9a70ba1d-74ab-445a-a515-cfce186173b4 service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Received event network-vif-plugged-f12bff80-425f-42ba-804d-540ad751f70c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:56:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e1e59c69-8fd9-47fa-8ca3-7aee94b727f1 req-9a70ba1d-74ab-445a-a515-cfce186173b4 service nova] Acquiring lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:56:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e1e59c69-8fd9-47fa-8ca3-7aee94b727f1 req-9a70ba1d-74ab-445a-a515-cfce186173b4 service nova] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:56:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e1e59c69-8fd9-47fa-8ca3-7aee94b727f1 req-9a70ba1d-74ab-445a-a515-cfce186173b4 service nova] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:56:32 user nova-compute[72809]: DEBUG nova.compute.manager [req-e1e59c69-8fd9-47fa-8ca3-7aee94b727f1 req-9a70ba1d-74ab-445a-a515-cfce186173b4 service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] No waiting events found dispatching network-vif-plugged-f12bff80-425f-42ba-804d-540ad751f70c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:56:32 user nova-compute[72809]: WARNING nova.compute.manager [req-e1e59c69-8fd9-47fa-8ca3-7aee94b727f1 req-9a70ba1d-74ab-445a-a515-cfce186173b4 service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Received unexpected event network-vif-plugged-f12bff80-425f-42ba-804d-540ad751f70c for instance with vm_state active and task_state None.
Aug 09 06:56:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 06:56:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:34 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 06:56:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:35 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:56:35 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:56:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=7855MB free_disk=25.555179595947266GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 06:56:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:56:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:56:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 24ba9b41-d0bf-4a84-9f04-bfda9525b154 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:56:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 15dda080-3487-4316-ab7b-f7185f0a4519 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:56:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 336770eb-4f09-4134-92ef-f96039bf4fa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:56:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 5251cef4-9a49-4220-984e-75d1198f95b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:56:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance aec0a7ee-69e1-41cf-bfa8-5733bdedd70a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:56:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 1bde423f-0b73-448f-bdce-8d6af96d8fc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:56:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance bebd5a14-6272-4de1-a1a1-4fb45b867c7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:56:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 06:56:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 06:56:35 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:35 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:56:35 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:56:36 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 06:56:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.579s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:56:37 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:56:37 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:56:37 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:56:37 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:56:37 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:56:37 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:56:37 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 06:56:37 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:56:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:43 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:43 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquiring lock "6d210e25-aa29-40a5-ad99-27e54a51dd7a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:56:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "6d210e25-aa29-40a5-ad99-27e54a51dd7a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:56:58 user nova-compute[72809]: DEBUG nova.compute.manager [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 06:56:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:56:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:56:59 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 06:56:59 user nova-compute[72809]: INFO nova.compute.claims [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Claim successful on node user
Aug 09 06:56:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:56:59 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:56:59 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:56:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.395s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:56:59 user nova-compute[72809]: DEBUG nova.compute.manager [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 06:56:59 user nova-compute[72809]: DEBUG nova.compute.manager [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 06:56:59 user nova-compute[72809]: DEBUG nova.network.neutron [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 06:56:59 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 06:56:59 user nova-compute[72809]: DEBUG nova.compute.manager [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 06:56:59 user nova-compute[72809]: DEBUG nova.compute.manager [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 06:56:59 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 06:56:59 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Creating image(s)
Aug 09 06:56:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquiring lock "/opt/stack/data/nova/instances/6d210e25-aa29-40a5-ad99-27e54a51dd7a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:56:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "/opt/stack/data/nova/instances/6d210e25-aa29-40a5-ad99-27e54a51dd7a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:56:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "/opt/stack/data/nova/instances/6d210e25-aa29-40a5-ad99-27e54a51dd7a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:56:59 user nova-compute[72809]: DEBUG nova.policy [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b9b206fdca44420984d9c279db01ef1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e442312164689bdd7686973d25eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 06:56:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:56:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.168s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:56:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:56:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:56:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.155s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/6d210e25-aa29-40a5-ad99-27e54a51dd7a/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/6d210e25-aa29-40a5-ad99-27e54a51dd7a/disk 1073741824" returned: 0 in 0.061s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.158s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:00 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6d210e25-aa29-40a5-ad99-27e54a51dd7a/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 06:57:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d210e25-aa29-40a5-ad99-27e54a51dd7a/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d210e25-aa29-40a5-ad99-27e54a51dd7a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:00 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Cannot resize image /opt/stack/data/nova/instances/6d210e25-aa29-40a5-ad99-27e54a51dd7a/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 06:57:00 user nova-compute[72809]: DEBUG nova.objects.instance [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lazy-loading 'migration_context' on Instance uuid 6d210e25-aa29-40a5-ad99-27e54a51dd7a {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:57:00 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 06:57:00 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Ensure instance console log exists: /opt/stack/data/nova/instances/6d210e25-aa29-40a5-ad99-27e54a51dd7a/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 06:57:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:00 user nova-compute[72809]: DEBUG nova.network.neutron [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Successfully created port: 245f99b8-570d-4077-b3ca-f05f03b309f2 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.network.neutron [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Successfully updated port: 245f99b8-570d-4077-b3ca-f05f03b309f2 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquiring lock "refresh_cache-6d210e25-aa29-40a5-ad99-27e54a51dd7a" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquired lock "refresh_cache-6d210e25-aa29-40a5-ad99-27e54a51dd7a" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.network.neutron [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.compute.manager [req-01164073-dd92-43c1-9e4f-7a4a4af96c92 req-6c470479-7225-4714-ac6b-b843247a71b0 service nova] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Received event network-changed-245f99b8-570d-4077-b3ca-f05f03b309f2 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.compute.manager [req-01164073-dd92-43c1-9e4f-7a4a4af96c92 req-6c470479-7225-4714-ac6b-b843247a71b0 service nova] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Refreshing instance network info cache due to event network-changed-245f99b8-570d-4077-b3ca-f05f03b309f2. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-01164073-dd92-43c1-9e4f-7a4a4af96c92 req-6c470479-7225-4714-ac6b-b843247a71b0 service nova] Acquiring lock "refresh_cache-6d210e25-aa29-40a5-ad99-27e54a51dd7a" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.network.neutron [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.network.neutron [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Updating instance_info_cache with network_info: [{"id": "245f99b8-570d-4077-b3ca-f05f03b309f2", "address": "fa:16:3e:53:81:3e", "network": {"id": "ae760578-06b0-479a-9f75-b5e781b1a087", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-541750148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76e442312164689bdd7686973d25eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245f99b8-57", "ovs_interfaceid": "245f99b8-570d-4077-b3ca-f05f03b309f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Releasing lock "refresh_cache-6d210e25-aa29-40a5-ad99-27e54a51dd7a" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.compute.manager [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Instance network_info: |[{"id": "245f99b8-570d-4077-b3ca-f05f03b309f2", "address": "fa:16:3e:53:81:3e", "network": {"id": "ae760578-06b0-479a-9f75-b5e781b1a087", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-541750148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76e442312164689bdd7686973d25eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245f99b8-57", "ovs_interfaceid": "245f99b8-570d-4077-b3ca-f05f03b309f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-01164073-dd92-43c1-9e4f-7a4a4af96c92 req-6c470479-7225-4714-ac6b-b843247a71b0 service nova] Acquired lock "refresh_cache-6d210e25-aa29-40a5-ad99-27e54a51dd7a" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.network.neutron [req-01164073-dd92-43c1-9e4f-7a4a4af96c92 req-6c470479-7225-4714-ac6b-b843247a71b0 service nova] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Refreshing network info cache for port 245f99b8-570d-4077-b3ca-f05f03b309f2 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Start _get_guest_xml network_info=[{"id": "245f99b8-570d-4077-b3ca-f05f03b309f2", "address": "fa:16:3e:53:81:3e", "network": {"id": "ae760578-06b0-479a-9f75-b5e781b1a087", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-541750148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76e442312164689bdd7686973d25eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245f99b8-57", "ovs_interfaceid": "245f99b8-570d-4077-b3ca-f05f03b309f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:57:01 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:57:01 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:56:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1705077597',display_name='tempest-VolumesSnapshotTestJSON-instance-1705077597',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1705077597',id=21,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmBzWuN9YAlVUXZ78dlLpVz2jDo6e+cwdcghKhC7Jw8Tg31xweUVMVvsm8ADEDDKY2gTpfz95vDn16G4HPtSeRXlbQtZc0g5xZO+CCYTQHnLqFXjj+ePS2O06qcds1aWw==',key_name='tempest-keypair-926098464',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f76e442312164689bdd7686973d25eda',ramdisk_id='',reservation_id='r-3lraetbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1130129930',owner_user_name='tempest-VolumesSnapshotTestJSON-1130129930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:57:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9b206fdca44420984d9c279db01ef1b',uuid=6d210e25-aa29-40a5-ad99-27e54a51dd7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "245f99b8-570d-4077-b3ca-f05f03b309f2", "address": "fa:16:3e:53:81:3e", "network": {"id": "ae760578-06b0-479a-9f75-b5e781b1a087", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-541750148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76e442312164689bdd7686973d25eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245f99b8-57", "ovs_interfaceid": "245f99b8-570d-4077-b3ca-f05f03b309f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Converting VIF {"id": "245f99b8-570d-4077-b3ca-f05f03b309f2", "address": "fa:16:3e:53:81:3e", "network": {"id": "ae760578-06b0-479a-9f75-b5e781b1a087", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-541750148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76e442312164689bdd7686973d25eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245f99b8-57", "ovs_interfaceid": "245f99b8-570d-4077-b3ca-f05f03b309f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:81:3e,bridge_name='br-int',has_traffic_filtering=True,id=245f99b8-570d-4077-b3ca-f05f03b309f2,network=Network(ae760578-06b0-479a-9f75-b5e781b1a087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap245f99b8-57') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.objects.instance [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d210e25-aa29-40a5-ad99-27e54a51dd7a {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:57:01 user nova-compute[72809]:   <uuid>6d210e25-aa29-40a5-ad99-27e54a51dd7a</uuid>
Aug 09 06:57:01 user nova-compute[72809]:   <name>instance-00000015</name>
Aug 09 06:57:01 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:57:01 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:57:01 user nova-compute[72809]:   <metadata>
Aug 09 06:57:01 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:57:01 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:57:01 user nova-compute[72809]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1705077597</nova:name>
Aug 09 06:57:01 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:57:01</nova:creationTime>
Aug 09 06:57:01 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:57:01 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:57:01 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:57:01 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:57:01 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:57:01 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:57:01 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:57:01 user nova-compute[72809]:       <nova:owner>
Aug 09 06:57:01 user nova-compute[72809]:         <nova:user uuid="b9b206fdca44420984d9c279db01ef1b">tempest-VolumesSnapshotTestJSON-1130129930-project-member</nova:user>
Aug 09 06:57:01 user nova-compute[72809]:         <nova:project uuid="f76e442312164689bdd7686973d25eda">tempest-VolumesSnapshotTestJSON-1130129930</nova:project>
Aug 09 06:57:01 user nova-compute[72809]:       </nova:owner>
Aug 09 06:57:01 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:57:01 user nova-compute[72809]:       <nova:ports>
Aug 09 06:57:01 user nova-compute[72809]:         <nova:port uuid="245f99b8-570d-4077-b3ca-f05f03b309f2">
Aug 09 06:57:01 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 06:57:01 user nova-compute[72809]:         </nova:port>
Aug 09 06:57:01 user nova-compute[72809]:       </nova:ports>
Aug 09 06:57:01 user nova-compute[72809]:     </nova:instance>
Aug 09 06:57:01 user nova-compute[72809]:   </metadata>
Aug 09 06:57:01 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:57:01 user nova-compute[72809]:     <system>
Aug 09 06:57:01 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:57:01 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:57:01 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:57:01 user nova-compute[72809]:       <entry name="serial">6d210e25-aa29-40a5-ad99-27e54a51dd7a</entry>
Aug 09 06:57:01 user nova-compute[72809]:       <entry name="uuid">6d210e25-aa29-40a5-ad99-27e54a51dd7a</entry>
Aug 09 06:57:01 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:57:01 user nova-compute[72809]:     </system>
Aug 09 06:57:01 user nova-compute[72809]:   </sysinfo>
Aug 09 06:57:01 user nova-compute[72809]:   <os>
Aug 09 06:57:01 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:57:01 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 06:57:01 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:57:01 user nova-compute[72809]:   </os>
Aug 09 06:57:01 user nova-compute[72809]:   <features>
Aug 09 06:57:01 user nova-compute[72809]:     <acpi/>
Aug 09 06:57:01 user nova-compute[72809]:     <apic/>
Aug 09 06:57:01 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:57:01 user nova-compute[72809]:   </features>
Aug 09 06:57:01 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:57:01 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:57:01 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:57:01 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:57:01 user nova-compute[72809]:   </clock>
Aug 09 06:57:01 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:57:01 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:57:01 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:57:01 user nova-compute[72809]:   </cpu>
Aug 09 06:57:01 user nova-compute[72809]:   <devices>
Aug 09 06:57:01 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:57:01 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:57:01 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/6d210e25-aa29-40a5-ad99-27e54a51dd7a/disk"/>
Aug 09 06:57:01 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:57:01 user nova-compute[72809]:     </disk>
Aug 09 06:57:01 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:57:01 user nova-compute[72809]:       <mac address="fa:16:3e:53:81:3e"/>
Aug 09 06:57:01 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:57:01 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:57:01 user nova-compute[72809]:       <target dev="tap245f99b8-57"/>
Aug 09 06:57:01 user nova-compute[72809]:     </interface>
Aug 09 06:57:01 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:57:01 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/6d210e25-aa29-40a5-ad99-27e54a51dd7a/console.log" append="off"/>
Aug 09 06:57:01 user nova-compute[72809]:     </serial>
Aug 09 06:57:01 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:57:01 user nova-compute[72809]:     <video>
Aug 09 06:57:01 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:57:01 user nova-compute[72809]:     </video>
Aug 09 06:57:01 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:57:01 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:57:01 user nova-compute[72809]:     </rng>
Aug 09 06:57:01 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:57:01 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:57:01 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:57:01 user nova-compute[72809]:     </memballoon>
Aug 09 06:57:01 user nova-compute[72809]:   </devices>
Aug 09 06:57:01 user nova-compute[72809]: </domain>
Aug 09 06:57:01 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:56:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1705077597',display_name='tempest-VolumesSnapshotTestJSON-instance-1705077597',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1705077597',id=21,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmBzWuN9YAlVUXZ78dlLpVz2jDo6e+cwdcghKhC7Jw8Tg31xweUVMVvsm8ADEDDKY2gTpfz95vDn16G4HPtSeRXlbQtZc0g5xZO+CCYTQHnLqFXjj+ePS2O06qcds1aWw==',key_name='tempest-keypair-926098464',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f76e442312164689bdd7686973d25eda',ramdisk_id='',reservation_id='r-3lraetbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1130129930',owner_user_name='tempest-VolumesSnapshotTestJSON-1130129930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:57:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9b206fdca44420984d9c279db01ef1b',uuid=6d210e25-aa29-40a5-ad99-27e54a51dd7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "245f99b8-570d-4077-b3ca-f05f03b309f2", "address": "fa:16:3e:53:81:3e", "network": {"id": "ae760578-06b0-479a-9f75-b5e781b1a087", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-541750148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76e442312164689bdd7686973d25eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245f99b8-57", "ovs_interfaceid": "245f99b8-570d-4077-b3ca-f05f03b309f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Converting VIF {"id": "245f99b8-570d-4077-b3ca-f05f03b309f2", "address": "fa:16:3e:53:81:3e", "network": {"id": "ae760578-06b0-479a-9f75-b5e781b1a087", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-541750148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76e442312164689bdd7686973d25eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245f99b8-57", "ovs_interfaceid": "245f99b8-570d-4077-b3ca-f05f03b309f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:81:3e,bridge_name='br-int',has_traffic_filtering=True,id=245f99b8-570d-4077-b3ca-f05f03b309f2,network=Network(ae760578-06b0-479a-9f75-b5e781b1a087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap245f99b8-57') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG os_vif [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:81:3e,bridge_name='br-int',has_traffic_filtering=True,id=245f99b8-570d-4077-b3ca-f05f03b309f2,network=Network(ae760578-06b0-479a-9f75-b5e781b1a087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap245f99b8-57') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap245f99b8-57, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap245f99b8-57, col_values=(('external_ids', {'iface-id': '245f99b8-570d-4077-b3ca-f05f03b309f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:81:3e', 'vm-uuid': '6d210e25-aa29-40a5-ad99-27e54a51dd7a'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:01 user nova-compute[72809]: INFO os_vif [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:81:3e,bridge_name='br-int',has_traffic_filtering=True,id=245f99b8-570d-4077-b3ca-f05f03b309f2,network=Network(ae760578-06b0-479a-9f75-b5e781b1a087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap245f99b8-57')
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:57:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] No VIF found with MAC fa:16:3e:53:81:3e, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:57:02 user nova-compute[72809]: DEBUG nova.network.neutron [req-01164073-dd92-43c1-9e4f-7a4a4af96c92 req-6c470479-7225-4714-ac6b-b843247a71b0 service nova] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Updated VIF entry in instance network info cache for port 245f99b8-570d-4077-b3ca-f05f03b309f2. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:57:02 user nova-compute[72809]: DEBUG nova.network.neutron [req-01164073-dd92-43c1-9e4f-7a4a4af96c92 req-6c470479-7225-4714-ac6b-b843247a71b0 service nova] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Updating instance_info_cache with network_info: [{"id": "245f99b8-570d-4077-b3ca-f05f03b309f2", "address": "fa:16:3e:53:81:3e", "network": {"id": "ae760578-06b0-479a-9f75-b5e781b1a087", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-541750148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76e442312164689bdd7686973d25eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245f99b8-57", "ovs_interfaceid": "245f99b8-570d-4077-b3ca-f05f03b309f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:57:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-01164073-dd92-43c1-9e4f-7a4a4af96c92 req-6c470479-7225-4714-ac6b-b843247a71b0 service nova] Releasing lock "refresh_cache-6d210e25-aa29-40a5-ad99-27e54a51dd7a" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:57:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:03 user nova-compute[72809]: DEBUG nova.compute.manager [req-1a6cd1be-b6d9-4bc8-80c7-e2e0048ce8af req-de70101f-9ef2-4e06-9c56-917e665da2c9 service nova] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Received event network-vif-plugged-245f99b8-570d-4077-b3ca-f05f03b309f2 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:57:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1a6cd1be-b6d9-4bc8-80c7-e2e0048ce8af req-de70101f-9ef2-4e06-9c56-917e665da2c9 service nova] Acquiring lock "6d210e25-aa29-40a5-ad99-27e54a51dd7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1a6cd1be-b6d9-4bc8-80c7-e2e0048ce8af req-de70101f-9ef2-4e06-9c56-917e665da2c9 service nova] Lock "6d210e25-aa29-40a5-ad99-27e54a51dd7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1a6cd1be-b6d9-4bc8-80c7-e2e0048ce8af req-de70101f-9ef2-4e06-9c56-917e665da2c9 service nova] Lock "6d210e25-aa29-40a5-ad99-27e54a51dd7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:03 user nova-compute[72809]: DEBUG nova.compute.manager [req-1a6cd1be-b6d9-4bc8-80c7-e2e0048ce8af req-de70101f-9ef2-4e06-9c56-917e665da2c9 service nova] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] No waiting events found dispatching network-vif-plugged-245f99b8-570d-4077-b3ca-f05f03b309f2 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:57:03 user nova-compute[72809]: WARNING nova.compute.manager [req-1a6cd1be-b6d9-4bc8-80c7-e2e0048ce8af req-de70101f-9ef2-4e06-9c56-917e665da2c9 service nova] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Received unexpected event network-vif-plugged-245f99b8-570d-4077-b3ca-f05f03b309f2 for instance with vm_state building and task_state spawning.
Aug 09 06:57:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:05 user nova-compute[72809]: DEBUG nova.compute.manager [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:57:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 06:57:05 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564225.6240213, 6d210e25-aa29-40a5-ad99-27e54a51dd7a => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:57:05 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] VM Resumed (Lifecycle Event)
Aug 09 06:57:05 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Instance spawned successfully.
Aug 09 06:57:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 06:57:05 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:57:05 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:57:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:57:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:57:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:57:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:57:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:57:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:57:05 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:57:05 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564225.625945, 6d210e25-aa29-40a5-ad99-27e54a51dd7a => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:57:05 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] VM Started (Lifecycle Event)
Aug 09 06:57:05 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:57:05 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:57:05 user nova-compute[72809]: DEBUG nova.compute.manager [req-71a0112b-ebac-4fe6-a5fc-01bfad333924 req-c04eb6cd-f19f-4516-b392-6f2b7221de1a service nova] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Received event network-vif-plugged-245f99b8-570d-4077-b3ca-f05f03b309f2 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:57:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-71a0112b-ebac-4fe6-a5fc-01bfad333924 req-c04eb6cd-f19f-4516-b392-6f2b7221de1a service nova] Acquiring lock "6d210e25-aa29-40a5-ad99-27e54a51dd7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-71a0112b-ebac-4fe6-a5fc-01bfad333924 req-c04eb6cd-f19f-4516-b392-6f2b7221de1a service nova] Lock "6d210e25-aa29-40a5-ad99-27e54a51dd7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-71a0112b-ebac-4fe6-a5fc-01bfad333924 req-c04eb6cd-f19f-4516-b392-6f2b7221de1a service nova] Lock "6d210e25-aa29-40a5-ad99-27e54a51dd7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:05 user nova-compute[72809]: DEBUG nova.compute.manager [req-71a0112b-ebac-4fe6-a5fc-01bfad333924 req-c04eb6cd-f19f-4516-b392-6f2b7221de1a service nova] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] No waiting events found dispatching network-vif-plugged-245f99b8-570d-4077-b3ca-f05f03b309f2 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:57:05 user nova-compute[72809]: WARNING nova.compute.manager [req-71a0112b-ebac-4fe6-a5fc-01bfad333924 req-c04eb6cd-f19f-4516-b392-6f2b7221de1a service nova] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Received unexpected event network-vif-plugged-245f99b8-570d-4077-b3ca-f05f03b309f2 for instance with vm_state building and task_state spawning.
Aug 09 06:57:05 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:57:05 user nova-compute[72809]: INFO nova.compute.manager [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Took 6.07 seconds to spawn the instance on the hypervisor.
Aug 09 06:57:05 user nova-compute[72809]: DEBUG nova.compute.manager [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:57:05 user nova-compute[72809]: INFO nova.compute.manager [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Took 6.86 seconds to build instance.
Aug 09 06:57:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6b2801df-7914-405d-a4d7-661785f727bb tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "6d210e25-aa29-40a5-ad99-27e54a51dd7a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.991s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:06 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:06 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:11 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:13 user nova-compute[72809]: DEBUG nova.compute.manager [req-b6c36c24-af68-4204-a50b-eaa8ce821887 req-a4409575-c607-4465-8a35-9cb50e884079 service nova] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Received event network-changed-0a2076a0-d9a0-4c09-9fcd-68011828f5e0 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:57:13 user nova-compute[72809]: DEBUG nova.compute.manager [req-b6c36c24-af68-4204-a50b-eaa8ce821887 req-a4409575-c607-4465-8a35-9cb50e884079 service nova] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Refreshing instance network info cache due to event network-changed-0a2076a0-d9a0-4c09-9fcd-68011828f5e0. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:57:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b6c36c24-af68-4204-a50b-eaa8ce821887 req-a4409575-c607-4465-8a35-9cb50e884079 service nova] Acquiring lock "refresh_cache-5251cef4-9a49-4220-984e-75d1198f95b6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:57:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b6c36c24-af68-4204-a50b-eaa8ce821887 req-a4409575-c607-4465-8a35-9cb50e884079 service nova] Acquired lock "refresh_cache-5251cef4-9a49-4220-984e-75d1198f95b6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:57:13 user nova-compute[72809]: DEBUG nova.network.neutron [req-b6c36c24-af68-4204-a50b-eaa8ce821887 req-a4409575-c607-4465-8a35-9cb50e884079 service nova] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Refreshing network info cache for port 0a2076a0-d9a0-4c09-9fcd-68011828f5e0 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:57:14 user nova-compute[72809]: DEBUG nova.network.neutron [req-b6c36c24-af68-4204-a50b-eaa8ce821887 req-a4409575-c607-4465-8a35-9cb50e884079 service nova] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Updated VIF entry in instance network info cache for port 0a2076a0-d9a0-4c09-9fcd-68011828f5e0. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:57:14 user nova-compute[72809]: DEBUG nova.network.neutron [req-b6c36c24-af68-4204-a50b-eaa8ce821887 req-a4409575-c607-4465-8a35-9cb50e884079 service nova] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Updating instance_info_cache with network_info: [{"id": "0a2076a0-d9a0-4c09-9fcd-68011828f5e0", "address": "fa:16:3e:6d:d2:82", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2076a0-d9", "ovs_interfaceid": "0a2076a0-d9a0-4c09-9fcd-68011828f5e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:57:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b6c36c24-af68-4204-a50b-eaa8ce821887 req-a4409575-c607-4465-8a35-9cb50e884079 service nova] Releasing lock "refresh_cache-5251cef4-9a49-4220-984e-75d1198f95b6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:57:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "5251cef4-9a49-4220-984e-75d1198f95b6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "5251cef4-9a49-4220-984e-75d1198f95b6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:18 user nova-compute[72809]: DEBUG nova.objects.instance [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lazy-loading 'flavor' on Instance uuid 5251cef4-9a49-4220-984e-75d1198f95b6 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:57:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "5251cef4-9a49-4220-984e-75d1198f95b6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "5251cef4-9a49-4220-984e-75d1198f95b6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "5251cef4-9a49-4220-984e-75d1198f95b6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:18 user nova-compute[72809]: INFO nova.compute.manager [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Attaching volume a4d75678-22d8-484d-abf4-58ef866de6bf to /dev/vdb
Aug 09 06:57:18 user nova-compute[72809]: DEBUG os_brick.utils [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:57:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:18 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3791f16-018e-4ef1-b02c-9c9c8404c1d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:18 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[099efbfd-343b-444d-be17-818d1d9fe5c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.050s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:18 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae1c85a-ed03-44da-9ece-1b3ebdc33240]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:18 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a583719-da66-4b92-9ed8-c7f89923d42b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:57:18 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 06:57:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:57:18 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 06:57:18 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e43defe-9c63-4993-8b5b-5227628ac1b8]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:18 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 06:57:18 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 06:57:18 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 06:57:18 user nova-compute[72809]: DEBUG os_brick.utils [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:57:18 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Updating existing volume attachment record: 6dc85ec6-29a8-46b5-9ce3-7aa9e584e27e {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 06:57:20 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "339372ed-140d-4226-ba00-2cc682214d5c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "339372ed-140d-4226-ba00-2cc682214d5c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:21 user nova-compute[72809]: DEBUG nova.compute.manager [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 06:57:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:21 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 06:57:21 user nova-compute[72809]: INFO nova.compute.claims [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Claim successful on node user
Aug 09 06:57:21 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:22 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:57:22 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:57:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:22 user nova-compute[72809]: DEBUG nova.compute.manager [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 06:57:22 user nova-compute[72809]: DEBUG nova.compute.manager [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 06:57:22 user nova-compute[72809]: DEBUG nova.network.neutron [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 06:57:22 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 06:57:22 user nova-compute[72809]: DEBUG nova.compute.manager [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 06:57:22 user nova-compute[72809]: DEBUG nova.compute.manager [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 06:57:22 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 06:57:22 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Creating image(s)
Aug 09 06:57:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "/opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "/opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "/opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:22 user nova-compute[72809]: DEBUG nova.policy [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c4c5942852b412885a5b4698552058d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1903437f7ed4c14a0660f64a2e0c647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 06:57:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.143s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.162s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk 1073741824" returned: 0 in 0.066s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.166s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:23 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Checking if we can resize image /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 06:57:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:23 user nova-compute[72809]: DEBUG nova.network.neutron [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Successfully created port: b50b65dc-a03d-4f22-bb35-f2b9dc67596d {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:57:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:23 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Cannot resize image /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 06:57:23 user nova-compute[72809]: DEBUG nova.objects.instance [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lazy-loading 'migration_context' on Instance uuid 339372ed-140d-4226-ba00-2cc682214d5c {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:57:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 06:57:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Ensure instance console log exists: /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 06:57:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "336770eb-4f09-4134-92ef-f96039bf4fa9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "336770eb-4f09-4134-92ef-f96039bf4fa9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:23 user nova-compute[72809]: DEBUG nova.objects.instance [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lazy-loading 'flavor' on Instance uuid 336770eb-4f09-4134-92ef-f96039bf4fa9 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:57:23 user nova-compute[72809]: DEBUG nova.network.neutron [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Successfully updated port: b50b65dc-a03d-4f22-bb35-f2b9dc67596d {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:57:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "336770eb-4f09-4134-92ef-f96039bf4fa9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "refresh_cache-339372ed-140d-4226-ba00-2cc682214d5c" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:57:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquired lock "refresh_cache-339372ed-140d-4226-ba00-2cc682214d5c" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:57:23 user nova-compute[72809]: DEBUG nova.network.neutron [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG nova.compute.manager [req-873a153c-36c7-4918-a0df-7ab8d3ca9f22 req-f042d0d7-a857-4fc8-8602-4fa64c6640c7 service nova] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Received event network-changed-b50b65dc-a03d-4f22-bb35-f2b9dc67596d {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG nova.compute.manager [req-873a153c-36c7-4918-a0df-7ab8d3ca9f22 req-f042d0d7-a857-4fc8-8602-4fa64c6640c7 service nova] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Refreshing instance network info cache due to event network-changed-b50b65dc-a03d-4f22-bb35-f2b9dc67596d. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-873a153c-36c7-4918-a0df-7ab8d3ca9f22 req-f042d0d7-a857-4fc8-8602-4fa64c6640c7 service nova] Acquiring lock "refresh_cache-339372ed-140d-4226-ba00-2cc682214d5c" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG nova.network.neutron [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "336770eb-4f09-4134-92ef-f96039bf4fa9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "336770eb-4f09-4134-92ef-f96039bf4fa9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:24 user nova-compute[72809]: INFO nova.compute.manager [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Attaching volume 558b89a2-6411-4dfc-937a-332585a1f186 to /dev/vdb
Aug 09 06:57:24 user nova-compute[72809]: DEBUG os_brick.utils [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6044ec8a-2309-4d11-8666-3e2790d52991]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[335f5797-d30e-4d58-a938-93c8debcd737]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquiring lock "15dda080-3487-4316-ab7b-f7185f0a4519" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "15dda080-3487-4316-ab7b-f7185f0a4519" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquiring lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:24 user nova-compute[72809]: INFO nova.compute.manager [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Terminating instance
Aug 09 06:57:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4146cb-a8d5-402f-8147-1a0d56fffb6f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG nova.compute.manager [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6214ed3d-462f-4b97-945d-594a5f3f752e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:57:24 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 06:57:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4a997a-300a-4dbc-9e1d-b1b76a1f6ec9]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG os_brick.utils [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Updating existing volume attachment record: 65b2f8fd-27a6-45b6-bfdb-d772a15511f9 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG nova.network.neutron [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Updating instance_info_cache with network_info: [{"id": "b50b65dc-a03d-4f22-bb35-f2b9dc67596d", "address": "fa:16:3e:67:6b:ac", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50b65dc-a0", "ovs_interfaceid": "b50b65dc-a03d-4f22-bb35-f2b9dc67596d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Releasing lock "refresh_cache-339372ed-140d-4226-ba00-2cc682214d5c" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG nova.compute.manager [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Instance network_info: |[{"id": "b50b65dc-a03d-4f22-bb35-f2b9dc67596d", "address": "fa:16:3e:67:6b:ac", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50b65dc-a0", "ovs_interfaceid": "b50b65dc-a03d-4f22-bb35-f2b9dc67596d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-873a153c-36c7-4918-a0df-7ab8d3ca9f22 req-f042d0d7-a857-4fc8-8602-4fa64c6640c7 service nova] Acquired lock "refresh_cache-339372ed-140d-4226-ba00-2cc682214d5c" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG nova.network.neutron [req-873a153c-36c7-4918-a0df-7ab8d3ca9f22 req-f042d0d7-a857-4fc8-8602-4fa64c6640c7 service nova] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Refreshing network info cache for port b50b65dc-a03d-4f22-bb35-f2b9dc67596d {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:57:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Start _get_guest_xml network_info=[{"id": "b50b65dc-a03d-4f22-bb35-f2b9dc67596d", "address": "fa:16:3e:67:6b:ac", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50b65dc-a0", "ovs_interfaceid": "b50b65dc-a03d-4f22-bb35-f2b9dc67596d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:57:25 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:57:25 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:57:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-908521016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-908521016',id=22,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1903437f7ed4c14a0660f64a2e0c647',ramdisk_id='',reservation_id='r-d41q0ihr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-917311946',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:57:22Z,user_data=None,user_id='6c4c5942852b412885a5b4698552058d',uuid=339372ed-140d-4226-ba00-2cc682214d5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b50b65dc-a03d-4f22-bb35-f2b9dc67596d", "address": "fa:16:3e:67:6b:ac", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50b65dc-a0", "ovs_interfaceid": "b50b65dc-a03d-4f22-bb35-f2b9dc67596d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Converting VIF {"id": "b50b65dc-a03d-4f22-bb35-f2b9dc67596d", "address": "fa:16:3e:67:6b:ac", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50b65dc-a0", "ovs_interfaceid": "b50b65dc-a03d-4f22-bb35-f2b9dc67596d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:6b:ac,bridge_name='br-int',has_traffic_filtering=True,id=b50b65dc-a03d-4f22-bb35-f2b9dc67596d,network=Network(5f03b0f9-e80d-428f-b0a6-57158568e620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb50b65dc-a0') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.objects.instance [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lazy-loading 'pci_devices' on Instance uuid 339372ed-140d-4226-ba00-2cc682214d5c {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:57:25 user nova-compute[72809]:   <uuid>339372ed-140d-4226-ba00-2cc682214d5c</uuid>
Aug 09 06:57:25 user nova-compute[72809]:   <name>instance-00000016</name>
Aug 09 06:57:25 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:57:25 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:57:25 user nova-compute[72809]:   <metadata>
Aug 09 06:57:25 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:57:25 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:57:25 user nova-compute[72809]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-908521016</nova:name>
Aug 09 06:57:25 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:57:25</nova:creationTime>
Aug 09 06:57:25 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:57:25 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:57:25 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:57:25 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:57:25 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:57:25 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:57:25 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:57:25 user nova-compute[72809]:       <nova:owner>
Aug 09 06:57:25 user nova-compute[72809]:         <nova:user uuid="6c4c5942852b412885a5b4698552058d">tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member</nova:user>
Aug 09 06:57:25 user nova-compute[72809]:         <nova:project uuid="b1903437f7ed4c14a0660f64a2e0c647">tempest-ServerBootFromVolumeStableRescueTest-917311946</nova:project>
Aug 09 06:57:25 user nova-compute[72809]:       </nova:owner>
Aug 09 06:57:25 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:57:25 user nova-compute[72809]:       <nova:ports>
Aug 09 06:57:25 user nova-compute[72809]:         <nova:port uuid="b50b65dc-a03d-4f22-bb35-f2b9dc67596d">
Aug 09 06:57:25 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 06:57:25 user nova-compute[72809]:         </nova:port>
Aug 09 06:57:25 user nova-compute[72809]:       </nova:ports>
Aug 09 06:57:25 user nova-compute[72809]:     </nova:instance>
Aug 09 06:57:25 user nova-compute[72809]:   </metadata>
Aug 09 06:57:25 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:57:25 user nova-compute[72809]:     <system>
Aug 09 06:57:25 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:57:25 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:57:25 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:57:25 user nova-compute[72809]:       <entry name="serial">339372ed-140d-4226-ba00-2cc682214d5c</entry>
Aug 09 06:57:25 user nova-compute[72809]:       <entry name="uuid">339372ed-140d-4226-ba00-2cc682214d5c</entry>
Aug 09 06:57:25 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:57:25 user nova-compute[72809]:     </system>
Aug 09 06:57:25 user nova-compute[72809]:   </sysinfo>
Aug 09 06:57:25 user nova-compute[72809]:   <os>
Aug 09 06:57:25 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:57:25 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 06:57:25 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:57:25 user nova-compute[72809]:   </os>
Aug 09 06:57:25 user nova-compute[72809]:   <features>
Aug 09 06:57:25 user nova-compute[72809]:     <acpi/>
Aug 09 06:57:25 user nova-compute[72809]:     <apic/>
Aug 09 06:57:25 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:57:25 user nova-compute[72809]:   </features>
Aug 09 06:57:25 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:57:25 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:57:25 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:57:25 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:57:25 user nova-compute[72809]:   </clock>
Aug 09 06:57:25 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:57:25 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:57:25 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:57:25 user nova-compute[72809]:   </cpu>
Aug 09 06:57:25 user nova-compute[72809]:   <devices>
Aug 09 06:57:25 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:57:25 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:57:25 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk"/>
Aug 09 06:57:25 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:57:25 user nova-compute[72809]:     </disk>
Aug 09 06:57:25 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:57:25 user nova-compute[72809]:       <mac address="fa:16:3e:67:6b:ac"/>
Aug 09 06:57:25 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:57:25 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:57:25 user nova-compute[72809]:       <target dev="tapb50b65dc-a0"/>
Aug 09 06:57:25 user nova-compute[72809]:     </interface>
Aug 09 06:57:25 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:57:25 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/console.log" append="off"/>
Aug 09 06:57:25 user nova-compute[72809]:     </serial>
Aug 09 06:57:25 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:57:25 user nova-compute[72809]:     <video>
Aug 09 06:57:25 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:57:25 user nova-compute[72809]:     </video>
Aug 09 06:57:25 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:57:25 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:57:25 user nova-compute[72809]:     </rng>
Aug 09 06:57:25 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:57:25 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:57:25 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:57:25 user nova-compute[72809]:     </memballoon>
Aug 09 06:57:25 user nova-compute[72809]:   </devices>
Aug 09 06:57:25 user nova-compute[72809]: </domain>
Aug 09 06:57:25 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:57:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-908521016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-908521016',id=22,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1903437f7ed4c14a0660f64a2e0c647',ramdisk_id='',reservation_id='r-d41q0ihr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-917311946',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:57:22Z,user_data=None,user_id='6c4c5942852b412885a5b4698552058d',uuid=339372ed-140d-4226-ba00-2cc682214d5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b50b65dc-a03d-4f22-bb35-f2b9dc67596d", "address": "fa:16:3e:67:6b:ac", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50b65dc-a0", "ovs_interfaceid": "b50b65dc-a03d-4f22-bb35-f2b9dc67596d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Converting VIF {"id": "b50b65dc-a03d-4f22-bb35-f2b9dc67596d", "address": "fa:16:3e:67:6b:ac", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50b65dc-a0", "ovs_interfaceid": "b50b65dc-a03d-4f22-bb35-f2b9dc67596d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:6b:ac,bridge_name='br-int',has_traffic_filtering=True,id=b50b65dc-a03d-4f22-bb35-f2b9dc67596d,network=Network(5f03b0f9-e80d-428f-b0a6-57158568e620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb50b65dc-a0') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG os_vif [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:6b:ac,bridge_name='br-int',has_traffic_filtering=True,id=b50b65dc-a03d-4f22-bb35-f2b9dc67596d,network=Network(5f03b0f9-e80d-428f-b0a6-57158568e620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb50b65dc-a0') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb50b65dc-a0, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb50b65dc-a0, col_values=(('external_ids', {'iface-id': 'b50b65dc-a03d-4f22-bb35-f2b9dc67596d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:6b:ac', 'vm-uuid': '339372ed-140d-4226-ba00-2cc682214d5c'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:25 user nova-compute[72809]: INFO os_vif [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:6b:ac,bridge_name='br-int',has_traffic_filtering=True,id=b50b65dc-a03d-4f22-bb35-f2b9dc67596d,network=Network(5f03b0f9-e80d-428f-b0a6-57158568e620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb50b65dc-a0')
Aug 09 06:57:25 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Instance destroyed successfully.
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.objects.instance [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lazy-loading 'resources' on Instance uuid 15dda080-3487-4316-ab7b-f7185f0a4519 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:48:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1848436274',display_name='tempest-ServerActionsTestOtherB-server-1848436274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1848436274',id=4,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzddBZQV6rBoKhUSr/KZYr11ADyq1HDaJHBbKwm5pCectYOG8Y/A3xcUayq6O8xK7rSLI08X+2Hg8J2DtxIR/GKq1CHmG5GQromz7rdkcwdeRGHWTQ/2HdiKGS29Oa5Sg==',key_name='tempest-keypair-830185710',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:54:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52fb0421f625467a8205b8000a6dcee5',ramdisk_id='',reservation_id='r-iw1w1c5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1112762044',owner_user_name='tempest-ServerActionsTestOtherB-1112762044-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:54:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0347074764734e2a8ca3f580efcb1272',uuid=15dda080-3487-4316-ab7b-f7185f0a4519,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6efe1803-2ae3-490f-8791-c2ba35919f09", "address": "fa:16:3e:a7:75:9f", "network": {"id": "aae92e96-18c4-419a-b1b0-5ab55d8f26c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1926005183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52fb0421f625467a8205b8000a6dcee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efe1803-2a", "ovs_interfaceid": "6efe1803-2ae3-490f-8791-c2ba35919f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Converting VIF {"id": "6efe1803-2ae3-490f-8791-c2ba35919f09", "address": "fa:16:3e:a7:75:9f", "network": {"id": "aae92e96-18c4-419a-b1b0-5ab55d8f26c3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1926005183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52fb0421f625467a8205b8000a6dcee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efe1803-2a", "ovs_interfaceid": "6efe1803-2ae3-490f-8791-c2ba35919f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:75:9f,bridge_name='br-int',has_traffic_filtering=True,id=6efe1803-2ae3-490f-8791-c2ba35919f09,network=Network(aae92e96-18c4-419a-b1b0-5ab55d8f26c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efe1803-2a') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG os_vif [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:75:9f,bridge_name='br-int',has_traffic_filtering=True,id=6efe1803-2ae3-490f-8791-c2ba35919f09,network=Network(aae92e96-18c4-419a-b1b0-5ab55d8f26c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efe1803-2a') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6efe1803-2a, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] No VIF found with MAC fa:16:3e:67:6b:ac, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:57:25 user nova-compute[72809]: INFO os_vif [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:75:9f,bridge_name='br-int',has_traffic_filtering=True,id=6efe1803-2ae3-490f-8791-c2ba35919f09,network=Network(aae92e96-18c4-419a-b1b0-5ab55d8f26c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efe1803-2a')
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMtUvsXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:57:25 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:57:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e9e670-d644-40fe-9dd0-0907d3c0e22a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dbb1ae-043f-46da-8c4f-ab02793cc689]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:57:25 user nova-compute[72809]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 (non-flash)
Aug 09 06:57:25 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf (non-flash)
Aug 09 06:57:25 user nova-compute[72809]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 (non-flash)
Aug 09 06:57:25 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc1584c8ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf'): ({'sdc'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Removing single pathed devices sdc {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f15f11-d224-4a10-bd86-354e2201f98b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.031s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[96911782-17f6-4ef0-983b-226934b4d0c2]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Flushing IO for device /dev/sdc {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c641e50-2e78-4d09-b570-407653974227]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1f5c1d-e6e4-4133-ba84-8c468a008094]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] SCSI volumes sdc have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c9fddb-4062-4d52-85a6-629eea366d23]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2e67bc-5e80-4b6c-9549-91c5c1af55ea]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf, portal: 172.16.0.220,3260]
Aug 09 06:57:25 user nova-compute[72809]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf, portal: 172.16.0.220,3260] successful.
Aug 09 06:57:25 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521a87a6-3612-4fe2-ba75-ffa77601e8bf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[219d6900-d5b6-47a3-a54c-65274fc2aaf9]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] <== disconnect_volume: return (347ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 06:57:25 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Deleting instance files /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519_del
Aug 09 06:57:25 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Deletion of /opt/stack/data/nova/instances/15dda080-3487-4316-ab7b-f7185f0a4519_del complete
Aug 09 06:57:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Acquiring lock "25943f41-2d28-4ffe-b38b-ae34a99426e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lock "25943f41-2d28-4ffe-b38b-ae34a99426e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.compute.manager [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 06:57:25 user nova-compute[72809]: INFO nova.compute.manager [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Took 1.45 seconds to destroy the instance on the hypervisor.
Aug 09 06:57:25 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 06:57:25 user nova-compute[72809]: INFO nova.compute.claims [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Claim successful on node user
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.network.neutron [req-873a153c-36c7-4918-a0df-7ab8d3ca9f22 req-f042d0d7-a857-4fc8-8602-4fa64c6640c7 service nova] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Updated VIF entry in instance network info cache for port b50b65dc-a03d-4f22-bb35-f2b9dc67596d. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG nova.network.neutron [req-873a153c-36c7-4918-a0df-7ab8d3ca9f22 req-f042d0d7-a857-4fc8-8602-4fa64c6640c7 service nova] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Updating instance_info_cache with network_info: [{"id": "b50b65dc-a03d-4f22-bb35-f2b9dc67596d", "address": "fa:16:3e:67:6b:ac", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50b65dc-a0", "ovs_interfaceid": "b50b65dc-a03d-4f22-bb35-f2b9dc67596d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:57:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-873a153c-36c7-4918-a0df-7ab8d3ca9f22 req-f042d0d7-a857-4fc8-8602-4fa64c6640c7 service nova] Releasing lock "refresh_cache-339372ed-140d-4226-ba00-2cc682214d5c" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG nova.compute.manager [req-a543af75-8797-4405-8320-eb26a381734c req-42dfd675-a3fd-42c4-86ff-dd22bb6f8693 service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Received event network-vif-unplugged-6efe1803-2ae3-490f-8791-c2ba35919f09 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a543af75-8797-4405-8320-eb26a381734c req-42dfd675-a3fd-42c4-86ff-dd22bb6f8693 service nova] Acquiring lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a543af75-8797-4405-8320-eb26a381734c req-42dfd675-a3fd-42c4-86ff-dd22bb6f8693 service nova] Lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a543af75-8797-4405-8320-eb26a381734c req-42dfd675-a3fd-42c4-86ff-dd22bb6f8693 service nova] Lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG nova.compute.manager [req-a543af75-8797-4405-8320-eb26a381734c req-42dfd675-a3fd-42c4-86ff-dd22bb6f8693 service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] No waiting events found dispatching network-vif-unplugged-6efe1803-2ae3-490f-8791-c2ba35919f09 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG nova.compute.manager [req-a543af75-8797-4405-8320-eb26a381734c req-42dfd675-a3fd-42c4-86ff-dd22bb6f8693 service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Received event network-vif-unplugged-6efe1803-2ae3-490f-8791-c2ba35919f09 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG nova.compute.manager [req-a543af75-8797-4405-8320-eb26a381734c req-42dfd675-a3fd-42c4-86ff-dd22bb6f8693 service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Received event network-vif-plugged-6efe1803-2ae3-490f-8791-c2ba35919f09 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a543af75-8797-4405-8320-eb26a381734c req-42dfd675-a3fd-42c4-86ff-dd22bb6f8693 service nova] Acquiring lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a543af75-8797-4405-8320-eb26a381734c req-42dfd675-a3fd-42c4-86ff-dd22bb6f8693 service nova] Lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a543af75-8797-4405-8320-eb26a381734c req-42dfd675-a3fd-42c4-86ff-dd22bb6f8693 service nova] Lock "15dda080-3487-4316-ab7b-f7185f0a4519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG nova.compute.manager [req-a543af75-8797-4405-8320-eb26a381734c req-42dfd675-a3fd-42c4-86ff-dd22bb6f8693 service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] No waiting events found dispatching network-vif-plugged-6efe1803-2ae3-490f-8791-c2ba35919f09 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:57:26 user nova-compute[72809]: WARNING nova.compute.manager [req-a543af75-8797-4405-8320-eb26a381734c req-42dfd675-a3fd-42c4-86ff-dd22bb6f8693 service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Received unexpected event network-vif-plugged-6efe1803-2ae3-490f-8791-c2ba35919f09 for instance with vm_state active and task_state deleting.
Aug 09 06:57:26 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.490s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG nova.compute.manager [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG nova.compute.manager [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG nova.network.neutron [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 06:57:26 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 06:57:26 user nova-compute[72809]: DEBUG nova.compute.manager [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 06:57:26 user nova-compute[72809]: INFO nova.virt.block_device [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Booting with volume 63dec66c-f14e-46ac-becb-481479048521 at /dev/vda
Aug 09 06:57:26 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:57:26 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Took 0.83 seconds to deallocate network for instance.
Aug 09 06:57:26 user nova-compute[72809]: DEBUG nova.compute.manager [req-9ce281d1-3a27-486b-92b6-8b3e4fd5f0cf req-b51a405c-b608-4ff7-bdd9-1acb63f37400 service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Received event network-vif-deleted-6efe1803-2ae3-490f-8791-c2ba35919f09 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:57:26 user nova-compute[72809]: INFO nova.compute.manager [req-9ce281d1-3a27-486b-92b6-8b3e4fd5f0cf req-b51a405c-b608-4ff7-bdd9-1acb63f37400 service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Neutron deleted interface 6efe1803-2ae3-490f-8791-c2ba35919f09; detaching it from the instance and deleting it from the info cache
Aug 09 06:57:26 user nova-compute[72809]: DEBUG nova.network.neutron [req-9ce281d1-3a27-486b-92b6-8b3e4fd5f0cf req-b51a405c-b608-4ff7-bdd9-1acb63f37400 service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG nova.compute.manager [req-9ce281d1-3a27-486b-92b6-8b3e4fd5f0cf req-b51a405c-b608-4ff7-bdd9-1acb63f37400 service nova] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Detach interface failed, port_id=6efe1803-2ae3-490f-8791-c2ba35919f09, reason: Instance 15dda080-3487-4316-ab7b-f7185f0a4519 could not be found. {{(pid=72809) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG nova.policy [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '66208d0453c0457ea5402ee892558f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b76be74ac2b46049686e6fdcef82dbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG os_brick.utils [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a359e304-9845-430e-80dc-e82a7711b83c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c917984-00f6-4a28-be84-c37ef08e575f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4399ef-b22c-4c93-aa4b-f0e566237841]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d185c657-25a8-4843-9e70-0f1086069a91]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:57:26 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 06:57:26 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3df71e5-4db4-451f-830f-36b44dec2ca7]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG os_brick.utils [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Updating existing volume attachment record: a522f38e-0fe4-4f8e-863f-adba3ad04628 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:27 user nova-compute[72809]: DEBUG nova.network.neutron [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Successfully created port: eaaf2699-4583-4421-872a-117e799570e5 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:57:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG nova.network.neutron [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Successfully updated port: eaaf2699-4583-4421-872a-117e799570e5 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Acquiring lock "refresh_cache-25943f41-2d28-4ffe-b38b-ae34a99426e1" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Acquired lock "refresh_cache-25943f41-2d28-4ffe-b38b-ae34a99426e1" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG nova.network.neutron [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG nova.compute.manager [req-875178f6-dd24-40bc-aaf5-3d08ac8bdad0 req-3171fd93-a12f-4859-9cce-ddd57966e4e0 service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Received event network-changed-eaaf2699-4583-4421-872a-117e799570e5 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG nova.compute.manager [req-875178f6-dd24-40bc-aaf5-3d08ac8bdad0 req-3171fd93-a12f-4859-9cce-ddd57966e4e0 service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Refreshing instance network info cache due to event network-changed-eaaf2699-4583-4421-872a-117e799570e5. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-875178f6-dd24-40bc-aaf5-3d08ac8bdad0 req-3171fd93-a12f-4859-9cce-ddd57966e4e0 service nova] Acquiring lock "refresh_cache-25943f41-2d28-4ffe-b38b-ae34a99426e1" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG nova.network.neutron [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG nova.network.neutron [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Updating instance_info_cache with network_info: [{"id": "eaaf2699-4583-4421-872a-117e799570e5", "address": "fa:16:3e:47:32:ed", "network": {"id": "514e9a73-337b-46a7-b516-df614914735a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-23845660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b76be74ac2b46049686e6fdcef82dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf2699-45", "ovs_interfaceid": "eaaf2699-4583-4421-872a-117e799570e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Releasing lock "refresh_cache-25943f41-2d28-4ffe-b38b-ae34a99426e1" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG nova.compute.manager [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Instance network_info: |[{"id": "eaaf2699-4583-4421-872a-117e799570e5", "address": "fa:16:3e:47:32:ed", "network": {"id": "514e9a73-337b-46a7-b516-df614914735a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-23845660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b76be74ac2b46049686e6fdcef82dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf2699-45", "ovs_interfaceid": "eaaf2699-4583-4421-872a-117e799570e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-875178f6-dd24-40bc-aaf5-3d08ac8bdad0 req-3171fd93-a12f-4859-9cce-ddd57966e4e0 service nova] Acquired lock "refresh_cache-25943f41-2d28-4ffe-b38b-ae34a99426e1" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG nova.network.neutron [req-875178f6-dd24-40bc-aaf5-3d08ac8bdad0 req-3171fd93-a12f-4859-9cce-ddd57966e4e0 service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Refreshing network info cache for port eaaf2699-4583-4421-872a-117e799570e5 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG nova.compute.manager [req-61f5d818-f1e6-496b-a5c2-b2d36c347842 req-76796a7c-ee56-4808-99eb-c0187aa77094 service nova] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Received event network-vif-plugged-b50b65dc-a03d-4f22-bb35-f2b9dc67596d {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-61f5d818-f1e6-496b-a5c2-b2d36c347842 req-76796a7c-ee56-4808-99eb-c0187aa77094 service nova] Acquiring lock "339372ed-140d-4226-ba00-2cc682214d5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-61f5d818-f1e6-496b-a5c2-b2d36c347842 req-76796a7c-ee56-4808-99eb-c0187aa77094 service nova] Lock "339372ed-140d-4226-ba00-2cc682214d5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-61f5d818-f1e6-496b-a5c2-b2d36c347842 req-76796a7c-ee56-4808-99eb-c0187aa77094 service nova] Lock "339372ed-140d-4226-ba00-2cc682214d5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG nova.compute.manager [req-61f5d818-f1e6-496b-a5c2-b2d36c347842 req-76796a7c-ee56-4808-99eb-c0187aa77094 service nova] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] No waiting events found dispatching network-vif-plugged-b50b65dc-a03d-4f22-bb35-f2b9dc67596d {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:57:28 user nova-compute[72809]: WARNING nova.compute.manager [req-61f5d818-f1e6-496b-a5c2-b2d36c347842 req-76796a7c-ee56-4808-99eb-c0187aa77094 service nova] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Received unexpected event network-vif-plugged-b50b65dc-a03d-4f22-bb35-f2b9dc67596d for instance with vm_state building and task_state spawning.
Aug 09 06:57:28 user nova-compute[72809]: DEBUG nova.compute.manager [req-61f5d818-f1e6-496b-a5c2-b2d36c347842 req-76796a7c-ee56-4808-99eb-c0187aa77094 service nova] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Received event network-vif-plugged-b50b65dc-a03d-4f22-bb35-f2b9dc67596d {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-61f5d818-f1e6-496b-a5c2-b2d36c347842 req-76796a7c-ee56-4808-99eb-c0187aa77094 service nova] Acquiring lock "339372ed-140d-4226-ba00-2cc682214d5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-61f5d818-f1e6-496b-a5c2-b2d36c347842 req-76796a7c-ee56-4808-99eb-c0187aa77094 service nova] Lock "339372ed-140d-4226-ba00-2cc682214d5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-61f5d818-f1e6-496b-a5c2-b2d36c347842 req-76796a7c-ee56-4808-99eb-c0187aa77094 service nova] Lock "339372ed-140d-4226-ba00-2cc682214d5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG nova.compute.manager [req-61f5d818-f1e6-496b-a5c2-b2d36c347842 req-76796a7c-ee56-4808-99eb-c0187aa77094 service nova] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] No waiting events found dispatching network-vif-plugged-b50b65dc-a03d-4f22-bb35-f2b9dc67596d {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:57:28 user nova-compute[72809]: WARNING nova.compute.manager [req-61f5d818-f1e6-496b-a5c2-b2d36c347842 req-76796a7c-ee56-4808-99eb-c0187aa77094 service nova] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Received unexpected event network-vif-plugged-b50b65dc-a03d-4f22-bb35-f2b9dc67596d for instance with vm_state building and task_state spawning.
Aug 09 06:57:28 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:57:28 user nova-compute[72809]: INFO nova.compute.manager [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Took 2.18 seconds to detach 1 volumes for instance.
Aug 09 06:57:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564248.9064279, 339372ed-140d-4226-ba00-2cc682214d5c => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:57:28 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] VM Resumed (Lifecycle Event)
Aug 09 06:57:28 user nova-compute[72809]: DEBUG nova.compute.manager [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 06:57:28 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Instance spawned successfully.
Aug 09 06:57:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mBbdJqfA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:57:28 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:57:28 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:57:28 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:57:28 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:57:28 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 06:57:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:28 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:57:28 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564248.907902, 339372ed-140d-4226-ba00-2cc682214d5c => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:57:28 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] VM Started (Lifecycle Event)
Aug 09 06:57:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:57:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c909c0-d93d-4902-a662-de89637cea4c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 06:57:29 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ea704b-c0b0-488c-adac-9b08ff187e62]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf] added
Aug 09 06:57:29 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:29 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2adbf96-6021-48e5-b3b5-575b7073993c]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:29 user nova-compute[72809]: INFO nova.compute.manager [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Took 6.64 seconds to spawn the instance on the hypervisor.
Aug 09 06:57:29 user nova-compute[72809]: DEBUG nova.compute.manager [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8a6249-c06b-43ba-9432-c45d9d4537cf]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mBbdJqfA {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG nova.network.neutron [req-875178f6-dd24-40bc-aaf5-3d08ac8bdad0 req-3171fd93-a12f-4859-9cce-ddd57966e4e0 service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Updated VIF entry in instance network info cache for port eaaf2699-4583-4421-872a-117e799570e5. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG nova.network.neutron [req-875178f6-dd24-40bc-aaf5-3d08ac8bdad0 req-3171fd93-a12f-4859-9cce-ddd57966e4e0 service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Updating instance_info_cache with network_info: [{"id": "eaaf2699-4583-4421-872a-117e799570e5", "address": "fa:16:3e:47:32:ed", "network": {"id": "514e9a73-337b-46a7-b516-df614914735a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-23845660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b76be74ac2b46049686e6fdcef82dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf2699-45", "ovs_interfaceid": "eaaf2699-4583-4421-872a-117e799570e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mBbdJqfA" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4ba107-1b3d-4e9a-b4d3-c855dcf2275a]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mBbdJqfA'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-875178f6-dd24-40bc-aaf5-3d08ac8bdad0 req-3171fd93-a12f-4859-9cce-ddd57966e4e0 service nova] Releasing lock "refresh_cache-25943f41-2d28-4ffe-b38b-ae34a99426e1" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0560d89-4a12-46ef-a2a0-cb49c60b3daa]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edb8938-0534-45e4-a590-552de1610483]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 (non-flash)
Aug 09 06:57:29 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 (non-flash)
Aug 09 06:57:29 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:57:29 user nova-compute[72809]: INFO nova.compute.manager [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Took 7.40 seconds to build instance.
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.443s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-682af272-2505-4e98-981c-114b70847431 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "339372ed-140d-4226-ba00-2cc682214d5c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.514s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fafa83-3d24-41ff-a085-30da72242d17]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf, portal: 172.16.0.220,3260]
Aug 09 06:57:29 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf, portal: 172.16.0.220,3260] successful.
Aug 09 06:57:29 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:29 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Deleted allocations for instance 15dda080-3487-4316-ab7b-f7185f0a4519
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddcde48-f19a-44f6-af68-ac75df0b1e19]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[05586102-901a-4182-841b-60e69ae81e75]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 (non-flash)
Aug 09 06:57:29 user nova-compute[72809]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 06:57:29 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 (non-flash)
Aug 09 06:57:29 user nova-compute[72809]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 06:57:29 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-36cafc95-bd71-44d4-b27f-ae4df72f567d tempest-ServerActionsTestOtherB-1112762044 tempest-ServerActionsTestOtherB-1112762044-project-member] Lock "15dda080-3487-4316-ab7b-f7185f0a4519" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.126s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4879a0-f13a-4434-a817-8adce151cde4]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 06:57:29 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mBbdJqfA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 06:57:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:30 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.427s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:57:30 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] <== connect_volume: return (1428ms) {'type': 'block', 'scsi_wwn': '23734383236323335', 'path': '/dev/sdb'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:57:30 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734383236323335', 'path': '/dev/sdb'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 06:57:30 user nova-compute[72809]: DEBUG nova.objects.instance [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lazy-loading 'flavor' on Instance uuid 5251cef4-9a49-4220-984e-75d1198f95b6 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:57:30 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 06:57:30 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:57:30 user nova-compute[72809]:   <source dev="/dev/sdb"/>
Aug 09 06:57:30 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 06:57:30 user nova-compute[72809]:   <serial>a4d75678-22d8-484d-abf4-58ef866de6bf</serial>
Aug 09 06:57:30 user nova-compute[72809]: </disk>
Aug 09 06:57:30 user nova-compute[72809]:  {{(pid=72809) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 06:57:30 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:57:30 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 06:57:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-336770eb-4f09-4134-92ef-f96039bf4fa9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:57:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-336770eb-4f09-4134-92ef-f96039bf4fa9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:57:30 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 06:57:30 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:57:30 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:57:30 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] No VIF found with MAC fa:16:3e:6d:d2:82, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:57:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2968e1fb-6171-43ec-88dc-4abc8ad12034 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "5251cef4-9a49-4220-984e-75d1198f95b6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.419s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:31 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Updating instance_info_cache with network_info: [{"id": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "address": "fa:16:3e:b9:56:8d", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac68313-9d", "ovs_interfaceid": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:57:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-336770eb-4f09-4134-92ef-f96039bf4fa9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:57:31 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 06:57:31 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:57:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:31 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 06:57:31 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:31 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:31 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 06:57:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QVSLipFZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:57:33 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:57:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:57:33 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:57:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:57:33 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d16a81d-57e2-4e25-ae71-3dd4facff919]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 06:57:33 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[77079933-a51e-4196-b2bb-0c41f1fa3fee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186] added
Aug 09 06:57:33 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf554d4-ff5b-4628-ae0a-012a48891f7e]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1577e54-d4cf-4198-b74e-40c9e7e8f0e6]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QVSLipFZ {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QVSLipFZ" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3188971-a2d8-47cb-82c1-f2d548a224e6]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QVSLipFZ'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[170cd575-14ac-4e79-a943-3062468b62b8]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b2d0f1-cf68-480d-9f4f-70a7f05172ae]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 (non-flash)
Aug 09 06:57:33 user nova-compute[72809]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 06:57:33 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 (non-flash)
Aug 09 06:57:33 user nova-compute[72809]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 06:57:33 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[66aa23fb-0e9c-47e1-8560-f9524f7163b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186, portal: 172.16.0.220,3260]
Aug 09 06:57:33 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186, portal: 172.16.0.220,3260] successful.
Aug 09 06:57:33 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9ecd98-d1dc-44d4-b542-66cc815ec695]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d153cf7-f23a-4059-999e-18f3f4432eda]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 (non-flash)
Aug 09 06:57:33 user nova-compute[72809]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 06:57:33 user nova-compute[72809]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)
Aug 09 06:57:33 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 (non-flash)
Aug 09 06:57:33 user nova-compute[72809]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 06:57:33 user nova-compute[72809]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)
Aug 09 06:57:33 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 06:57:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:34 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d30e37-f0d4-481b-953c-ffba62592e9c]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:34 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 06:57:34 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QVSLipFZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 06:57:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d210e25-aa29-40a5-ad99-27e54a51dd7a/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "e8e7fc37-b821-4ee9-9ec6-2b2254287d26" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "e8e7fc37-b821-4ee9-9ec6-2b2254287d26" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:34 user nova-compute[72809]: DEBUG nova.compute.manager [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 06:57:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d210e25-aa29-40a5-ad99-27e54a51dd7a/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d210e25-aa29-40a5-ad99-27e54a51dd7a/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:34 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 06:57:34 user nova-compute[72809]: INFO nova.compute.claims [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Claim successful on node user
Aug 09 06:57:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d210e25-aa29-40a5-ad99-27e54a51dd7a/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:34 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:57:34 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:57:34 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=7562MB free_disk=25.483177185058594GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 06:57:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '23962333236623736', 'path': '/dev/sdc'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962333236623736', 'path': '/dev/sdc'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG nova.objects.instance [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lazy-loading 'flavor' on Instance uuid 336770eb-4f09-4134-92ef-f96039bf4fa9 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 06:57:35 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:57:35 user nova-compute[72809]:   <source dev="/dev/sdc"/>
Aug 09 06:57:35 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 06:57:35 user nova-compute[72809]:   <serial>558b89a2-6411-4dfc-937a-332585a1f186</serial>
Aug 09 06:57:35 user nova-compute[72809]: </disk>
Aug 09 06:57:35 user nova-compute[72809]:  {{(pid=72809) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.911s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG nova.compute.manager [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.389s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG nova.compute.manager [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG nova.network.neutron [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 06:57:35 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 06:57:35 user nova-compute[72809]: DEBUG nova.compute.manager [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 24ba9b41-d0bf-4a84-9f04-bfda9525b154 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 336770eb-4f09-4134-92ef-f96039bf4fa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 5251cef4-9a49-4220-984e-75d1198f95b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance aec0a7ee-69e1-41cf-bfa8-5733bdedd70a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 1bde423f-0b73-448f-bdce-8d6af96d8fc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance bebd5a14-6272-4de1-a1a1-4fb45b867c7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 6d210e25-aa29-40a5-ad99-27e54a51dd7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 339372ed-140d-4226-ba00-2cc682214d5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 25943f41-2d28-4ffe-b38b-ae34a99426e1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance e8e7fc37-b821-4ee9-9ec6-2b2254287d26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG nova.policy [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f85a1f2a88fd40a48d1c4dba13f0ac09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce7c486aaca4ef89eb7e392b717e3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] No VIF found with MAC fa:16:3e:b9:56:8d, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG nova.compute.manager [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 06:57:35 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Creating image(s)
Aug 09 06:57:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "/opt/stack/data/nova/instances/e8e7fc37-b821-4ee9-9ec6-2b2254287d26/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "/opt/stack/data/nova/instances/e8e7fc37-b821-4ee9-9ec6-2b2254287d26/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "/opt/stack/data/nova/instances/e8e7fc37-b821-4ee9-9ec6-2b2254287d26/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-244e8273-4dab-4cee-a580-285efd4b5e1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "336770eb-4f09-4134-92ef-f96039bf4fa9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.652s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.145s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 06:57:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.668s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.179s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/e8e7fc37-b821-4ee9-9ec6-2b2254287d26/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/e8e7fc37-b821-4ee9-9ec6-2b2254287d26/disk 1073741824" returned: 0 in 0.061s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.171s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:36 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e8e7fc37-b821-4ee9-9ec6-2b2254287d26/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 06:57:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8e7fc37-b821-4ee9-9ec6-2b2254287d26/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:36 user nova-compute[72809]: DEBUG nova.network.neutron [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Successfully created port: 31867152-d058-43b9-a8af-f1a7c61f5299 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:57:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8e7fc37-b821-4ee9-9ec6-2b2254287d26/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:36 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Cannot resize image /opt/stack/data/nova/instances/e8e7fc37-b821-4ee9-9ec6-2b2254287d26/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 06:57:36 user nova-compute[72809]: DEBUG nova.objects.instance [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lazy-loading 'migration_context' on Instance uuid e8e7fc37-b821-4ee9-9ec6-2b2254287d26 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:57:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 06:57:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Ensure instance console log exists: /opt/stack/data/nova/instances/e8e7fc37-b821-4ee9-9ec6-2b2254287d26/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 06:57:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.network.neutron [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Successfully updated port: 31867152-d058-43b9-a8af-f1a7c61f5299 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "refresh_cache-e8e7fc37-b821-4ee9-9ec6-2b2254287d26" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquired lock "refresh_cache-e8e7fc37-b821-4ee9-9ec6-2b2254287d26" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.network.neutron [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.compute.manager [req-f79b2ff2-f1b7-4b7f-8239-fa5586933133 req-0fa053d1-bcf1-4273-9e54-3a8ef13d09b2 service nova] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Received event network-changed-31867152-d058-43b9-a8af-f1a7c61f5299 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.compute.manager [req-f79b2ff2-f1b7-4b7f-8239-fa5586933133 req-0fa053d1-bcf1-4273-9e54-3a8ef13d09b2 service nova] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Refreshing instance network info cache due to event network-changed-31867152-d058-43b9-a8af-f1a7c61f5299. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f79b2ff2-f1b7-4b7f-8239-fa5586933133 req-0fa053d1-bcf1-4273-9e54-3a8ef13d09b2 service nova] Acquiring lock "refresh_cache-e8e7fc37-b821-4ee9-9ec6-2b2254287d26" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.network.neutron [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:57:37 user nova-compute[72809]: INFO nova.compute.manager [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Rebuilding instance
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.objects.instance [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lazy-loading 'trusted_certs' on Instance uuid 336770eb-4f09-4134-92ef-f96039bf4fa9 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.compute.manager [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.objects.instance [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lazy-loading 'pci_requests' on Instance uuid 336770eb-4f09-4134-92ef-f96039bf4fa9 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.objects.instance [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lazy-loading 'pci_devices' on Instance uuid 336770eb-4f09-4134-92ef-f96039bf4fa9 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.objects.instance [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lazy-loading 'resources' on Instance uuid 336770eb-4f09-4134-92ef-f96039bf4fa9 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.objects.instance [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lazy-loading 'migration_context' on Instance uuid 336770eb-4f09-4134-92ef-f96039bf4fa9 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.network.neutron [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Updating instance_info_cache with network_info: [{"id": "31867152-d058-43b9-a8af-f1a7c61f5299", "address": "fa:16:3e:4a:61:62", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31867152-d0", "ovs_interfaceid": "31867152-d058-43b9-a8af-f1a7c61f5299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.objects.instance [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72809) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Releasing lock "refresh_cache-e8e7fc37-b821-4ee9-9ec6-2b2254287d26" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.compute.manager [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Instance network_info: |[{"id": "31867152-d058-43b9-a8af-f1a7c61f5299", "address": "fa:16:3e:4a:61:62", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31867152-d0", "ovs_interfaceid": "31867152-d058-43b9-a8af-f1a7c61f5299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f79b2ff2-f1b7-4b7f-8239-fa5586933133 req-0fa053d1-bcf1-4273-9e54-3a8ef13d09b2 service nova] Acquired lock "refresh_cache-e8e7fc37-b821-4ee9-9ec6-2b2254287d26" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.network.neutron [req-f79b2ff2-f1b7-4b7f-8239-fa5586933133 req-0fa053d1-bcf1-4273-9e54-3a8ef13d09b2 service nova] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Refreshing network info cache for port 31867152-d058-43b9-a8af-f1a7c61f5299 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Start _get_guest_xml network_info=[{"id": "31867152-d058-43b9-a8af-f1a7c61f5299", "address": "fa:16:3e:4a:61:62", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31867152-d0", "ovs_interfaceid": "31867152-d058-43b9-a8af-f1a7c61f5299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:57:37 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:57:37 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:57:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2020653027',display_name='tempest-AttachVolumeNegativeTest-server-2020653027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2020653027',id=24,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3qsxN9hvPZaRYdUdKj5df7i8xIln+d6mIxvqvqlx6aSLo10WvOlmy1kltP88yZht7ZcR13a+zCkhm2yxq+93u6U4WcheeviO6+nEFj+vuuVgb4E6iHijyIlD/v4vnMXA==',key_name='tempest-keypair-1514945260',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ce7c486aaca4ef89eb7e392b717e3d7',ramdisk_id='',reservation_id='r-0igc7fzn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2066250801',owner_user_name='tempest-AttachVolumeNegativeTest-2066250801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:57:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f85a1f2a88fd40a48d1c4dba13f0ac09',uuid=e8e7fc37-b821-4ee9-9ec6-2b2254287d26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31867152-d058-43b9-a8af-f1a7c61f5299", "address": "fa:16:3e:4a:61:62", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31867152-d0", "ovs_interfaceid": "31867152-d058-43b9-a8af-f1a7c61f5299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Converting VIF {"id": "31867152-d058-43b9-a8af-f1a7c61f5299", "address": "fa:16:3e:4a:61:62", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31867152-d0", "ovs_interfaceid": "31867152-d058-43b9-a8af-f1a7c61f5299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:61:62,bridge_name='br-int',has_traffic_filtering=True,id=31867152-d058-43b9-a8af-f1a7c61f5299,network=Network(1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31867152-d0') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.objects.instance [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lazy-loading 'pci_devices' on Instance uuid e8e7fc37-b821-4ee9-9ec6-2b2254287d26 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:57:37 user nova-compute[72809]:   <uuid>e8e7fc37-b821-4ee9-9ec6-2b2254287d26</uuid>
Aug 09 06:57:37 user nova-compute[72809]:   <name>instance-00000018</name>
Aug 09 06:57:37 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:57:37 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:57:37 user nova-compute[72809]:   <metadata>
Aug 09 06:57:37 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:57:37 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:57:37 user nova-compute[72809]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2020653027</nova:name>
Aug 09 06:57:37 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:57:37</nova:creationTime>
Aug 09 06:57:37 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:57:37 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:57:37 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:57:37 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:57:37 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:57:37 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:57:37 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:57:37 user nova-compute[72809]:       <nova:owner>
Aug 09 06:57:37 user nova-compute[72809]:         <nova:user uuid="f85a1f2a88fd40a48d1c4dba13f0ac09">tempest-AttachVolumeNegativeTest-2066250801-project-member</nova:user>
Aug 09 06:57:37 user nova-compute[72809]:         <nova:project uuid="8ce7c486aaca4ef89eb7e392b717e3d7">tempest-AttachVolumeNegativeTest-2066250801</nova:project>
Aug 09 06:57:37 user nova-compute[72809]:       </nova:owner>
Aug 09 06:57:37 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:57:37 user nova-compute[72809]:       <nova:ports>
Aug 09 06:57:37 user nova-compute[72809]:         <nova:port uuid="31867152-d058-43b9-a8af-f1a7c61f5299">
Aug 09 06:57:37 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 06:57:37 user nova-compute[72809]:         </nova:port>
Aug 09 06:57:37 user nova-compute[72809]:       </nova:ports>
Aug 09 06:57:37 user nova-compute[72809]:     </nova:instance>
Aug 09 06:57:37 user nova-compute[72809]:   </metadata>
Aug 09 06:57:37 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:57:37 user nova-compute[72809]:     <system>
Aug 09 06:57:37 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:57:37 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:57:37 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:57:37 user nova-compute[72809]:       <entry name="serial">e8e7fc37-b821-4ee9-9ec6-2b2254287d26</entry>
Aug 09 06:57:37 user nova-compute[72809]:       <entry name="uuid">e8e7fc37-b821-4ee9-9ec6-2b2254287d26</entry>
Aug 09 06:57:37 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:57:37 user nova-compute[72809]:     </system>
Aug 09 06:57:37 user nova-compute[72809]:   </sysinfo>
Aug 09 06:57:37 user nova-compute[72809]:   <os>
Aug 09 06:57:37 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:57:37 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 06:57:37 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:57:37 user nova-compute[72809]:   </os>
Aug 09 06:57:37 user nova-compute[72809]:   <features>
Aug 09 06:57:37 user nova-compute[72809]:     <acpi/>
Aug 09 06:57:37 user nova-compute[72809]:     <apic/>
Aug 09 06:57:37 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:57:37 user nova-compute[72809]:   </features>
Aug 09 06:57:37 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:57:37 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:57:37 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:57:37 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:57:37 user nova-compute[72809]:   </clock>
Aug 09 06:57:37 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:57:37 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:57:37 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:57:37 user nova-compute[72809]:   </cpu>
Aug 09 06:57:37 user nova-compute[72809]:   <devices>
Aug 09 06:57:37 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:57:37 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:57:37 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/e8e7fc37-b821-4ee9-9ec6-2b2254287d26/disk"/>
Aug 09 06:57:37 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:57:37 user nova-compute[72809]:     </disk>
Aug 09 06:57:37 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:57:37 user nova-compute[72809]:       <mac address="fa:16:3e:4a:61:62"/>
Aug 09 06:57:37 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:57:37 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:57:37 user nova-compute[72809]:       <target dev="tap31867152-d0"/>
Aug 09 06:57:37 user nova-compute[72809]:     </interface>
Aug 09 06:57:37 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:57:37 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/e8e7fc37-b821-4ee9-9ec6-2b2254287d26/console.log" append="off"/>
Aug 09 06:57:37 user nova-compute[72809]:     </serial>
Aug 09 06:57:37 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:57:37 user nova-compute[72809]:     <video>
Aug 09 06:57:37 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:57:37 user nova-compute[72809]:     </video>
Aug 09 06:57:37 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:57:37 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:57:37 user nova-compute[72809]:     </rng>
Aug 09 06:57:37 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:57:37 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:57:37 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:57:37 user nova-compute[72809]:     </memballoon>
Aug 09 06:57:37 user nova-compute[72809]:   </devices>
Aug 09 06:57:37 user nova-compute[72809]: </domain>
Aug 09 06:57:37 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:57:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2020653027',display_name='tempest-AttachVolumeNegativeTest-server-2020653027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2020653027',id=24,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3qsxN9hvPZaRYdUdKj5df7i8xIln+d6mIxvqvqlx6aSLo10WvOlmy1kltP88yZht7ZcR13a+zCkhm2yxq+93u6U4WcheeviO6+nEFj+vuuVgb4E6iHijyIlD/v4vnMXA==',key_name='tempest-keypair-1514945260',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ce7c486aaca4ef89eb7e392b717e3d7',ramdisk_id='',reservation_id='r-0igc7fzn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2066250801',owner_user_name='tempest-AttachVolumeNegativeTest-2066250801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:57:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f85a1f2a88fd40a48d1c4dba13f0ac09',uuid=e8e7fc37-b821-4ee9-9ec6-2b2254287d26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31867152-d058-43b9-a8af-f1a7c61f5299", "address": "fa:16:3e:4a:61:62", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31867152-d0", "ovs_interfaceid": "31867152-d058-43b9-a8af-f1a7c61f5299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Converting VIF {"id": "31867152-d058-43b9-a8af-f1a7c61f5299", "address": "fa:16:3e:4a:61:62", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31867152-d0", "ovs_interfaceid": "31867152-d058-43b9-a8af-f1a7c61f5299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:61:62,bridge_name='br-int',has_traffic_filtering=True,id=31867152-d058-43b9-a8af-f1a7c61f5299,network=Network(1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31867152-d0') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG os_vif [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:61:62,bridge_name='br-int',has_traffic_filtering=True,id=31867152-d058-43b9-a8af-f1a7c61f5299,network=Network(1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31867152-d0') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31867152-d0, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap31867152-d0, col_values=(('external_ids', {'iface-id': '31867152-d058-43b9-a8af-f1a7c61f5299', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:61:62', 'vm-uuid': 'e8e7fc37-b821-4ee9-9ec6-2b2254287d26'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:37 user nova-compute[72809]: INFO os_vif [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:61:62,bridge_name='br-int',has_traffic_filtering=True,id=31867152-d058-43b9-a8af-f1a7c61f5299,network=Network(1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31867152-d0')
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:57:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] No VIF found with MAC fa:16:3e:4a:61:62, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG nova.compute.manager [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 06:57:38 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Creating image(s)
Aug 09 06:57:38 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Did not create local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Ensure instance console log exists: /opt/stack/data/nova/instances/25943f41-2d28-4ffe-b38b-ae34a99426e1/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Start _get_guest_xml network_info=[{"id": "eaaf2699-4583-4421-872a-117e799570e5", "address": "fa:16:3e:47:32:ed", "network": {"id": "514e9a73-337b-46a7-b516-df614914735a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-23845660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b76be74ac2b46049686e6fdcef82dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf2699-45", "ovs_interfaceid": "eaaf2699-4583-4421-872a-117e799570e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXAPdNUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '25943f41-2d28-4ffe-b38b-ae34a99426e1', 'attached_at': '', 'detached_at': '', 'volume_id': '63dec66c-f14e-46ac-becb-481479048521', 'serial': '63dec66c-f14e-46ac-becb-481479048521'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'boot_index': 0, 'attachment_id': 'a522f38e-0fe4-4f8e-863f-adba3ad04628', 'volume_type': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:57:38 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:57:38 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:57:38 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXAPdNUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:57:38 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:57:38 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:57:38 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:57:38 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:57:38 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09c135d-d249-4658-a3e6-81969a83938c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 06:57:38 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[443a1cdc-0130-41db-a503-b04e625ef966]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521] added
Aug 09 06:57:38 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fb2662-018e-4471-8d67-b26be06c5ea4]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e81edd-7ddd-46b4-82a7-8db0f2ee5a56]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DXAPdNUJ {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG nova.network.neutron [req-f79b2ff2-f1b7-4b7f-8239-fa5586933133 req-0fa053d1-bcf1-4273-9e54-3a8ef13d09b2 service nova] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Updated VIF entry in instance network info cache for port 31867152-d058-43b9-a8af-f1a7c61f5299. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG nova.network.neutron [req-f79b2ff2-f1b7-4b7f-8239-fa5586933133 req-0fa053d1-bcf1-4273-9e54-3a8ef13d09b2 service nova] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Updating instance_info_cache with network_info: [{"id": "31867152-d058-43b9-a8af-f1a7c61f5299", "address": "fa:16:3e:4a:61:62", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31867152-d0", "ovs_interfaceid": "31867152-d058-43b9-a8af-f1a7c61f5299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DXAPdNUJ" returned: 0 in 0.029s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[29023030-023f-4537-942e-ec1be7723ad6]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DXAPdNUJ'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f79b2ff2-f1b7-4b7f-8239-fa5586933133 req-0fa053d1-bcf1-4273-9e54-3a8ef13d09b2 service nova] Releasing lock "refresh_cache-e8e7fc37-b821-4ee9-9ec6-2b2254287d26" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[df12b103-ae8b-4380-a1b4-d5bbceaf3395]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[91315cd3-c02d-46b8-8081-3ad8f013270f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 (non-flash)
Aug 09 06:57:38 user nova-compute[72809]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 06:57:38 user nova-compute[72809]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)
Aug 09 06:57:38 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 (non-flash)
Aug 09 06:57:38 user nova-compute[72809]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 06:57:38 user nova-compute[72809]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)
Aug 09 06:57:38 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[258d9a4d-6576-4c91-a0b0-c968391eb53b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521, portal: 172.16.0.220,3260]
Aug 09 06:57:38 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521, portal: 172.16.0.220,3260] successful.
Aug 09 06:57:38 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e6755b-073d-4893-9308-ff70921178b3]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e616b8-bab8-4152-961f-b00ca9e1a93f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 (non-flash)
Aug 09 06:57:38 user nova-compute[72809]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 06:57:38 user nova-compute[72809]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)
Aug 09 06:57:38 user nova-compute[72809]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 06:57:38 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 (non-flash)
Aug 09 06:57:38 user nova-compute[72809]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 06:57:38 user nova-compute[72809]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)
Aug 09 06:57:38 user nova-compute[72809]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 06:57:38 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4dce9c-df6a-4750-9835-07012e24841a]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:38 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: None {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 06:57:39 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Instance destroyed successfully.
Aug 09 06:57:39 user nova-compute[72809]: DEBUG nova.compute.manager [req-a608448b-a2dc-4c26-be22-97847d8f5e5c req-8c69bc9e-66bd-4c39-bc76-388460a07f8d service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Received event network-vif-unplugged-8ac68313-9d94-449d-87e1-9fb135c7bab5 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a608448b-a2dc-4c26-be22-97847d8f5e5c req-8c69bc9e-66bd-4c39-bc76-388460a07f8d service nova] Acquiring lock "336770eb-4f09-4134-92ef-f96039bf4fa9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a608448b-a2dc-4c26-be22-97847d8f5e5c req-8c69bc9e-66bd-4c39-bc76-388460a07f8d service nova] Lock "336770eb-4f09-4134-92ef-f96039bf4fa9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a608448b-a2dc-4c26-be22-97847d8f5e5c req-8c69bc9e-66bd-4c39-bc76-388460a07f8d service nova] Lock "336770eb-4f09-4134-92ef-f96039bf4fa9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG nova.compute.manager [req-a608448b-a2dc-4c26-be22-97847d8f5e5c req-8c69bc9e-66bd-4c39-bc76-388460a07f8d service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] No waiting events found dispatching network-vif-unplugged-8ac68313-9d94-449d-87e1-9fb135c7bab5 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:57:39 user nova-compute[72809]: WARNING nova.compute.manager [req-a608448b-a2dc-4c26-be22-97847d8f5e5c req-8c69bc9e-66bd-4c39-bc76-388460a07f8d service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Received unexpected event network-vif-unplugged-8ac68313-9d94-449d-87e1-9fb135c7bab5 for instance with vm_state active and task_state rebuilding.
Aug 09 06:57:39 user nova-compute[72809]: DEBUG nova.compute.manager [req-a608448b-a2dc-4c26-be22-97847d8f5e5c req-8c69bc9e-66bd-4c39-bc76-388460a07f8d service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Received event network-vif-plugged-8ac68313-9d94-449d-87e1-9fb135c7bab5 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a608448b-a2dc-4c26-be22-97847d8f5e5c req-8c69bc9e-66bd-4c39-bc76-388460a07f8d service nova] Acquiring lock "336770eb-4f09-4134-92ef-f96039bf4fa9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a608448b-a2dc-4c26-be22-97847d8f5e5c req-8c69bc9e-66bd-4c39-bc76-388460a07f8d service nova] Lock "336770eb-4f09-4134-92ef-f96039bf4fa9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a608448b-a2dc-4c26-be22-97847d8f5e5c req-8c69bc9e-66bd-4c39-bc76-388460a07f8d service nova] Lock "336770eb-4f09-4134-92ef-f96039bf4fa9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG nova.compute.manager [req-a608448b-a2dc-4c26-be22-97847d8f5e5c req-8c69bc9e-66bd-4c39-bc76-388460a07f8d service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] No waiting events found dispatching network-vif-plugged-8ac68313-9d94-449d-87e1-9fb135c7bab5 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:57:39 user nova-compute[72809]: WARNING nova.compute.manager [req-a608448b-a2dc-4c26-be22-97847d8f5e5c req-8c69bc9e-66bd-4c39-bc76-388460a07f8d service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Received unexpected event network-vif-plugged-8ac68313-9d94-449d-87e1-9fb135c7bab5 for instance with vm_state active and task_state rebuilding.
Aug 09 06:57:39 user nova-compute[72809]: INFO nova.compute.manager [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Detaching volume 558b89a2-6411-4dfc-937a-332585a1f186
Aug 09 06:57:39 user nova-compute[72809]: INFO nova.virt.block_device [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Attempting to driver detach volume 558b89a2-6411-4dfc-937a-332585a1f186 from mountpoint /dev/vdb
Aug 09 06:57:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Attempting to detach device vdb from instance 336770eb-4f09-4134-92ef-f96039bf4fa9 from the persistent domain config. {{(pid=72809) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 06:57:39 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:57:39 user nova-compute[72809]:   <source dev="/dev/sdc"/>
Aug 09 06:57:39 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 06:57:39 user nova-compute[72809]:   <serial>558b89a2-6411-4dfc-937a-332585a1f186</serial>
Aug 09 06:57:39 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 06:57:39 user nova-compute[72809]: </disk>
Aug 09 06:57:39 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 06:57:39 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Successfully detached device vdb from instance 336770eb-4f09-4134-92ef-f96039bf4fa9 from the persistent domain config.
Aug 09 06:57:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QVSLipFZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:57:39 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 06:57:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXAPdNUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '26464653164376464', 'path': '/dev/sde'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464653164376464', 'path': '/dev/sde'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.453s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0957dc10-f4bd-4331-a681-040ba77183d8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6312a454-948c-47b3-90e4-ed9064ded1b0]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 (non-flash)
Aug 09 06:57:39 user nova-compute[72809]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 06:57:39 user nova-compute[72809]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)
Aug 09 06:57:39 user nova-compute[72809]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 06:57:39 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 (non-flash)
Aug 09 06:57:39 user nova-compute[72809]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 06:57:39 user nova-compute[72809]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)
Aug 09 06:57:39 user nova-compute[72809]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 06:57:39 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc13851d3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186'): ({'sdc'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Removing single pathed devices sdc {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:57:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-746793904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-746793904',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaQ4scRY1Gs40gnfMXMH9+94YnOoay8Xk4x1JUX9Bi5t92OrKSGMiljWmXUj+GTELgNUptiW7m1t9tJjH9WklkC4tVBDCva2tyGVNhU3VtR7ORGer1lOM2KxVeRyFujXA==',key_name='tempest-keypair-1187965605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b76be74ac2b46049686e6fdcef82dbb',ramdisk_id='',reservation_id='r-y0g6fmqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1383955831',owner_user_name='tempest-ServerActionsV293TestJSON-1383955831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:57:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66208d0453c0457ea5402ee892558f33',uuid=25943f41-2d28-4ffe-b38b-ae34a99426e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eaaf2699-4583-4421-872a-117e799570e5", "address": "fa:16:3e:47:32:ed", "network": {"id": "514e9a73-337b-46a7-b516-df614914735a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-23845660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b76be74ac2b46049686e6fdcef82dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf2699-45", "ovs_interfaceid": "eaaf2699-4583-4421-872a-117e799570e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Converting VIF {"id": "eaaf2699-4583-4421-872a-117e799570e5", "address": "fa:16:3e:47:32:ed", "network": {"id": "514e9a73-337b-46a7-b516-df614914735a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-23845660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b76be74ac2b46049686e6fdcef82dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf2699-45", "ovs_interfaceid": "eaaf2699-4583-4421-872a-117e799570e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:32:ed,bridge_name='br-int',has_traffic_filtering=True,id=eaaf2699-4583-4421-872a-117e799570e5,network=Network(514e9a73-337b-46a7-b516-df614914735a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaaf2699-45') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG nova.objects.instance [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lazy-loading 'pci_devices' on Instance uuid 25943f41-2d28-4ffe-b38b-ae34a99426e1 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:57:39 user nova-compute[72809]:   <uuid>25943f41-2d28-4ffe-b38b-ae34a99426e1</uuid>
Aug 09 06:57:39 user nova-compute[72809]:   <name>instance-00000017</name>
Aug 09 06:57:39 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:57:39 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:57:39 user nova-compute[72809]:   <metadata>
Aug 09 06:57:39 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:57:39 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:57:39 user nova-compute[72809]:       <nova:name>tempest-ServerActionsV293TestJSON-server-746793904</nova:name>
Aug 09 06:57:39 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:57:38</nova:creationTime>
Aug 09 06:57:39 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:57:39 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:57:39 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:57:39 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:57:39 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:57:39 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:57:39 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:57:39 user nova-compute[72809]:       <nova:owner>
Aug 09 06:57:39 user nova-compute[72809]:         <nova:user uuid="66208d0453c0457ea5402ee892558f33">tempest-ServerActionsV293TestJSON-1383955831-project-member</nova:user>
Aug 09 06:57:39 user nova-compute[72809]:         <nova:project uuid="3b76be74ac2b46049686e6fdcef82dbb">tempest-ServerActionsV293TestJSON-1383955831</nova:project>
Aug 09 06:57:39 user nova-compute[72809]:       </nova:owner>
Aug 09 06:57:39 user nova-compute[72809]:       <nova:ports>
Aug 09 06:57:39 user nova-compute[72809]:         <nova:port uuid="eaaf2699-4583-4421-872a-117e799570e5">
Aug 09 06:57:39 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 06:57:39 user nova-compute[72809]:         </nova:port>
Aug 09 06:57:39 user nova-compute[72809]:       </nova:ports>
Aug 09 06:57:39 user nova-compute[72809]:     </nova:instance>
Aug 09 06:57:39 user nova-compute[72809]:   </metadata>
Aug 09 06:57:39 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:57:39 user nova-compute[72809]:     <system>
Aug 09 06:57:39 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:57:39 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:57:39 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:57:39 user nova-compute[72809]:       <entry name="serial">25943f41-2d28-4ffe-b38b-ae34a99426e1</entry>
Aug 09 06:57:39 user nova-compute[72809]:       <entry name="uuid">25943f41-2d28-4ffe-b38b-ae34a99426e1</entry>
Aug 09 06:57:39 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:57:39 user nova-compute[72809]:     </system>
Aug 09 06:57:39 user nova-compute[72809]:   </sysinfo>
Aug 09 06:57:39 user nova-compute[72809]:   <os>
Aug 09 06:57:39 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:57:39 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 06:57:39 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:57:39 user nova-compute[72809]:   </os>
Aug 09 06:57:39 user nova-compute[72809]:   <features>
Aug 09 06:57:39 user nova-compute[72809]:     <acpi/>
Aug 09 06:57:39 user nova-compute[72809]:     <apic/>
Aug 09 06:57:39 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:57:39 user nova-compute[72809]:   </features>
Aug 09 06:57:39 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:57:39 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:57:39 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:57:39 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:57:39 user nova-compute[72809]:   </clock>
Aug 09 06:57:39 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:57:39 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:57:39 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:57:39 user nova-compute[72809]:   </cpu>
Aug 09 06:57:39 user nova-compute[72809]:   <devices>
Aug 09 06:57:39 user nova-compute[72809]:     <disk type="block" device="disk">
Aug 09 06:57:39 user nova-compute[72809]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:57:39 user nova-compute[72809]:       <source dev="/dev/sde"/>
Aug 09 06:57:39 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:57:39 user nova-compute[72809]:       <serial>63dec66c-f14e-46ac-becb-481479048521</serial>
Aug 09 06:57:39 user nova-compute[72809]:     </disk>
Aug 09 06:57:39 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:57:39 user nova-compute[72809]:       <mac address="fa:16:3e:47:32:ed"/>
Aug 09 06:57:39 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:57:39 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:57:39 user nova-compute[72809]:       <target dev="tapeaaf2699-45"/>
Aug 09 06:57:39 user nova-compute[72809]:     </interface>
Aug 09 06:57:39 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:57:39 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/25943f41-2d28-4ffe-b38b-ae34a99426e1/console.log" append="off"/>
Aug 09 06:57:39 user nova-compute[72809]:     </serial>
Aug 09 06:57:39 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:57:39 user nova-compute[72809]:     <video>
Aug 09 06:57:39 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:57:39 user nova-compute[72809]:     </video>
Aug 09 06:57:39 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:57:39 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:57:39 user nova-compute[72809]:     </rng>
Aug 09 06:57:39 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:57:39 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:57:39 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:57:39 user nova-compute[72809]:     </memballoon>
Aug 09 06:57:39 user nova-compute[72809]:   </devices>
Aug 09 06:57:39 user nova-compute[72809]: </domain>
Aug 09 06:57:39 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:57:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-746793904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-746793904',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaQ4scRY1Gs40gnfMXMH9+94YnOoay8Xk4x1JUX9Bi5t92OrKSGMiljWmXUj+GTELgNUptiW7m1t9tJjH9WklkC4tVBDCva2tyGVNhU3VtR7ORGer1lOM2KxVeRyFujXA==',key_name='tempest-keypair-1187965605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b76be74ac2b46049686e6fdcef82dbb',ramdisk_id='',reservation_id='r-y0g6fmqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1383955831',owner_user_name='tempest-ServerActionsV293TestJSON-1383955831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:57:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66208d0453c0457ea5402ee892558f33',uuid=25943f41-2d28-4ffe-b38b-ae34a99426e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eaaf2699-4583-4421-872a-117e799570e5", "address": "fa:16:3e:47:32:ed", "network": {"id": "514e9a73-337b-46a7-b516-df614914735a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-23845660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b76be74ac2b46049686e6fdcef82dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf2699-45", "ovs_interfaceid": "eaaf2699-4583-4421-872a-117e799570e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Converting VIF {"id": "eaaf2699-4583-4421-872a-117e799570e5", "address": "fa:16:3e:47:32:ed", "network": {"id": "514e9a73-337b-46a7-b516-df614914735a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-23845660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b76be74ac2b46049686e6fdcef82dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf2699-45", "ovs_interfaceid": "eaaf2699-4583-4421-872a-117e799570e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:32:ed,bridge_name='br-int',has_traffic_filtering=True,id=eaaf2699-4583-4421-872a-117e799570e5,network=Network(514e9a73-337b-46a7-b516-df614914735a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaaf2699-45') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG os_vif [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:32:ed,bridge_name='br-int',has_traffic_filtering=True,id=eaaf2699-4583-4421-872a-117e799570e5,network=Network(514e9a73-337b-46a7-b516-df614914735a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaaf2699-45') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb8be4a-d833-44e0-8864-bcde4dcea4e8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeaaf2699-45, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeaaf2699-45, col_values=(('external_ids', {'iface-id': 'eaaf2699-4583-4421-872a-117e799570e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:32:ed', 'vm-uuid': '25943f41-2d28-4ffe-b38b-ae34a99426e1'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:40 user nova-compute[72809]: INFO os_vif [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:32:ed,bridge_name='br-int',has_traffic_filtering=True,id=eaaf2699-4583-4421-872a-117e799570e5,network=Network(514e9a73-337b-46a7-b516-df614914735a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaaf2699-45')
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.035s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b439a2-0e28-4eaf-97f6-26a7d06a2090]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:40 user nova-compute[72809]: INFO nova.compute.manager [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Detaching volume ed384adf-9851-4d4f-9ca4-998e3b064a44
Aug 09 06:57:40 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Flushing IO for device /dev/sdc {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf0c132-4cd8-4ffd-a4a1-83b7713f0ce3]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] No VIF found with MAC fa:16:3e:47:32:ed, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:57:40 user nova-compute[72809]: INFO nova.virt.block_device [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Attempting to driver detach volume ed384adf-9851-4d4f-9ca4-998e3b064a44 from mountpoint /dev/vdc
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[710f3981-0fdd-4a79-b1b1-cab682658386]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] SCSI volumes sdc have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Attempting to detach device vdc from instance aec0a7ee-69e1-41cf-bfa8-5733bdedd70a from the persistent domain config. {{(pid=72809) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 06:57:40 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:57:40 user nova-compute[72809]:   <source dev="/dev/sdd"/>
Aug 09 06:57:40 user nova-compute[72809]:   <target dev="vdc" bus="virtio"/>
Aug 09 06:57:40 user nova-compute[72809]:   <serial>ed384adf-9851-4d4f-9ca4-998e3b064a44</serial>
Aug 09 06:57:40 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 06:57:40 user nova-compute[72809]: </disk>
Aug 09 06:57:40 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:40 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Successfully detached device vdc from instance aec0a7ee-69e1-41cf-bfa8-5733bdedd70a from the persistent domain config.
Aug 09 06:57:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance aec0a7ee-69e1-41cf-bfa8-5733bdedd70a from the live domain config. {{(pid=72809) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 06:57:40 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:57:40 user nova-compute[72809]:   <source dev="/dev/sdd"/>
Aug 09 06:57:40 user nova-compute[72809]:   <target dev="vdc" bus="virtio"/>
Aug 09 06:57:40 user nova-compute[72809]:   <serial>ed384adf-9851-4d4f-9ca4-998e3b064a44</serial>
Aug 09 06:57:40 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 06:57:40 user nova-compute[72809]: </disk>
Aug 09 06:57:40 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c99fde-a03f-4a66-8ae7-b545e8c7be80]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691564245.155886, 15dda080-3487-4316-ab7b-f7185f0a4519 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:57:40 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] VM Stopped (Lifecycle Event)
Aug 09 06:57:40 user nova-compute[72809]: DEBUG nova.compute.manager [None req-11b62dfe-c5ef-4732-8a4c-303e2ecfaafe None None] [instance: 15dda080-3487-4316-ab7b-f7185f0a4519] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[311b524e-a922-48df-a81e-173d8b79e0cc]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186, portal: 172.16.0.220,3260]
Aug 09 06:57:40 user nova-compute[72809]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186, portal: 172.16.0.220,3260] successful.
Aug 09 06:57:40 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe56a42-3052-400f-aa85-4b914c59e4f2]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] <== disconnect_volume: return (825ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Received event <DeviceRemovedEvent: 1691564260.7890322, aec0a7ee-69e1-41cf-bfa8-5733bdedd70a => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72809) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance aec0a7ee-69e1-41cf-bfa8-5733bdedd70a {{(pid=72809) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 06:57:40 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Successfully detached device vdc from instance aec0a7ee-69e1-41cf-bfa8-5733bdedd70a from the live domain config.
Aug 09 06:57:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sjluIXaY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:57:40 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:57:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3e2e49-b6f6-4155-96cb-88cd699608af]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea44d0f-6417-4b15-aaa9-502bd271d517]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 (non-flash)
Aug 09 06:57:40 user nova-compute[72809]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 06:57:40 user nova-compute[72809]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 06:57:40 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 (non-flash)
Aug 09 06:57:40 user nova-compute[72809]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 06:57:40 user nova-compute[72809]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 06:57:40 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc1585d5090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44'): ({'sdd'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Removing single pathed devices sdd {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af80d1e-a871-46db-8c26-6b95c0517e95]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc25970-7380-4b17-a89d-1344c25f2724]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Flushing IO for device /dev/sdd {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0642a861-2aeb-440a-a481-7d1a4dfae968]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.031s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead6b231-30d1-430a-a082-5c885a6655f1]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] SCSI volumes sdd have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[86aed742-32e7-4df4-b73e-9af4ae1ae4e4]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5ba911-2ad5-4bb8-81b5-cb3e4d3d2c85]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44, portal: 172.16.0.220,3260]
Aug 09 06:57:41 user nova-compute[72809]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44, portal: 172.16.0.220,3260] successful.
Aug 09 06:57:41 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed384adf-9851-4d4f-9ca4-998e3b064a44 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d20cbb0-205d-481e-89db-0ae4ea1526ee]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] <== disconnect_volume: return (275ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 06:57:41 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Instance destroyed successfully.
Aug 09 06:57:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:53:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-83451525',display_name='tempest-ServerActionsTestOtherA-server-354299267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-83451525',id=16,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCouL5r1ONNNh4MEm1cE7q85fOqyiHXG74zUMePb7Qx7FM94grlflWjrtC3jQ2LeCgVBOqUmmFTQqcvNJ0pbLdMAdhZ4dM0vJEiMtEgevMXZ2oGhFPDEpbVyaR20DJopHw==',key_name='tempest-keypair-888098152',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:53:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6da97330281c4d0eba99e485db051973',ramdisk_id='',reservation_id='r-p0mtguey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-118844208',owner_user_name='tempest-ServerActionsTestOtherA-118844208-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:57:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10e067d2b5b7459cadf50b1ed89a8864',uuid=336770eb-4f09-4134-92ef-f96039bf4fa9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "address": "fa:16:3e:b9:56:8d", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac68313-9d", "ovs_interfaceid": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Converting VIF {"id": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "address": "fa:16:3e:b9:56:8d", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac68313-9d", "ovs_interfaceid": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:56:8d,bridge_name='br-int',has_traffic_filtering=True,id=8ac68313-9d94-449d-87e1-9fb135c7bab5,network=Network(0e68e18b-480a-4b6c-b194-39ba1099a4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac68313-9d') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG os_vif [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:56:8d,bridge_name='br-int',has_traffic_filtering=True,id=8ac68313-9d94-449d-87e1-9fb135c7bab5,network=Network(0e68e18b-480a-4b6c-b194-39ba1099a4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac68313-9d') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ac68313-9d, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:41 user nova-compute[72809]: INFO os_vif [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:56:8d,bridge_name='br-int',has_traffic_filtering=True,id=8ac68313-9d94-449d-87e1-9fb135c7bab5,network=Network(0e68e18b-480a-4b6c-b194-39ba1099a4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac68313-9d')
Aug 09 06:57:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QVSLipFZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:57:41 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 06:57:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee65391-842a-4aef-9a37-e863f7800e25]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cf0a36-68da-47eb-bd96-9dbf2215b036]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 06:57:41 user nova-compute[72809]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 06:57:41 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 06:57:41 user nova-compute[72809]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 06:57:41 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc138513e20>, {}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Disconnecting from: [] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] <== disconnect_volume: return (73ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 06:57:41 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Deleting instance files /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9_del
Aug 09 06:57:41 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Deletion of /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9_del complete
Aug 09 06:57:41 user nova-compute[72809]: DEBUG nova.compute.manager [req-8d853283-2afb-414c-abd0-87ee1bb48ccb req-6b4f8796-3204-45f7-809e-c3ece92cc97a service nova] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Received event network-vif-plugged-31867152-d058-43b9-a8af-f1a7c61f5299 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-8d853283-2afb-414c-abd0-87ee1bb48ccb req-6b4f8796-3204-45f7-809e-c3ece92cc97a service nova] Acquiring lock "e8e7fc37-b821-4ee9-9ec6-2b2254287d26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-8d853283-2afb-414c-abd0-87ee1bb48ccb req-6b4f8796-3204-45f7-809e-c3ece92cc97a service nova] Lock "e8e7fc37-b821-4ee9-9ec6-2b2254287d26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-8d853283-2afb-414c-abd0-87ee1bb48ccb req-6b4f8796-3204-45f7-809e-c3ece92cc97a service nova] Lock "e8e7fc37-b821-4ee9-9ec6-2b2254287d26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG nova.compute.manager [req-8d853283-2afb-414c-abd0-87ee1bb48ccb req-6b4f8796-3204-45f7-809e-c3ece92cc97a service nova] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] No waiting events found dispatching network-vif-plugged-31867152-d058-43b9-a8af-f1a7c61f5299 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:57:41 user nova-compute[72809]: WARNING nova.compute.manager [req-8d853283-2afb-414c-abd0-87ee1bb48ccb req-6b4f8796-3204-45f7-809e-c3ece92cc97a service nova] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Received unexpected event network-vif-plugged-31867152-d058-43b9-a8af-f1a7c61f5299 for instance with vm_state building and task_state spawning.
Aug 09 06:57:41 user nova-compute[72809]: DEBUG nova.compute.manager [req-8d853283-2afb-414c-abd0-87ee1bb48ccb req-6b4f8796-3204-45f7-809e-c3ece92cc97a service nova] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Received event network-vif-plugged-31867152-d058-43b9-a8af-f1a7c61f5299 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-8d853283-2afb-414c-abd0-87ee1bb48ccb req-6b4f8796-3204-45f7-809e-c3ece92cc97a service nova] Acquiring lock "e8e7fc37-b821-4ee9-9ec6-2b2254287d26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-8d853283-2afb-414c-abd0-87ee1bb48ccb req-6b4f8796-3204-45f7-809e-c3ece92cc97a service nova] Lock "e8e7fc37-b821-4ee9-9ec6-2b2254287d26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-8d853283-2afb-414c-abd0-87ee1bb48ccb req-6b4f8796-3204-45f7-809e-c3ece92cc97a service nova] Lock "e8e7fc37-b821-4ee9-9ec6-2b2254287d26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG nova.compute.manager [req-8d853283-2afb-414c-abd0-87ee1bb48ccb req-6b4f8796-3204-45f7-809e-c3ece92cc97a service nova] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] No waiting events found dispatching network-vif-plugged-31867152-d058-43b9-a8af-f1a7c61f5299 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:57:41 user nova-compute[72809]: WARNING nova.compute.manager [req-8d853283-2afb-414c-abd0-87ee1bb48ccb req-6b4f8796-3204-45f7-809e-c3ece92cc97a service nova] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Received unexpected event network-vif-plugged-31867152-d058-43b9-a8af-f1a7c61f5299 for instance with vm_state building and task_state spawning.
Aug 09 06:57:41 user nova-compute[72809]: INFO nova.virt.block_device [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Booting with volume 558b89a2-6411-4dfc-937a-332585a1f186 at /dev/vdb
Aug 09 06:57:41 user nova-compute[72809]: DEBUG os_brick.utils [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[de329d26-9ce3-487f-8675-4ab376ad33fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dba95b8-d74d-4b65-bdc3-8b2595c528f7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37bb131-4313-4938-9107-13553c9ee2c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc96d37a-58d8-4441-8181-2b7c9ccebe8d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:57:41 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 06:57:41 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b4041a-57ea-4840-990c-3bd142fff8d2]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG os_brick.utils [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] <== get_connector_properties: return (183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Updating existing volume attachment record: e19dbd38-e68d-40fd-9544-c3d91993f2f5 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:41 user nova-compute[72809]: DEBUG nova.objects.instance [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lazy-loading 'flavor' on Instance uuid aec0a7ee-69e1-41cf-bfa8-5733bdedd70a {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:57:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-aefb99b0-8880-4004-b2ce-4cbfd5a6fd58 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.026s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:42 user nova-compute[72809]: DEBUG nova.compute.manager [req-6d16e217-26fb-484c-8f54-b02c9c525889 req-5937e4f8-b645-437f-aab3-aee7db5d2969 service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Received event network-vif-plugged-eaaf2699-4583-4421-872a-117e799570e5 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:57:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6d16e217-26fb-484c-8f54-b02c9c525889 req-5937e4f8-b645-437f-aab3-aee7db5d2969 service nova] Acquiring lock "25943f41-2d28-4ffe-b38b-ae34a99426e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6d16e217-26fb-484c-8f54-b02c9c525889 req-5937e4f8-b645-437f-aab3-aee7db5d2969 service nova] Lock "25943f41-2d28-4ffe-b38b-ae34a99426e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6d16e217-26fb-484c-8f54-b02c9c525889 req-5937e4f8-b645-437f-aab3-aee7db5d2969 service nova] Lock "25943f41-2d28-4ffe-b38b-ae34a99426e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:42 user nova-compute[72809]: DEBUG nova.compute.manager [req-6d16e217-26fb-484c-8f54-b02c9c525889 req-5937e4f8-b645-437f-aab3-aee7db5d2969 service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] No waiting events found dispatching network-vif-plugged-eaaf2699-4583-4421-872a-117e799570e5 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:57:42 user nova-compute[72809]: WARNING nova.compute.manager [req-6d16e217-26fb-484c-8f54-b02c9c525889 req-5937e4f8-b645-437f-aab3-aee7db5d2969 service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Received unexpected event network-vif-plugged-eaaf2699-4583-4421-872a-117e799570e5 for instance with vm_state building and task_state spawning.
Aug 09 06:57:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:43 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:43 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564263.7457702, e8e7fc37-b821-4ee9-9ec6-2b2254287d26 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:57:43 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] VM Resumed (Lifecycle Event)
Aug 09 06:57:43 user nova-compute[72809]: DEBUG nova.compute.manager [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:57:43 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 06:57:43 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Instance spawned successfully.
Aug 09 06:57:43 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 06:57:43 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:57:43 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:57:43 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:57:43 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:57:43 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:57:43 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:57:43 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:57:43 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:57:43 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:57:43 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564263.7493079, e8e7fc37-b821-4ee9-9ec6-2b2254287d26 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:57:43 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] VM Started (Lifecycle Event)
Aug 09 06:57:43 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:57:43 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:57:43 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:57:43 user nova-compute[72809]: INFO nova.compute.manager [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Took 8.21 seconds to spawn the instance on the hypervisor.
Aug 09 06:57:43 user nova-compute[72809]: DEBUG nova.compute.manager [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:57:43 user nova-compute[72809]: INFO nova.compute.manager [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Took 9.58 seconds to build instance.
Aug 09 06:57:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e78cf-f3c7-429a-b359-216d62f5aa08 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "e8e7fc37-b821-4ee9-9ec6-2b2254287d26" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.714s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:44 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564264.068451, 25943f41-2d28-4ffe-b38b-ae34a99426e1 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:57:44 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] VM Resumed (Lifecycle Event)
Aug 09 06:57:44 user nova-compute[72809]: DEBUG nova.compute.manager [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:57:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 06:57:44 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Instance spawned successfully.
Aug 09 06:57:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 06:57:44 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:57:44 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:57:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:57:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:57:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:57:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:57:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:57:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:57:44 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:57:44 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564264.0694458, 25943f41-2d28-4ffe-b38b-ae34a99426e1 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:57:44 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] VM Started (Lifecycle Event)
Aug 09 06:57:44 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:57:44 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:57:44 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:57:44 user nova-compute[72809]: INFO nova.compute.manager [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Took 5.75 seconds to spawn the instance on the hypervisor.
Aug 09 06:57:44 user nova-compute[72809]: DEBUG nova.compute.manager [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:57:44 user nova-compute[72809]: DEBUG nova.compute.manager [req-1f8a85e2-9c6b-45ad-85c9-81af1ec5a9dd req-3350dfed-3e67-467c-a2f9-15618c18ed4e service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Received event network-vif-plugged-eaaf2699-4583-4421-872a-117e799570e5 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:57:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1f8a85e2-9c6b-45ad-85c9-81af1ec5a9dd req-3350dfed-3e67-467c-a2f9-15618c18ed4e service nova] Acquiring lock "25943f41-2d28-4ffe-b38b-ae34a99426e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1f8a85e2-9c6b-45ad-85c9-81af1ec5a9dd req-3350dfed-3e67-467c-a2f9-15618c18ed4e service nova] Lock "25943f41-2d28-4ffe-b38b-ae34a99426e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1f8a85e2-9c6b-45ad-85c9-81af1ec5a9dd req-3350dfed-3e67-467c-a2f9-15618c18ed4e service nova] Lock "25943f41-2d28-4ffe-b38b-ae34a99426e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:44 user nova-compute[72809]: DEBUG nova.compute.manager [req-1f8a85e2-9c6b-45ad-85c9-81af1ec5a9dd req-3350dfed-3e67-467c-a2f9-15618c18ed4e service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] No waiting events found dispatching network-vif-plugged-eaaf2699-4583-4421-872a-117e799570e5 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:57:44 user nova-compute[72809]: WARNING nova.compute.manager [req-1f8a85e2-9c6b-45ad-85c9-81af1ec5a9dd req-3350dfed-3e67-467c-a2f9-15618c18ed4e service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Received unexpected event network-vif-plugged-eaaf2699-4583-4421-872a-117e799570e5 for instance with vm_state building and task_state spawning.
Aug 09 06:57:44 user nova-compute[72809]: INFO nova.compute.manager [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Took 18.49 seconds to build instance.
Aug 09 06:57:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-31197eb1-f684-4f0d-99b7-c8f4f6f1c28d tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lock "25943f41-2d28-4ffe-b38b-ae34a99426e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.611s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:50 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 06:57:50 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Creating image(s)
Aug 09 06:57:50 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "/opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:50 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "/opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:50 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "/opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.140s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:50 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:50 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.139s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk 1073741824" returned: 0 in 0.059s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.140s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Checking if we can resize image /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Cannot resize image /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Ensure instance console log exists: /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Start _get_guest_xml network_info=[{"id": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "address": "fa:16:3e:b9:56:8d", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac68313-9d", "ovs_interfaceid": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QVSLipFZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '336770eb-4f09-4134-92ef-f96039bf4fa9', 'attached_at': '', 'detached_at': '', 'volume_id': '558b89a2-6411-4dfc-937a-332585a1f186', 'serial': '558b89a2-6411-4dfc-937a-332585a1f186'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': None, 'attachment_id': 'e19dbd38-e68d-40fd-9544-c3d91993f2f5', 'volume_type': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:57:51 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 06:57:51 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 06:57:51 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG nova.objects.instance [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lazy-loading 'vcpu_model' on Instance uuid 336770eb-4f09-4134-92ef-f96039bf4fa9 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QVSLipFZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:57:51 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 06:57:51 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:57:51 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 06:57:51 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:57:51 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e99f076-7965-40d5-a87b-8d813ee843c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 06:57:51 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e16798-6500-4584-899d-23a54fa214a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186] added
Aug 09 06:57:51 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e940034a-8036-4c56-959f-56dd620c3a5c]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda5778c-0565-4c5b-bd88-ff29cb870ca4]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QVSLipFZ {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QVSLipFZ" returned: 0 in 0.026s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb5745e-18ac-4541-b5f8-028c17571056]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QVSLipFZ'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd66d3b-c149-4eb9-a4b7-d63b0cd84294]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f23e6c-e50f-434f-b1fc-ae6303e5b679]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 06:57:51 user nova-compute[72809]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 06:57:51 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 06:57:51 user nova-compute[72809]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 06:57:51 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[41470541-2552-44e5-9385-f976fadeb8aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186, portal: 172.16.0.220,3260]
Aug 09 06:57:51 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186, portal: 172.16.0.220,3260] successful.
Aug 09 06:57:51 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c5203c-7046-4c21-806f-7510799e0b29]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a6de54-36f7-4c4a-95da-4e1d7dda1589]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 06:57:51 user nova-compute[72809]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 06:57:51 user nova-compute[72809]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)
Aug 09 06:57:51 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 06:57:51 user nova-compute[72809]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 06:57:51 user nova-compute[72809]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)
Aug 09 06:57:51 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[55385774-4299-45f7-a63e-3b6ab55d7dd1]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 06:57:51 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QVSLipFZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 06:57:52 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:57:52 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23962333236623736', 'path': '/dev/sdc'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:57:52 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962333236623736', 'path': '/dev/sdc'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 06:57:52 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T06:53:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-83451525',display_name='tempest-ServerActionsTestOtherA-server-354299267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-83451525',id=16,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCouL5r1ONNNh4MEm1cE7q85fOqyiHXG74zUMePb7Qx7FM94grlflWjrtC3jQ2LeCgVBOqUmmFTQqcvNJ0pbLdMAdhZ4dM0vJEiMtEgevMXZ2oGhFPDEpbVyaR20DJopHw==',key_name='tempest-keypair-888098152',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:53:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6da97330281c4d0eba99e485db051973',ramdisk_id='',reservation_id='r-p0mtguey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-118844208',owner_user_name='tempest-ServerActionsTestOtherA-118844208-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:57:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10e067d2b5b7459cadf50b1ed89a8864',uuid=336770eb-4f09-4134-92ef-f96039bf4fa9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "address": "fa:16:3e:b9:56:8d", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac68313-9d", "ovs_interfaceid": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:57:52 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Converting VIF {"id": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "address": "fa:16:3e:b9:56:8d", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac68313-9d", "ovs_interfaceid": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:57:52 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:56:8d,bridge_name='br-int',has_traffic_filtering=True,id=8ac68313-9d94-449d-87e1-9fb135c7bab5,network=Network(0e68e18b-480a-4b6c-b194-39ba1099a4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac68313-9d') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:57:52 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:57:52 user nova-compute[72809]:   <uuid>336770eb-4f09-4134-92ef-f96039bf4fa9</uuid>
Aug 09 06:57:52 user nova-compute[72809]:   <name>instance-00000010</name>
Aug 09 06:57:52 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:57:52 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:57:52 user nova-compute[72809]:   <metadata>
Aug 09 06:57:52 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:57:52 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:57:52 user nova-compute[72809]:       <nova:name>tempest-ServerActionsTestOtherA-server-354299267</nova:name>
Aug 09 06:57:52 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:57:51</nova:creationTime>
Aug 09 06:57:52 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:57:52 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:57:52 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:57:52 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:57:52 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:57:52 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:57:52 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:57:52 user nova-compute[72809]:       <nova:owner>
Aug 09 06:57:52 user nova-compute[72809]:         <nova:user uuid="10e067d2b5b7459cadf50b1ed89a8864">tempest-ServerActionsTestOtherA-118844208-project-member</nova:user>
Aug 09 06:57:52 user nova-compute[72809]:         <nova:project uuid="6da97330281c4d0eba99e485db051973">tempest-ServerActionsTestOtherA-118844208</nova:project>
Aug 09 06:57:52 user nova-compute[72809]:       </nova:owner>
Aug 09 06:57:52 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:57:52 user nova-compute[72809]:       <nova:ports>
Aug 09 06:57:52 user nova-compute[72809]:         <nova:port uuid="8ac68313-9d94-449d-87e1-9fb135c7bab5">
Aug 09 06:57:52 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 06:57:52 user nova-compute[72809]:         </nova:port>
Aug 09 06:57:52 user nova-compute[72809]:       </nova:ports>
Aug 09 06:57:52 user nova-compute[72809]:     </nova:instance>
Aug 09 06:57:52 user nova-compute[72809]:   </metadata>
Aug 09 06:57:52 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:57:52 user nova-compute[72809]:     <system>
Aug 09 06:57:52 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:57:52 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:57:52 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:57:52 user nova-compute[72809]:       <entry name="serial">336770eb-4f09-4134-92ef-f96039bf4fa9</entry>
Aug 09 06:57:52 user nova-compute[72809]:       <entry name="uuid">336770eb-4f09-4134-92ef-f96039bf4fa9</entry>
Aug 09 06:57:52 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:57:52 user nova-compute[72809]:     </system>
Aug 09 06:57:52 user nova-compute[72809]:   </sysinfo>
Aug 09 06:57:52 user nova-compute[72809]:   <os>
Aug 09 06:57:52 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:57:52 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 06:57:52 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:57:52 user nova-compute[72809]:   </os>
Aug 09 06:57:52 user nova-compute[72809]:   <features>
Aug 09 06:57:52 user nova-compute[72809]:     <acpi/>
Aug 09 06:57:52 user nova-compute[72809]:     <apic/>
Aug 09 06:57:52 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:57:52 user nova-compute[72809]:   </features>
Aug 09 06:57:52 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:57:52 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:57:52 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:57:52 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:57:52 user nova-compute[72809]:   </clock>
Aug 09 06:57:52 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:57:52 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:57:52 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:57:52 user nova-compute[72809]:   </cpu>
Aug 09 06:57:52 user nova-compute[72809]:   <devices>
Aug 09 06:57:52 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:57:52 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:57:52 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk"/>
Aug 09 06:57:52 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:57:52 user nova-compute[72809]:     </disk>
Aug 09 06:57:52 user nova-compute[72809]:     <disk type="block" device="disk">
Aug 09 06:57:52 user nova-compute[72809]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:57:52 user nova-compute[72809]:       <source dev="/dev/sdc"/>
Aug 09 06:57:52 user nova-compute[72809]:       <target dev="vdb" bus="virtio"/>
Aug 09 06:57:52 user nova-compute[72809]:       <serial>558b89a2-6411-4dfc-937a-332585a1f186</serial>
Aug 09 06:57:52 user nova-compute[72809]:     </disk>
Aug 09 06:57:52 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:57:52 user nova-compute[72809]:       <mac address="fa:16:3e:b9:56:8d"/>
Aug 09 06:57:52 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:57:52 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:57:52 user nova-compute[72809]:       <target dev="tap8ac68313-9d"/>
Aug 09 06:57:52 user nova-compute[72809]:     </interface>
Aug 09 06:57:52 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:57:52 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/console.log" append="off"/>
Aug 09 06:57:52 user nova-compute[72809]:     </serial>
Aug 09 06:57:52 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:57:52 user nova-compute[72809]:     <video>
Aug 09 06:57:52 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:57:52 user nova-compute[72809]:     </video>
Aug 09 06:57:52 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:57:52 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:57:52 user nova-compute[72809]:     </rng>
Aug 09 06:57:52 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:57:52 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:57:52 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:57:52 user nova-compute[72809]:     </memballoon>
Aug 09 06:57:52 user nova-compute[72809]:   </devices>
Aug 09 06:57:52 user nova-compute[72809]: </domain>
Aug 09 06:57:52 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:57:52 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T06:53:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-83451525',display_name='tempest-ServerActionsTestOtherA-server-354299267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-83451525',id=16,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCouL5r1ONNNh4MEm1cE7q85fOqyiHXG74zUMePb7Qx7FM94grlflWjrtC3jQ2LeCgVBOqUmmFTQqcvNJ0pbLdMAdhZ4dM0vJEiMtEgevMXZ2oGhFPDEpbVyaR20DJopHw==',key_name='tempest-keypair-888098152',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:53:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6da97330281c4d0eba99e485db051973',ramdisk_id='',reservation_id='r-p0mtguey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-118844208',owner_user_name='tempest-ServerActionsTestOtherA-118844208-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:57:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10e067d2b5b7459cadf50b1ed89a8864',uuid=336770eb-4f09-4134-92ef-f96039bf4fa9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "address": "fa:16:3e:b9:56:8d", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac68313-9d", "ovs_interfaceid": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:57:52 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Converting VIF {"id": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "address": "fa:16:3e:b9:56:8d", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac68313-9d", "ovs_interfaceid": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:57:52 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:56:8d,bridge_name='br-int',has_traffic_filtering=True,id=8ac68313-9d94-449d-87e1-9fb135c7bab5,network=Network(0e68e18b-480a-4b6c-b194-39ba1099a4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac68313-9d') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:57:52 user nova-compute[72809]: DEBUG os_vif [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:56:8d,bridge_name='br-int',has_traffic_filtering=True,id=8ac68313-9d94-449d-87e1-9fb135c7bab5,network=Network(0e68e18b-480a-4b6c-b194-39ba1099a4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac68313-9d') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:57:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:57:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:57:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ac68313-9d, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:57:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8ac68313-9d, col_values=(('external_ids', {'iface-id': '8ac68313-9d94-449d-87e1-9fb135c7bab5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:56:8d', 'vm-uuid': '336770eb-4f09-4134-92ef-f96039bf4fa9'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:57:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:57:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:53 user nova-compute[72809]: INFO os_vif [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:56:8d,bridge_name='br-int',has_traffic_filtering=True,id=8ac68313-9d94-449d-87e1-9fb135c7bab5,network=Network(0e68e18b-480a-4b6c-b194-39ba1099a4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac68313-9d')
Aug 09 06:57:53 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:57:53 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:57:53 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] No VIF found with MAC fa:16:3e:b9:56:8d, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:57:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:54 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691564259.164594, 336770eb-4f09-4134-92ef-f96039bf4fa9 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:57:54 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] VM Stopped (Lifecycle Event)
Aug 09 06:57:54 user nova-compute[72809]: DEBUG nova.compute.manager [None req-f1758944-b31f-47d3-adcc-9464d0eefd01 None None] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:57:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:54 user nova-compute[72809]: DEBUG nova.compute.manager [req-cd2a6643-31eb-44ca-ab87-1b7c70b27f78 req-0f7b639f-7e42-44f9-805e-f18187f33d34 service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Received event network-vif-plugged-8ac68313-9d94-449d-87e1-9fb135c7bab5 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:57:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-cd2a6643-31eb-44ca-ab87-1b7c70b27f78 req-0f7b639f-7e42-44f9-805e-f18187f33d34 service nova] Acquiring lock "336770eb-4f09-4134-92ef-f96039bf4fa9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-cd2a6643-31eb-44ca-ab87-1b7c70b27f78 req-0f7b639f-7e42-44f9-805e-f18187f33d34 service nova] Lock "336770eb-4f09-4134-92ef-f96039bf4fa9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-cd2a6643-31eb-44ca-ab87-1b7c70b27f78 req-0f7b639f-7e42-44f9-805e-f18187f33d34 service nova] Lock "336770eb-4f09-4134-92ef-f96039bf4fa9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:54 user nova-compute[72809]: DEBUG nova.compute.manager [req-cd2a6643-31eb-44ca-ab87-1b7c70b27f78 req-0f7b639f-7e42-44f9-805e-f18187f33d34 service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] No waiting events found dispatching network-vif-plugged-8ac68313-9d94-449d-87e1-9fb135c7bab5 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:57:54 user nova-compute[72809]: WARNING nova.compute.manager [req-cd2a6643-31eb-44ca-ab87-1b7c70b27f78 req-0f7b639f-7e42-44f9-805e-f18187f33d34 service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Received unexpected event network-vif-plugged-8ac68313-9d94-449d-87e1-9fb135c7bab5 for instance with vm_state active and task_state rebuild_spawning.
Aug 09 06:57:55 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:55 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:55 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:56 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564276.6668205, 336770eb-4f09-4134-92ef-f96039bf4fa9 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:57:56 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] VM Resumed (Lifecycle Event)
Aug 09 06:57:56 user nova-compute[72809]: DEBUG nova.compute.manager [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:57:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 06:57:56 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Instance spawned successfully.
Aug 09 06:57:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 06:57:56 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:57:56 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:57:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:57:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:57:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:57:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:57:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:57:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:57:56 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 06:57:56 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564276.6711912, 336770eb-4f09-4134-92ef-f96039bf4fa9 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:57:56 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] VM Started (Lifecycle Event)
Aug 09 06:57:56 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:57:56 user nova-compute[72809]: DEBUG nova.compute.manager [req-637268f8-3067-45ff-b457-86d3d00a825e req-12b86d41-5e80-47e8-a377-50bcac4c7ca2 service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Received event network-vif-plugged-8ac68313-9d94-449d-87e1-9fb135c7bab5 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:57:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-637268f8-3067-45ff-b457-86d3d00a825e req-12b86d41-5e80-47e8-a377-50bcac4c7ca2 service nova] Acquiring lock "336770eb-4f09-4134-92ef-f96039bf4fa9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-637268f8-3067-45ff-b457-86d3d00a825e req-12b86d41-5e80-47e8-a377-50bcac4c7ca2 service nova] Lock "336770eb-4f09-4134-92ef-f96039bf4fa9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-637268f8-3067-45ff-b457-86d3d00a825e req-12b86d41-5e80-47e8-a377-50bcac4c7ca2 service nova] Lock "336770eb-4f09-4134-92ef-f96039bf4fa9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:56 user nova-compute[72809]: DEBUG nova.compute.manager [req-637268f8-3067-45ff-b457-86d3d00a825e req-12b86d41-5e80-47e8-a377-50bcac4c7ca2 service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] No waiting events found dispatching network-vif-plugged-8ac68313-9d94-449d-87e1-9fb135c7bab5 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:57:56 user nova-compute[72809]: WARNING nova.compute.manager [req-637268f8-3067-45ff-b457-86d3d00a825e req-12b86d41-5e80-47e8-a377-50bcac4c7ca2 service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Received unexpected event network-vif-plugged-8ac68313-9d94-449d-87e1-9fb135c7bab5 for instance with vm_state active and task_state rebuild_spawning.
Aug 09 06:57:56 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:57:56 user nova-compute[72809]: DEBUG nova.compute.manager [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:57:56 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 06:57:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:57:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:57:56 user nova-compute[72809]: DEBUG nova.objects.instance [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72809) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 06:57:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f80886d9-0383-487a-a8f0-a55276d30d1c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.077s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:57:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:57:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:07 user nova-compute[72809]: INFO nova.compute.manager [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Rescuing
Aug 09 06:58:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "refresh_cache-bebd5a14-6272-4de1-a1a1-4fb45b867c7f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:58:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquired lock "refresh_cache-bebd5a14-6272-4de1-a1a1-4fb45b867c7f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:58:07 user nova-compute[72809]: DEBUG nova.network.neutron [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:58:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:08 user nova-compute[72809]: DEBUG nova.network.neutron [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Updating instance_info_cache with network_info: [{"id": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "address": "fa:16:3e:95:65:6f", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c034fd-3a", "ovs_interfaceid": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:58:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Releasing lock "refresh_cache-bebd5a14-6272-4de1-a1a1-4fb45b867c7f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:58:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:08 user nova-compute[72809]: DEBUG nova.compute.manager [req-2955df17-d0fa-401d-83fd-492aa4fba0fa req-984fc359-7a37-442b-9771-4fabdf69b2ea service nova] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Received event network-vif-unplugged-f3c034fd-3aaa-4f55-a25a-e5370456135c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:58:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2955df17-d0fa-401d-83fd-492aa4fba0fa req-984fc359-7a37-442b-9771-4fabdf69b2ea service nova] Acquiring lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:58:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2955df17-d0fa-401d-83fd-492aa4fba0fa req-984fc359-7a37-442b-9771-4fabdf69b2ea service nova] Lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:58:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2955df17-d0fa-401d-83fd-492aa4fba0fa req-984fc359-7a37-442b-9771-4fabdf69b2ea service nova] Lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:58:08 user nova-compute[72809]: DEBUG nova.compute.manager [req-2955df17-d0fa-401d-83fd-492aa4fba0fa req-984fc359-7a37-442b-9771-4fabdf69b2ea service nova] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] No waiting events found dispatching network-vif-unplugged-f3c034fd-3aaa-4f55-a25a-e5370456135c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:58:08 user nova-compute[72809]: WARNING nova.compute.manager [req-2955df17-d0fa-401d-83fd-492aa4fba0fa req-984fc359-7a37-442b-9771-4fabdf69b2ea service nova] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Received unexpected event network-vif-unplugged-f3c034fd-3aaa-4f55-a25a-e5370456135c for instance with vm_state active and task_state rescuing.
Aug 09 06:58:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:08 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Instance destroyed successfully.
Aug 09 06:58:08 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Attempting rescue
Aug 09 06:58:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72809) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 06:58:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Instance directory exists: not creating {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 06:58:08 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Creating image(s)
Aug 09 06:58:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "/opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:58:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "/opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:58:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "/opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:58:08 user nova-compute[72809]: DEBUG nova.objects.instance [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lazy-loading 'trusted_certs' on Instance uuid bebd5a14-6272-4de1-a1a1-4fb45b867c7f {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:58:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:58:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:58:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:58:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.139s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:58:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:58:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue" returned: 0 in 0.054s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:58:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:58:09 user nova-compute[72809]: DEBUG nova.objects.instance [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lazy-loading 'migration_context' on Instance uuid bebd5a14-6272-4de1-a1a1-4fb45b867c7f {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:58:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 06:58:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Start _get_guest_xml network_info=[{"id": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "address": "fa:16:3e:95:65:6f", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "vif_mac": "fa:16:3e:95:65:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c034fd-3a", "ovs_interfaceid": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:58:09 user nova-compute[72809]: DEBUG nova.objects.instance [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lazy-loading 'resources' on Instance uuid bebd5a14-6272-4de1-a1a1-4fb45b867c7f {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:58:09 user nova-compute[72809]: DEBUG nova.objects.instance [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lazy-loading 'numa_topology' on Instance uuid bebd5a14-6272-4de1-a1a1-4fb45b867c7f {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:58:09 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:58:09 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:58:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:58:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:58:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:58:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:58:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:58:09 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:58:09 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:58:09 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:58:09 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:58:09 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:58:09 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:58:09 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:58:09 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:58:09 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:58:09 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:58:09 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:58:09 user nova-compute[72809]: DEBUG nova.objects.instance [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lazy-loading 'vcpu_model' on Instance uuid bebd5a14-6272-4de1-a1a1-4fb45b867c7f {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:58:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:56:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1180037582',display_name='tempest-ServerRescueNegativeTestJSON-server-1180037582',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1180037582',id=20,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:56:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e75b8536be334abba712e1c6f6886cdf',ramdisk_id='',reservation_id='r-6oy9lqdq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1153742012',owner_user_name='tempest-ServerRescueNegativeTestJSON-1153742012-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:56:25Z,user_data=None,user_id='740071d735364ce5b0e6a7bb0dbdffe3',uuid=bebd5a14-6272-4de1-a1a1-4fb45b867c7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "address": "fa:16:3e:95:65:6f", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "vif_mac": "fa:16:3e:95:65:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c034fd-3a", "ovs_interfaceid": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:58:09 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Converting VIF {"id": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "address": "fa:16:3e:95:65:6f", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "vif_mac": "fa:16:3e:95:65:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c034fd-3a", "ovs_interfaceid": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:58:09 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:65:6f,bridge_name='br-int',has_traffic_filtering=True,id=f3c034fd-3aaa-4f55-a25a-e5370456135c,network=Network(fb9ae39b-117a-4cca-8080-683f63e8a318),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3c034fd-3a') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:58:09 user nova-compute[72809]: DEBUG nova.objects.instance [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lazy-loading 'pci_devices' on Instance uuid bebd5a14-6272-4de1-a1a1-4fb45b867c7f {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:58:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:58:09 user nova-compute[72809]:   <uuid>bebd5a14-6272-4de1-a1a1-4fb45b867c7f</uuid>
Aug 09 06:58:09 user nova-compute[72809]:   <name>instance-00000014</name>
Aug 09 06:58:09 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:58:09 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:58:09 user nova-compute[72809]:   <metadata>
Aug 09 06:58:09 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:58:09 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:58:09 user nova-compute[72809]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1180037582</nova:name>
Aug 09 06:58:09 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:58:09</nova:creationTime>
Aug 09 06:58:09 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:58:09 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:58:09 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:58:09 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:58:09 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:58:09 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:58:09 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:58:09 user nova-compute[72809]:       <nova:owner>
Aug 09 06:58:09 user nova-compute[72809]:         <nova:user uuid="740071d735364ce5b0e6a7bb0dbdffe3">tempest-ServerRescueNegativeTestJSON-1153742012-project-member</nova:user>
Aug 09 06:58:09 user nova-compute[72809]:         <nova:project uuid="e75b8536be334abba712e1c6f6886cdf">tempest-ServerRescueNegativeTestJSON-1153742012</nova:project>
Aug 09 06:58:09 user nova-compute[72809]:       </nova:owner>
Aug 09 06:58:09 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:58:09 user nova-compute[72809]:       <nova:ports>
Aug 09 06:58:09 user nova-compute[72809]:         <nova:port uuid="f3c034fd-3aaa-4f55-a25a-e5370456135c">
Aug 09 06:58:09 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 06:58:09 user nova-compute[72809]:         </nova:port>
Aug 09 06:58:09 user nova-compute[72809]:       </nova:ports>
Aug 09 06:58:09 user nova-compute[72809]:     </nova:instance>
Aug 09 06:58:09 user nova-compute[72809]:   </metadata>
Aug 09 06:58:09 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:58:09 user nova-compute[72809]:     <system>
Aug 09 06:58:09 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:58:09 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:58:09 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:58:09 user nova-compute[72809]:       <entry name="serial">bebd5a14-6272-4de1-a1a1-4fb45b867c7f</entry>
Aug 09 06:58:09 user nova-compute[72809]:       <entry name="uuid">bebd5a14-6272-4de1-a1a1-4fb45b867c7f</entry>
Aug 09 06:58:09 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:58:09 user nova-compute[72809]:     </system>
Aug 09 06:58:09 user nova-compute[72809]:   </sysinfo>
Aug 09 06:58:09 user nova-compute[72809]:   <os>
Aug 09 06:58:09 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:58:09 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:58:09 user nova-compute[72809]:   </os>
Aug 09 06:58:09 user nova-compute[72809]:   <features>
Aug 09 06:58:09 user nova-compute[72809]:     <acpi/>
Aug 09 06:58:09 user nova-compute[72809]:     <apic/>
Aug 09 06:58:09 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:58:09 user nova-compute[72809]:   </features>
Aug 09 06:58:09 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:58:09 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:58:09 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:58:09 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:58:09 user nova-compute[72809]:   </clock>
Aug 09 06:58:09 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:58:09 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:58:09 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:58:09 user nova-compute[72809]:   </cpu>
Aug 09 06:58:09 user nova-compute[72809]:   <devices>
Aug 09 06:58:09 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:58:09 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:58:09 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue"/>
Aug 09 06:58:09 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:58:09 user nova-compute[72809]:     </disk>
Aug 09 06:58:09 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:58:09 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:58:09 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk"/>
Aug 09 06:58:09 user nova-compute[72809]:       <target dev="vdb" bus="virtio"/>
Aug 09 06:58:09 user nova-compute[72809]:     </disk>
Aug 09 06:58:09 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:58:09 user nova-compute[72809]:       <mac address="fa:16:3e:95:65:6f"/>
Aug 09 06:58:09 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:58:09 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:58:09 user nova-compute[72809]:       <target dev="tapf3c034fd-3a"/>
Aug 09 06:58:09 user nova-compute[72809]:     </interface>
Aug 09 06:58:09 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:58:09 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/console.log" append="off"/>
Aug 09 06:58:09 user nova-compute[72809]:     </serial>
Aug 09 06:58:09 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:58:09 user nova-compute[72809]:     <video>
Aug 09 06:58:09 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:58:09 user nova-compute[72809]:     </video>
Aug 09 06:58:09 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:58:09 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:58:09 user nova-compute[72809]:     </rng>
Aug 09 06:58:09 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:58:09 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:58:09 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:58:09 user nova-compute[72809]:     </memballoon>
Aug 09 06:58:09 user nova-compute[72809]:   </devices>
Aug 09 06:58:09 user nova-compute[72809]: </domain>
Aug 09 06:58:09 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:58:09 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Instance destroyed successfully.
Aug 09 06:58:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:58:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:58:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] No VIF found with MAC fa:16:3e:95:65:6f, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:58:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:10 user nova-compute[72809]: DEBUG nova.compute.manager [req-a7d83dd8-c837-46c5-b4ab-fc900bb0829a req-01da880d-2223-41ea-8a0e-cc8092eb90d8 service nova] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Received event network-vif-plugged-f3c034fd-3aaa-4f55-a25a-e5370456135c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:58:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a7d83dd8-c837-46c5-b4ab-fc900bb0829a req-01da880d-2223-41ea-8a0e-cc8092eb90d8 service nova] Acquiring lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:58:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a7d83dd8-c837-46c5-b4ab-fc900bb0829a req-01da880d-2223-41ea-8a0e-cc8092eb90d8 service nova] Lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:58:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a7d83dd8-c837-46c5-b4ab-fc900bb0829a req-01da880d-2223-41ea-8a0e-cc8092eb90d8 service nova] Lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:58:10 user nova-compute[72809]: DEBUG nova.compute.manager [req-a7d83dd8-c837-46c5-b4ab-fc900bb0829a req-01da880d-2223-41ea-8a0e-cc8092eb90d8 service nova] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] No waiting events found dispatching network-vif-plugged-f3c034fd-3aaa-4f55-a25a-e5370456135c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:58:10 user nova-compute[72809]: WARNING nova.compute.manager [req-a7d83dd8-c837-46c5-b4ab-fc900bb0829a req-01da880d-2223-41ea-8a0e-cc8092eb90d8 service nova] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Received unexpected event network-vif-plugged-f3c034fd-3aaa-4f55-a25a-e5370456135c for instance with vm_state active and task_state rescuing.
Aug 09 06:58:10 user nova-compute[72809]: DEBUG nova.compute.manager [req-a7d83dd8-c837-46c5-b4ab-fc900bb0829a req-01da880d-2223-41ea-8a0e-cc8092eb90d8 service nova] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Received event network-vif-plugged-f3c034fd-3aaa-4f55-a25a-e5370456135c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:58:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a7d83dd8-c837-46c5-b4ab-fc900bb0829a req-01da880d-2223-41ea-8a0e-cc8092eb90d8 service nova] Acquiring lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:58:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a7d83dd8-c837-46c5-b4ab-fc900bb0829a req-01da880d-2223-41ea-8a0e-cc8092eb90d8 service nova] Lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:58:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a7d83dd8-c837-46c5-b4ab-fc900bb0829a req-01da880d-2223-41ea-8a0e-cc8092eb90d8 service nova] Lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:58:10 user nova-compute[72809]: DEBUG nova.compute.manager [req-a7d83dd8-c837-46c5-b4ab-fc900bb0829a req-01da880d-2223-41ea-8a0e-cc8092eb90d8 service nova] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] No waiting events found dispatching network-vif-plugged-f3c034fd-3aaa-4f55-a25a-e5370456135c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:58:10 user nova-compute[72809]: WARNING nova.compute.manager [req-a7d83dd8-c837-46c5-b4ab-fc900bb0829a req-01da880d-2223-41ea-8a0e-cc8092eb90d8 service nova] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Received unexpected event network-vif-plugged-f3c034fd-3aaa-4f55-a25a-e5370456135c for instance with vm_state active and task_state rescuing.
Aug 09 06:58:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Removed pending event for bebd5a14-6272-4de1-a1a1-4fb45b867c7f due to event {{(pid=72809) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 06:58:12 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564292.7939856, bebd5a14-6272-4de1-a1a1-4fb45b867c7f => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:58:12 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] VM Resumed (Lifecycle Event)
Aug 09 06:58:12 user nova-compute[72809]: DEBUG nova.compute.manager [None req-db4c062c-1b4d-4e81-b9b1-3395c476bdc4 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:58:12 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:58:12 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:58:12 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 06:58:12 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564292.796216, bebd5a14-6272-4de1-a1a1-4fb45b867c7f => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:58:12 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] VM Started (Lifecycle Event)
Aug 09 06:58:12 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:58:12 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:58:12 user nova-compute[72809]: DEBUG nova.compute.manager [req-9ce1fb61-227f-4dc1-8912-a700a8a5fa13 req-f4edc15f-2280-4f26-b39f-931eec428352 service nova] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Received event network-vif-plugged-f3c034fd-3aaa-4f55-a25a-e5370456135c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:58:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9ce1fb61-227f-4dc1-8912-a700a8a5fa13 req-f4edc15f-2280-4f26-b39f-931eec428352 service nova] Acquiring lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:58:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9ce1fb61-227f-4dc1-8912-a700a8a5fa13 req-f4edc15f-2280-4f26-b39f-931eec428352 service nova] Lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:58:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9ce1fb61-227f-4dc1-8912-a700a8a5fa13 req-f4edc15f-2280-4f26-b39f-931eec428352 service nova] Lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:58:12 user nova-compute[72809]: DEBUG nova.compute.manager [req-9ce1fb61-227f-4dc1-8912-a700a8a5fa13 req-f4edc15f-2280-4f26-b39f-931eec428352 service nova] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] No waiting events found dispatching network-vif-plugged-f3c034fd-3aaa-4f55-a25a-e5370456135c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:58:12 user nova-compute[72809]: WARNING nova.compute.manager [req-9ce1fb61-227f-4dc1-8912-a700a8a5fa13 req-f4edc15f-2280-4f26-b39f-931eec428352 service nova] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Received unexpected event network-vif-plugged-f3c034fd-3aaa-4f55-a25a-e5370456135c for instance with vm_state rescued and task_state None.
Aug 09 06:58:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-40b88ad0-6935-423f-8d4d-167468dba1fc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:58:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-40b88ad0-6935-423f-8d4d-167468dba1fc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:58:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-40b88ad0-6935-423f-8d4d-167468dba1fc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:58:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-40b88ad0-6935-423f-8d4d-167468dba1fc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:58:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-40b88ad0-6935-423f-8d4d-167468dba1fc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:58:18 user nova-compute[72809]: INFO nova.compute.manager [None req-40b88ad0-6935-423f-8d4d-167468dba1fc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Terminating instance
Aug 09 06:58:18 user nova-compute[72809]: DEBUG nova.compute.manager [None req-40b88ad0-6935-423f-8d4d-167468dba1fc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 06:58:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:18 user nova-compute[72809]: DEBUG nova.compute.manager [req-538acac3-3237-468a-83b9-8ff80e39f030 req-da242c44-fce2-49ce-8da7-298761d28351 service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Received event network-vif-unplugged-f12bff80-425f-42ba-804d-540ad751f70c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:58:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-538acac3-3237-468a-83b9-8ff80e39f030 req-da242c44-fce2-49ce-8da7-298761d28351 service nova] Acquiring lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:58:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-538acac3-3237-468a-83b9-8ff80e39f030 req-da242c44-fce2-49ce-8da7-298761d28351 service nova] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:58:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-538acac3-3237-468a-83b9-8ff80e39f030 req-da242c44-fce2-49ce-8da7-298761d28351 service nova] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:58:18 user nova-compute[72809]: DEBUG nova.compute.manager [req-538acac3-3237-468a-83b9-8ff80e39f030 req-da242c44-fce2-49ce-8da7-298761d28351 service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] No waiting events found dispatching network-vif-unplugged-f12bff80-425f-42ba-804d-540ad751f70c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:58:18 user nova-compute[72809]: DEBUG nova.compute.manager [req-538acac3-3237-468a-83b9-8ff80e39f030 req-da242c44-fce2-49ce-8da7-298761d28351 service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Received event network-vif-unplugged-f12bff80-425f-42ba-804d-540ad751f70c for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 06:58:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:18 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Instance destroyed successfully.
Aug 09 06:58:18 user nova-compute[72809]: DEBUG nova.objects.instance [None req-40b88ad0-6935-423f-8d4d-167468dba1fc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lazy-loading 'resources' on Instance uuid 24ba9b41-d0bf-4a84-9f04-bfda9525b154 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:58:18 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-40b88ad0-6935-423f-8d4d-167468dba1fc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:48:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-450574580',display_name='tempest-AttachVolumeTestJSON-server-450574580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-450574580',id=2,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDJ0cgVVGdxmBusvy2LpBlTCELREPHX0PiRGBl4xUaShS+GxBoB6howy4sQdzJp5xGl40sCcx5e/0j2dhekoUvRjUbaKjJ/gVIKho4UvqK2B4IB5h/y1k8THmm8SIXqLw==',key_name='tempest-keypair-1151798744',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:48:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='55a7945f87914776a3f58bda58b7c90c',ramdisk_id='',reservation_id='r-0e3nfuh3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1328011883',owner_user_name='tempest-AttachVolumeTestJSON-1328011883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:56:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87785e8362a14385a951638f4d7cf817',uuid=24ba9b41-d0bf-4a84-9f04-bfda9525b154,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f12bff80-425f-42ba-804d-540ad751f70c", "address": "fa:16:3e:36:6c:27", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12bff80-42", "ovs_interfaceid": "f12bff80-425f-42ba-804d-540ad751f70c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:58:18 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-40b88ad0-6935-423f-8d4d-167468dba1fc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Converting VIF {"id": "f12bff80-425f-42ba-804d-540ad751f70c", "address": "fa:16:3e:36:6c:27", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12bff80-42", "ovs_interfaceid": "f12bff80-425f-42ba-804d-540ad751f70c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:58:18 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-40b88ad0-6935-423f-8d4d-167468dba1fc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:6c:27,bridge_name='br-int',has_traffic_filtering=True,id=f12bff80-425f-42ba-804d-540ad751f70c,network=Network(3430cb1f-9729-4613-bc8b-0fcdafd88198),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12bff80-42') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:58:18 user nova-compute[72809]: DEBUG os_vif [None req-40b88ad0-6935-423f-8d4d-167468dba1fc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:6c:27,bridge_name='br-int',has_traffic_filtering=True,id=f12bff80-425f-42ba-804d-540ad751f70c,network=Network(3430cb1f-9729-4613-bc8b-0fcdafd88198),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12bff80-42') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:58:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf12bff80-42, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:58:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:58:18 user nova-compute[72809]: INFO os_vif [None req-40b88ad0-6935-423f-8d4d-167468dba1fc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:6c:27,bridge_name='br-int',has_traffic_filtering=True,id=f12bff80-425f-42ba-804d-540ad751f70c,network=Network(3430cb1f-9729-4613-bc8b-0fcdafd88198),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12bff80-42')
Aug 09 06:58:18 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-40b88ad0-6935-423f-8d4d-167468dba1fc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Deleting instance files /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154_del
Aug 09 06:58:18 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-40b88ad0-6935-423f-8d4d-167468dba1fc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Deletion of /opt/stack/data/nova/instances/24ba9b41-d0bf-4a84-9f04-bfda9525b154_del complete
Aug 09 06:58:18 user nova-compute[72809]: INFO nova.compute.manager [None req-40b88ad0-6935-423f-8d4d-167468dba1fc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 09 06:58:18 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-40b88ad0-6935-423f-8d4d-167468dba1fc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 06:58:18 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 06:58:18 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 06:58:19 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:58:19 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Took 0.96 seconds to deallocate network for instance.
Aug 09 06:58:19 user nova-compute[72809]: DEBUG nova.compute.manager [req-a9c806df-1598-4fae-83d3-f50b34f64bdc req-397175b1-8451-4648-acf9-30d3da8915f3 service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Received event network-vif-deleted-f12bff80-425f-42ba-804d-540ad751f70c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:58:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-40b88ad0-6935-423f-8d4d-167468dba1fc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:58:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-40b88ad0-6935-423f-8d4d-167468dba1fc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:58:20 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-40b88ad0-6935-423f-8d4d-167468dba1fc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:58:20 user nova-compute[72809]: DEBUG nova.compute.manager [req-5901ff53-1e43-45ac-9981-781e83cca5b0 req-d1164c87-bfce-4200-92f1-a0f1f267b448 service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Received event network-vif-plugged-f12bff80-425f-42ba-804d-540ad751f70c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:58:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5901ff53-1e43-45ac-9981-781e83cca5b0 req-d1164c87-bfce-4200-92f1-a0f1f267b448 service nova] Acquiring lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:58:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5901ff53-1e43-45ac-9981-781e83cca5b0 req-d1164c87-bfce-4200-92f1-a0f1f267b448 service nova] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:58:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5901ff53-1e43-45ac-9981-781e83cca5b0 req-d1164c87-bfce-4200-92f1-a0f1f267b448 service nova] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:58:20 user nova-compute[72809]: DEBUG nova.compute.manager [req-5901ff53-1e43-45ac-9981-781e83cca5b0 req-d1164c87-bfce-4200-92f1-a0f1f267b448 service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] No waiting events found dispatching network-vif-plugged-f12bff80-425f-42ba-804d-540ad751f70c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:58:20 user nova-compute[72809]: WARNING nova.compute.manager [req-5901ff53-1e43-45ac-9981-781e83cca5b0 req-d1164c87-bfce-4200-92f1-a0f1f267b448 service nova] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Received unexpected event network-vif-plugged-f12bff80-425f-42ba-804d-540ad751f70c for instance with vm_state deleted and task_state None.
Aug 09 06:58:20 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-40b88ad0-6935-423f-8d4d-167468dba1fc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:58:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-40b88ad0-6935-423f-8d4d-167468dba1fc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:58:20 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-40b88ad0-6935-423f-8d4d-167468dba1fc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Deleted allocations for instance 24ba9b41-d0bf-4a84-9f04-bfda9525b154
Aug 09 06:58:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-40b88ad0-6935-423f-8d4d-167468dba1fc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "24ba9b41-d0bf-4a84-9f04-bfda9525b154" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.621s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:58:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-37ffe355-fbf7-4b2e-8141-b531f8f25aeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:58:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-37ffe355-fbf7-4b2e-8141-b531f8f25aeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:58:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-37ffe355-fbf7-4b2e-8141-b531f8f25aeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:58:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-37ffe355-fbf7-4b2e-8141-b531f8f25aeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:58:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-37ffe355-fbf7-4b2e-8141-b531f8f25aeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:58:30 user nova-compute[72809]: INFO nova.compute.manager [None req-37ffe355-fbf7-4b2e-8141-b531f8f25aeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Terminating instance
Aug 09 06:58:30 user nova-compute[72809]: DEBUG nova.compute.manager [None req-37ffe355-fbf7-4b2e-8141-b531f8f25aeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 06:58:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:30 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:58:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-f4b576bb-f842-43df-bc65-73be35f62bb8 req-659bd619-acbf-4414-8539-3199f9bbaa9c service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Received event network-vif-unplugged-b94aa917-6963-4aee-9bc2-15b2720191be {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:58:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f4b576bb-f842-43df-bc65-73be35f62bb8 req-659bd619-acbf-4414-8539-3199f9bbaa9c service nova] Acquiring lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:58:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f4b576bb-f842-43df-bc65-73be35f62bb8 req-659bd619-acbf-4414-8539-3199f9bbaa9c service nova] Lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:58:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f4b576bb-f842-43df-bc65-73be35f62bb8 req-659bd619-acbf-4414-8539-3199f9bbaa9c service nova] Lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:58:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-f4b576bb-f842-43df-bc65-73be35f62bb8 req-659bd619-acbf-4414-8539-3199f9bbaa9c service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] No waiting events found dispatching network-vif-unplugged-b94aa917-6963-4aee-9bc2-15b2720191be {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:58:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-f4b576bb-f842-43df-bc65-73be35f62bb8 req-659bd619-acbf-4414-8539-3199f9bbaa9c service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Received event network-vif-unplugged-b94aa917-6963-4aee-9bc2-15b2720191be for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 06:58:31 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Instance destroyed successfully.
Aug 09 06:58:31 user nova-compute[72809]: DEBUG nova.objects.instance [None req-37ffe355-fbf7-4b2e-8141-b531f8f25aeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lazy-loading 'resources' on Instance uuid aec0a7ee-69e1-41cf-bfa8-5733bdedd70a {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:58:31 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-37ffe355-fbf7-4b2e-8141-b531f8f25aeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T06:51:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-913717240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-913717240',id=12,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOO6sV+Qoal86qtcFU/3EObSR3TULxpC71/EBxvqmfNHUwrVBvM0F3kd7T3Glq1bk7tnZt3sMX+JOAHb7PEDhxWbR125C3wnEZH09gF2FMN71tfa4u3yaGKdWomhubcnMw==',key_name='tempest-keypair-38606939',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:56:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ec36de19d984ff3a150db4fdd8ce327',ramdisk_id='',reservation_id='r-3i0wy02j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1006961404',owner_user_name='tempest-AttachVolumeShelveTestJSON-1006961404-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:56:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e51e8a984c724efe966662c14b0dbffc',uuid=aec0a7ee-69e1-41cf-bfa8-5733bdedd70a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b94aa917-6963-4aee-9bc2-15b2720191be", "address": "fa:16:3e:5c:5d:c2", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb94aa917-69", "ovs_interfaceid": "b94aa917-6963-4aee-9bc2-15b2720191be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:58:31 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-37ffe355-fbf7-4b2e-8141-b531f8f25aeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Converting VIF {"id": "b94aa917-6963-4aee-9bc2-15b2720191be", "address": "fa:16:3e:5c:5d:c2", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb94aa917-69", "ovs_interfaceid": "b94aa917-6963-4aee-9bc2-15b2720191be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:58:31 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-37ffe355-fbf7-4b2e-8141-b531f8f25aeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:5d:c2,bridge_name='br-int',has_traffic_filtering=True,id=b94aa917-6963-4aee-9bc2-15b2720191be,network=Network(39277410-6754-4b40-b1bc-9777841910ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb94aa917-69') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:58:31 user nova-compute[72809]: DEBUG os_vif [None req-37ffe355-fbf7-4b2e-8141-b531f8f25aeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:5d:c2,bridge_name='br-int',has_traffic_filtering=True,id=b94aa917-6963-4aee-9bc2-15b2720191be,network=Network(39277410-6754-4b40-b1bc-9777841910ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb94aa917-69') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:58:31 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:31 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb94aa917-69, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:58:31 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:31 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:58:31 user nova-compute[72809]: INFO os_vif [None req-37ffe355-fbf7-4b2e-8141-b531f8f25aeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:5d:c2,bridge_name='br-int',has_traffic_filtering=True,id=b94aa917-6963-4aee-9bc2-15b2720191be,network=Network(39277410-6754-4b40-b1bc-9777841910ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb94aa917-69')
Aug 09 06:58:31 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-37ffe355-fbf7-4b2e-8141-b531f8f25aeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Deleting instance files /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a_del
Aug 09 06:58:31 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-37ffe355-fbf7-4b2e-8141-b531f8f25aeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Deletion of /opt/stack/data/nova/instances/aec0a7ee-69e1-41cf-bfa8-5733bdedd70a_del complete
Aug 09 06:58:31 user nova-compute[72809]: INFO nova.compute.manager [None req-37ffe355-fbf7-4b2e-8141-b531f8f25aeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 09 06:58:31 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-37ffe355-fbf7-4b2e-8141-b531f8f25aeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 06:58:31 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 06:58:31 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 06:58:31 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:58:31 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 06:58:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-5251cef4-9a49-4220-984e-75d1198f95b6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:58:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-5251cef4-9a49-4220-984e-75d1198f95b6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:58:31 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 06:58:32 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Updating instance_info_cache with network_info: [{"id": "0a2076a0-d9a0-4c09-9fcd-68011828f5e0", "address": "fa:16:3e:6d:d2:82", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2076a0-d9", "ovs_interfaceid": "0a2076a0-d9a0-4c09-9fcd-68011828f5e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:58:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-5251cef4-9a49-4220-984e-75d1198f95b6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:58:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 06:58:32 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:58:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:58:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:58:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:58:32 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 06:58:32 user nova-compute[72809]: DEBUG nova.compute.manager [req-d31b3d7c-666b-4d8c-b800-e1f5f1dd8994 req-34afa1d4-f49f-4f5d-b119-6e0bf125a3a6 service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Received event network-vif-plugged-b94aa917-6963-4aee-9bc2-15b2720191be {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:58:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d31b3d7c-666b-4d8c-b800-e1f5f1dd8994 req-34afa1d4-f49f-4f5d-b119-6e0bf125a3a6 service nova] Acquiring lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:58:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d31b3d7c-666b-4d8c-b800-e1f5f1dd8994 req-34afa1d4-f49f-4f5d-b119-6e0bf125a3a6 service nova] Lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:58:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d31b3d7c-666b-4d8c-b800-e1f5f1dd8994 req-34afa1d4-f49f-4f5d-b119-6e0bf125a3a6 service nova] Lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:58:32 user nova-compute[72809]: DEBUG nova.compute.manager [req-d31b3d7c-666b-4d8c-b800-e1f5f1dd8994 req-34afa1d4-f49f-4f5d-b119-6e0bf125a3a6 service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] No waiting events found dispatching network-vif-plugged-b94aa917-6963-4aee-9bc2-15b2720191be {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:58:32 user nova-compute[72809]: WARNING nova.compute.manager [req-d31b3d7c-666b-4d8c-b800-e1f5f1dd8994 req-34afa1d4-f49f-4f5d-b119-6e0bf125a3a6 service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Received unexpected event network-vif-plugged-b94aa917-6963-4aee-9bc2-15b2720191be for instance with vm_state active and task_state deleting.
Aug 09 06:58:32 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:58:32 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Took 1.61 seconds to deallocate network for instance.
Aug 09 06:58:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 06:58:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:58:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-37ffe355-fbf7-4b2e-8141-b531f8f25aeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:58:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-37ffe355-fbf7-4b2e-8141-b531f8f25aeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.005s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:58:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:58:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:58:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:58:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 06:58:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:58:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:33 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-37ffe355-fbf7-4b2e-8141-b531f8f25aeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:58:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:58:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:58:33 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-37ffe355-fbf7-4b2e-8141-b531f8f25aeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:58:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-37ffe355-fbf7-4b2e-8141-b531f8f25aeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.500s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:58:33 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-37ffe355-fbf7-4b2e-8141-b531f8f25aeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Deleted allocations for instance aec0a7ee-69e1-41cf-bfa8-5733bdedd70a
Aug 09 06:58:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:58:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:58:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-37ffe355-fbf7-4b2e-8141-b531f8f25aeb tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "aec0a7ee-69e1-41cf-bfa8-5733bdedd70a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.248s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:58:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:58:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:58:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:58:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:58:33 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691564298.8290455, 24ba9b41-d0bf-4a84-9f04-bfda9525b154 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:58:33 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] VM Stopped (Lifecycle Event)
Aug 09 06:58:33 user nova-compute[72809]: DEBUG nova.compute.manager [None req-12d65a76-a8a1-4e2e-8570-a6f18474cf87 None None] [instance: 24ba9b41-d0bf-4a84-9f04-bfda9525b154] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:58:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:58:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:58:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:58:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8e7fc37-b821-4ee9-9ec6-2b2254287d26/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:58:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8e7fc37-b821-4ee9-9ec6-2b2254287d26/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:58:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8e7fc37-b821-4ee9-9ec6-2b2254287d26/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:58:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8e7fc37-b821-4ee9-9ec6-2b2254287d26/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:58:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:58:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Acquiring lock "38319c37-9cc0-4e84-8415-ddcf37451daf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:58:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lock "38319c37-9cc0-4e84-8415-ddcf37451daf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:58:34 user nova-compute[72809]: DEBUG nova.compute.manager [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 06:58:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:58:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:58:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:58:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:58:34 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 06:58:34 user nova-compute[72809]: INFO nova.compute.claims [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Claim successful on node user
Aug 09 06:58:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:58:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:58:34 user nova-compute[72809]: DEBUG nova.compute.manager [req-1644fe6b-725a-41ab-8f62-361ec36b93a1 req-16f32af0-531f-45eb-b9f3-f6bc25faa83c service nova] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Received event network-vif-deleted-b94aa917-6963-4aee-9bc2-15b2720191be {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:58:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:58:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d210e25-aa29-40a5-ad99-27e54a51dd7a/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.527s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG nova.compute.manager [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d210e25-aa29-40a5-ad99-27e54a51dd7a/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d210e25-aa29-40a5-ad99-27e54a51dd7a/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG nova.compute.manager [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG nova.network.neutron [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 06:58:35 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 06:58:35 user nova-compute[72809]: DEBUG nova.compute.manager [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d210e25-aa29-40a5-ad99-27e54a51dd7a/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG nova.policy [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9dc41dc12f02418eba58bfce4128b26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb54b76021d41c3b047dcad448441d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG nova.compute.manager [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 06:58:35 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Creating image(s)
Aug 09 06:58:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Acquiring lock "/opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lock "/opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lock "/opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:58:35 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:58:35 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:58:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=7350MB free_disk=25.461139678955078GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.151s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 336770eb-4f09-4134-92ef-f96039bf4fa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 5251cef4-9a49-4220-984e-75d1198f95b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 1bde423f-0b73-448f-bdce-8d6af96d8fc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance bebd5a14-6272-4de1-a1a1-4fb45b867c7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 6d210e25-aa29-40a5-ad99-27e54a51dd7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 339372ed-140d-4226-ba00-2cc682214d5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 25943f41-2d28-4ffe-b38b-ae34a99426e1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance e8e7fc37-b821-4ee9-9ec6-2b2254287d26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 38319c37-9cc0-4e84-8415-ddcf37451daf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 06:58:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 06:58:36 user nova-compute[72809]: DEBUG nova.network.neutron [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Successfully created port: 1b035fe4-63e9-43eb-9cd1-c7daa830c393 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:58:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.146s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:58:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:58:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk 1073741824" returned: 0 in 0.052s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:58:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:58:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:58:36 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.149s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:58:36 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Checking if we can resize image /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 06:58:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:58:36 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:58:36 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:58:36 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 06:58:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.622s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:58:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:58:36 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Cannot resize image /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 06:58:36 user nova-compute[72809]: DEBUG nova.objects.instance [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lazy-loading 'migration_context' on Instance uuid 38319c37-9cc0-4e84-8415-ddcf37451daf {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:58:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 06:58:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Ensure instance console log exists: /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 06:58:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:58:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:58:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:58:36 user nova-compute[72809]: DEBUG nova.network.neutron [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Successfully updated port: 1b035fe4-63e9-43eb-9cd1-c7daa830c393 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:58:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Acquiring lock "refresh_cache-38319c37-9cc0-4e84-8415-ddcf37451daf" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:58:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Acquired lock "refresh_cache-38319c37-9cc0-4e84-8415-ddcf37451daf" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:58:36 user nova-compute[72809]: DEBUG nova.network.neutron [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:58:36 user nova-compute[72809]: DEBUG nova.compute.manager [req-79ec791f-6a7f-4551-b5fb-f440ebd7bb88 req-ee858cdb-94d9-4135-b747-f97c0d739613 service nova] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Received event network-changed-1b035fe4-63e9-43eb-9cd1-c7daa830c393 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:58:36 user nova-compute[72809]: DEBUG nova.compute.manager [req-79ec791f-6a7f-4551-b5fb-f440ebd7bb88 req-ee858cdb-94d9-4135-b747-f97c0d739613 service nova] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Refreshing instance network info cache due to event network-changed-1b035fe4-63e9-43eb-9cd1-c7daa830c393. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:58:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-79ec791f-6a7f-4551-b5fb-f440ebd7bb88 req-ee858cdb-94d9-4135-b747-f97c0d739613 service nova] Acquiring lock "refresh_cache-38319c37-9cc0-4e84-8415-ddcf37451daf" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:58:36 user nova-compute[72809]: DEBUG nova.network.neutron [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG nova.network.neutron [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Updating instance_info_cache with network_info: [{"id": "1b035fe4-63e9-43eb-9cd1-c7daa830c393", "address": "fa:16:3e:6f:5e:56", "network": {"id": "957d253a-5f0b-4a0d-89e0-5a4ee590929b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1432478722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb54b76021d41c3b047dcad448441d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b035fe4-63", "ovs_interfaceid": "1b035fe4-63e9-43eb-9cd1-c7daa830c393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Releasing lock "refresh_cache-38319c37-9cc0-4e84-8415-ddcf37451daf" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG nova.compute.manager [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Instance network_info: |[{"id": "1b035fe4-63e9-43eb-9cd1-c7daa830c393", "address": "fa:16:3e:6f:5e:56", "network": {"id": "957d253a-5f0b-4a0d-89e0-5a4ee590929b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1432478722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb54b76021d41c3b047dcad448441d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b035fe4-63", "ovs_interfaceid": "1b035fe4-63e9-43eb-9cd1-c7daa830c393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-79ec791f-6a7f-4551-b5fb-f440ebd7bb88 req-ee858cdb-94d9-4135-b747-f97c0d739613 service nova] Acquired lock "refresh_cache-38319c37-9cc0-4e84-8415-ddcf37451daf" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG nova.network.neutron [req-79ec791f-6a7f-4551-b5fb-f440ebd7bb88 req-ee858cdb-94d9-4135-b747-f97c0d739613 service nova] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Refreshing network info cache for port 1b035fe4-63e9-43eb-9cd1-c7daa830c393 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Start _get_guest_xml network_info=[{"id": "1b035fe4-63e9-43eb-9cd1-c7daa830c393", "address": "fa:16:3e:6f:5e:56", "network": {"id": "957d253a-5f0b-4a0d-89e0-5a4ee590929b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1432478722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb54b76021d41c3b047dcad448441d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b035fe4-63", "ovs_interfaceid": "1b035fe4-63e9-43eb-9cd1-c7daa830c393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:58:37 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:58:37 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:58:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:58:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-626121031',display_name='tempest-ServersNegativeTestJSON-server-626121031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-626121031',id=25,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='adb54b76021d41c3b047dcad448441d0',ramdisk_id='',reservation_id='r-k69wf00n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-169525689',owner_user_name='tempest-ServersNegativeTestJSON-169525689-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:58:35Z,user_data=None,user_id='9dc41dc12f02418eba58bfce4128b26d',uuid=38319c37-9cc0-4e84-8415-ddcf37451daf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b035fe4-63e9-43eb-9cd1-c7daa830c393", "address": "fa:16:3e:6f:5e:56", "network": {"id": "957d253a-5f0b-4a0d-89e0-5a4ee590929b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1432478722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb54b76021d41c3b047dcad448441d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b035fe4-63", "ovs_interfaceid": "1b035fe4-63e9-43eb-9cd1-c7daa830c393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Converting VIF {"id": "1b035fe4-63e9-43eb-9cd1-c7daa830c393", "address": "fa:16:3e:6f:5e:56", "network": {"id": "957d253a-5f0b-4a0d-89e0-5a4ee590929b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1432478722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb54b76021d41c3b047dcad448441d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b035fe4-63", "ovs_interfaceid": "1b035fe4-63e9-43eb-9cd1-c7daa830c393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:5e:56,bridge_name='br-int',has_traffic_filtering=True,id=1b035fe4-63e9-43eb-9cd1-c7daa830c393,network=Network(957d253a-5f0b-4a0d-89e0-5a4ee590929b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b035fe4-63') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG nova.objects.instance [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lazy-loading 'pci_devices' on Instance uuid 38319c37-9cc0-4e84-8415-ddcf37451daf {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:58:37 user nova-compute[72809]:   <uuid>38319c37-9cc0-4e84-8415-ddcf37451daf</uuid>
Aug 09 06:58:37 user nova-compute[72809]:   <name>instance-00000019</name>
Aug 09 06:58:37 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:58:37 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:58:37 user nova-compute[72809]:   <metadata>
Aug 09 06:58:37 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:58:37 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:58:37 user nova-compute[72809]:       <nova:name>tempest-ServersNegativeTestJSON-server-626121031</nova:name>
Aug 09 06:58:37 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:58:37</nova:creationTime>
Aug 09 06:58:37 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:58:37 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:58:37 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:58:37 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:58:37 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:58:37 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:58:37 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:58:37 user nova-compute[72809]:       <nova:owner>
Aug 09 06:58:37 user nova-compute[72809]:         <nova:user uuid="9dc41dc12f02418eba58bfce4128b26d">tempest-ServersNegativeTestJSON-169525689-project-member</nova:user>
Aug 09 06:58:37 user nova-compute[72809]:         <nova:project uuid="adb54b76021d41c3b047dcad448441d0">tempest-ServersNegativeTestJSON-169525689</nova:project>
Aug 09 06:58:37 user nova-compute[72809]:       </nova:owner>
Aug 09 06:58:37 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:58:37 user nova-compute[72809]:       <nova:ports>
Aug 09 06:58:37 user nova-compute[72809]:         <nova:port uuid="1b035fe4-63e9-43eb-9cd1-c7daa830c393">
Aug 09 06:58:37 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 06:58:37 user nova-compute[72809]:         </nova:port>
Aug 09 06:58:37 user nova-compute[72809]:       </nova:ports>
Aug 09 06:58:37 user nova-compute[72809]:     </nova:instance>
Aug 09 06:58:37 user nova-compute[72809]:   </metadata>
Aug 09 06:58:37 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:58:37 user nova-compute[72809]:     <system>
Aug 09 06:58:37 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:58:37 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:58:37 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:58:37 user nova-compute[72809]:       <entry name="serial">38319c37-9cc0-4e84-8415-ddcf37451daf</entry>
Aug 09 06:58:37 user nova-compute[72809]:       <entry name="uuid">38319c37-9cc0-4e84-8415-ddcf37451daf</entry>
Aug 09 06:58:37 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:58:37 user nova-compute[72809]:     </system>
Aug 09 06:58:37 user nova-compute[72809]:   </sysinfo>
Aug 09 06:58:37 user nova-compute[72809]:   <os>
Aug 09 06:58:37 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:58:37 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 06:58:37 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:58:37 user nova-compute[72809]:   </os>
Aug 09 06:58:37 user nova-compute[72809]:   <features>
Aug 09 06:58:37 user nova-compute[72809]:     <acpi/>
Aug 09 06:58:37 user nova-compute[72809]:     <apic/>
Aug 09 06:58:37 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:58:37 user nova-compute[72809]:   </features>
Aug 09 06:58:37 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:58:37 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:58:37 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:58:37 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:58:37 user nova-compute[72809]:   </clock>
Aug 09 06:58:37 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:58:37 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:58:37 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:58:37 user nova-compute[72809]:   </cpu>
Aug 09 06:58:37 user nova-compute[72809]:   <devices>
Aug 09 06:58:37 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:58:37 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:58:37 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk"/>
Aug 09 06:58:37 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:58:37 user nova-compute[72809]:     </disk>
Aug 09 06:58:37 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:58:37 user nova-compute[72809]:       <mac address="fa:16:3e:6f:5e:56"/>
Aug 09 06:58:37 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:58:37 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:58:37 user nova-compute[72809]:       <target dev="tap1b035fe4-63"/>
Aug 09 06:58:37 user nova-compute[72809]:     </interface>
Aug 09 06:58:37 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:58:37 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/console.log" append="off"/>
Aug 09 06:58:37 user nova-compute[72809]:     </serial>
Aug 09 06:58:37 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:58:37 user nova-compute[72809]:     <video>
Aug 09 06:58:37 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:58:37 user nova-compute[72809]:     </video>
Aug 09 06:58:37 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:58:37 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:58:37 user nova-compute[72809]:     </rng>
Aug 09 06:58:37 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:58:37 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:58:37 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:58:37 user nova-compute[72809]:     </memballoon>
Aug 09 06:58:37 user nova-compute[72809]:   </devices>
Aug 09 06:58:37 user nova-compute[72809]: </domain>
Aug 09 06:58:37 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:58:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-626121031',display_name='tempest-ServersNegativeTestJSON-server-626121031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-626121031',id=25,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='adb54b76021d41c3b047dcad448441d0',ramdisk_id='',reservation_id='r-k69wf00n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-169525689',owner_user_name='tempest-ServersNegativeTestJSON-169525689-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:58:35Z,user_data=None,user_id='9dc41dc12f02418eba58bfce4128b26d',uuid=38319c37-9cc0-4e84-8415-ddcf37451daf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b035fe4-63e9-43eb-9cd1-c7daa830c393", "address": "fa:16:3e:6f:5e:56", "network": {"id": "957d253a-5f0b-4a0d-89e0-5a4ee590929b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1432478722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb54b76021d41c3b047dcad448441d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b035fe4-63", "ovs_interfaceid": "1b035fe4-63e9-43eb-9cd1-c7daa830c393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Converting VIF {"id": "1b035fe4-63e9-43eb-9cd1-c7daa830c393", "address": "fa:16:3e:6f:5e:56", "network": {"id": "957d253a-5f0b-4a0d-89e0-5a4ee590929b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1432478722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb54b76021d41c3b047dcad448441d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b035fe4-63", "ovs_interfaceid": "1b035fe4-63e9-43eb-9cd1-c7daa830c393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:5e:56,bridge_name='br-int',has_traffic_filtering=True,id=1b035fe4-63e9-43eb-9cd1-c7daa830c393,network=Network(957d253a-5f0b-4a0d-89e0-5a4ee590929b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b035fe4-63') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG os_vif [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:5e:56,bridge_name='br-int',has_traffic_filtering=True,id=1b035fe4-63e9-43eb-9cd1-c7daa830c393,network=Network(957d253a-5f0b-4a0d-89e0-5a4ee590929b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b035fe4-63') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b035fe4-63, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1b035fe4-63, col_values=(('external_ids', {'iface-id': '1b035fe4-63e9-43eb-9cd1-c7daa830c393', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:5e:56', 'vm-uuid': '38319c37-9cc0-4e84-8415-ddcf37451daf'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:37 user nova-compute[72809]: INFO os_vif [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:5e:56,bridge_name='br-int',has_traffic_filtering=True,id=1b035fe4-63e9-43eb-9cd1-c7daa830c393,network=Network(957d253a-5f0b-4a0d-89e0-5a4ee590929b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b035fe4-63')
Aug 09 06:58:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] No VIF found with MAC fa:16:3e:6f:5e:56, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG nova.network.neutron [req-79ec791f-6a7f-4551-b5fb-f440ebd7bb88 req-ee858cdb-94d9-4135-b747-f97c0d739613 service nova] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Updated VIF entry in instance network info cache for port 1b035fe4-63e9-43eb-9cd1-c7daa830c393. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG nova.network.neutron [req-79ec791f-6a7f-4551-b5fb-f440ebd7bb88 req-ee858cdb-94d9-4135-b747-f97c0d739613 service nova] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Updating instance_info_cache with network_info: [{"id": "1b035fe4-63e9-43eb-9cd1-c7daa830c393", "address": "fa:16:3e:6f:5e:56", "network": {"id": "957d253a-5f0b-4a0d-89e0-5a4ee590929b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1432478722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb54b76021d41c3b047dcad448441d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b035fe4-63", "ovs_interfaceid": "1b035fe4-63e9-43eb-9cd1-c7daa830c393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:58:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-79ec791f-6a7f-4551-b5fb-f440ebd7bb88 req-ee858cdb-94d9-4135-b747-f97c0d739613 service nova] Releasing lock "refresh_cache-38319c37-9cc0-4e84-8415-ddcf37451daf" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:58:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:38 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:58:38 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:58:38 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:58:38 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:58:38 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 06:58:38 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:58:38 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:58:38 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:58:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:39 user nova-compute[72809]: DEBUG nova.compute.manager [req-779f5f3a-944a-48ac-8d52-40bd4d5629d2 req-28a84df7-fbd4-46fa-aff2-b0e782f1a077 service nova] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Received event network-vif-plugged-1b035fe4-63e9-43eb-9cd1-c7daa830c393 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:58:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-779f5f3a-944a-48ac-8d52-40bd4d5629d2 req-28a84df7-fbd4-46fa-aff2-b0e782f1a077 service nova] Acquiring lock "38319c37-9cc0-4e84-8415-ddcf37451daf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:58:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-779f5f3a-944a-48ac-8d52-40bd4d5629d2 req-28a84df7-fbd4-46fa-aff2-b0e782f1a077 service nova] Lock "38319c37-9cc0-4e84-8415-ddcf37451daf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:58:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-779f5f3a-944a-48ac-8d52-40bd4d5629d2 req-28a84df7-fbd4-46fa-aff2-b0e782f1a077 service nova] Lock "38319c37-9cc0-4e84-8415-ddcf37451daf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:58:39 user nova-compute[72809]: DEBUG nova.compute.manager [req-779f5f3a-944a-48ac-8d52-40bd4d5629d2 req-28a84df7-fbd4-46fa-aff2-b0e782f1a077 service nova] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] No waiting events found dispatching network-vif-plugged-1b035fe4-63e9-43eb-9cd1-c7daa830c393 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:58:39 user nova-compute[72809]: WARNING nova.compute.manager [req-779f5f3a-944a-48ac-8d52-40bd4d5629d2 req-28a84df7-fbd4-46fa-aff2-b0e782f1a077 service nova] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Received unexpected event network-vif-plugged-1b035fe4-63e9-43eb-9cd1-c7daa830c393 for instance with vm_state building and task_state spawning.
Aug 09 06:58:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:41 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564321.1202066, 38319c37-9cc0-4e84-8415-ddcf37451daf => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:58:41 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] VM Resumed (Lifecycle Event)
Aug 09 06:58:41 user nova-compute[72809]: DEBUG nova.compute.manager [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:58:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 06:58:41 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Instance spawned successfully.
Aug 09 06:58:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 06:58:41 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:58:41 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:58:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:58:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:58:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:58:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:58:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:58:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:58:41 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:58:41 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564321.121614, 38319c37-9cc0-4e84-8415-ddcf37451daf => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:58:41 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] VM Started (Lifecycle Event)
Aug 09 06:58:41 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:58:41 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:58:41 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:58:41 user nova-compute[72809]: INFO nova.compute.manager [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Took 5.45 seconds to spawn the instance on the hypervisor.
Aug 09 06:58:41 user nova-compute[72809]: DEBUG nova.compute.manager [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:58:41 user nova-compute[72809]: INFO nova.compute.manager [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Took 6.68 seconds to build instance.
Aug 09 06:58:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-774e4838-cb97-426b-b36e-41be829e5480 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lock "38319c37-9cc0-4e84-8415-ddcf37451daf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.804s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:58:41 user nova-compute[72809]: DEBUG nova.compute.manager [req-38229a95-0a5e-4982-9089-bd1d9e323b75 req-fe1b3307-4ae3-4aeb-a663-974371378cd7 service nova] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Received event network-vif-plugged-1b035fe4-63e9-43eb-9cd1-c7daa830c393 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:58:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-38229a95-0a5e-4982-9089-bd1d9e323b75 req-fe1b3307-4ae3-4aeb-a663-974371378cd7 service nova] Acquiring lock "38319c37-9cc0-4e84-8415-ddcf37451daf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:58:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-38229a95-0a5e-4982-9089-bd1d9e323b75 req-fe1b3307-4ae3-4aeb-a663-974371378cd7 service nova] Lock "38319c37-9cc0-4e84-8415-ddcf37451daf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:58:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-38229a95-0a5e-4982-9089-bd1d9e323b75 req-fe1b3307-4ae3-4aeb-a663-974371378cd7 service nova] Lock "38319c37-9cc0-4e84-8415-ddcf37451daf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:58:41 user nova-compute[72809]: DEBUG nova.compute.manager [req-38229a95-0a5e-4982-9089-bd1d9e323b75 req-fe1b3307-4ae3-4aeb-a663-974371378cd7 service nova] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] No waiting events found dispatching network-vif-plugged-1b035fe4-63e9-43eb-9cd1-c7daa830c393 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:58:41 user nova-compute[72809]: WARNING nova.compute.manager [req-38229a95-0a5e-4982-9089-bd1d9e323b75 req-fe1b3307-4ae3-4aeb-a663-974371378cd7 service nova] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Received unexpected event network-vif-plugged-1b035fe4-63e9-43eb-9cd1-c7daa830c393 for instance with vm_state active and task_state None.
Aug 09 06:58:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:43 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:46 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691564311.168519, aec0a7ee-69e1-41cf-bfa8-5733bdedd70a => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:58:46 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] VM Stopped (Lifecycle Event)
Aug 09 06:58:46 user nova-compute[72809]: DEBUG nova.compute.manager [None req-3b2a4ba7-573c-4321-9e8c-731b371d5e45 None None] [instance: aec0a7ee-69e1-41cf-bfa8-5733bdedd70a] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:58:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:50 user nova-compute[72809]: DEBUG nova.compute.manager [req-64621621-e1dc-4a78-a069-1ba20c4fee17 req-67560906-1553-4b41-bb6f-e171682fe261 service nova] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Received event network-changed-245f99b8-570d-4077-b3ca-f05f03b309f2 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:58:50 user nova-compute[72809]: DEBUG nova.compute.manager [req-64621621-e1dc-4a78-a069-1ba20c4fee17 req-67560906-1553-4b41-bb6f-e171682fe261 service nova] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Refreshing instance network info cache due to event network-changed-245f99b8-570d-4077-b3ca-f05f03b309f2. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:58:50 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-64621621-e1dc-4a78-a069-1ba20c4fee17 req-67560906-1553-4b41-bb6f-e171682fe261 service nova] Acquiring lock "refresh_cache-6d210e25-aa29-40a5-ad99-27e54a51dd7a" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:58:50 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-64621621-e1dc-4a78-a069-1ba20c4fee17 req-67560906-1553-4b41-bb6f-e171682fe261 service nova] Acquired lock "refresh_cache-6d210e25-aa29-40a5-ad99-27e54a51dd7a" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:58:50 user nova-compute[72809]: DEBUG nova.network.neutron [req-64621621-e1dc-4a78-a069-1ba20c4fee17 req-67560906-1553-4b41-bb6f-e171682fe261 service nova] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Refreshing network info cache for port 245f99b8-570d-4077-b3ca-f05f03b309f2 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:58:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquiring lock "6d210e25-aa29-40a5-ad99-27e54a51dd7a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:58:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "6d210e25-aa29-40a5-ad99-27e54a51dd7a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:58:51 user nova-compute[72809]: DEBUG nova.objects.instance [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lazy-loading 'flavor' on Instance uuid 6d210e25-aa29-40a5-ad99-27e54a51dd7a {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:58:51 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Ignoring supplied device name: /dev/vdb
Aug 09 06:58:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "6d210e25-aa29-40a5-ad99-27e54a51dd7a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:58:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquiring lock "6d210e25-aa29-40a5-ad99-27e54a51dd7a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:58:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "6d210e25-aa29-40a5-ad99-27e54a51dd7a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:58:51 user nova-compute[72809]: INFO nova.compute.manager [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Attaching volume be0a75df-172a-4e65-8eeb-1785aa48c088 to /dev/vdb
Aug 09 06:58:51 user nova-compute[72809]: DEBUG os_brick.utils [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:58:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:58:51 user nova-compute[72809]: DEBUG nova.network.neutron [req-64621621-e1dc-4a78-a069-1ba20c4fee17 req-67560906-1553-4b41-bb6f-e171682fe261 service nova] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Updated VIF entry in instance network info cache for port 245f99b8-570d-4077-b3ca-f05f03b309f2. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:58:51 user nova-compute[72809]: DEBUG nova.network.neutron [req-64621621-e1dc-4a78-a069-1ba20c4fee17 req-67560906-1553-4b41-bb6f-e171682fe261 service nova] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Updating instance_info_cache with network_info: [{"id": "245f99b8-570d-4077-b3ca-f05f03b309f2", "address": "fa:16:3e:53:81:3e", "network": {"id": "ae760578-06b0-479a-9f75-b5e781b1a087", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-541750148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76e442312164689bdd7686973d25eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245f99b8-57", "ovs_interfaceid": "245f99b8-570d-4077-b3ca-f05f03b309f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:58:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:58:51 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ac278a-1df6-4237-8ad2-a2328e778b3d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:58:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:58:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-64621621-e1dc-4a78-a069-1ba20c4fee17 req-67560906-1553-4b41-bb6f-e171682fe261 service nova] Releasing lock "refresh_cache-6d210e25-aa29-40a5-ad99-27e54a51dd7a" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:58:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:58:51 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a74224a-7128-4843-865d-ffd971029eda]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:58:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:58:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:58:51 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3decbe9b-fc93-413c-8871-5ad47d89546d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:58:51 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[523f1d30-d344-4aaf-ba44-d08b5d207e17]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:58:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:58:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:58:51 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 06:58:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:58:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:58:51 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 06:58:51 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[034ab10f-d1cf-496f-9b0a-6b2626f2acae]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:58:51 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 06:58:51 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 06:58:51 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 06:58:51 user nova-compute[72809]: DEBUG os_brick.utils [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:58:51 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Updating existing volume attachment record: 6075ac8e-7f87-4b40-a96b-d8c884a234b5 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 06:58:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:58:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iUnMqhej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:59:07 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:59:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:59:07 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 06:59:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:59:07 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 06:59:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7d221c-e193-4f85-9f70-889bc0a4a1b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 06:59:07 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[841d4c09-712a-432b-a7e6-10948a6a6f31]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088] added
Aug 09 06:59:07 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[06691120-b9dc-4ba9-972b-4de37c1b747d]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab52925d-0fc4-41ec-9df0-e2a32a56b9b7]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iUnMqhej {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iUnMqhej" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2db811-bf7c-4b44-853f-5181d9707d0f]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iUnMqhej'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efe9db1-d410-4410-9e87-dfb609978e53]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e4f8cf-2b0c-4650-86bc-9a0ab0e8f7fb]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 06:59:07 user nova-compute[72809]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 06:59:07 user nova-compute[72809]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)
Aug 09 06:59:07 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 06:59:07 user nova-compute[72809]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 06:59:07 user nova-compute[72809]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)
Aug 09 06:59:07 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5958ccba-e195-4d7c-b39e-26e850eaee45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088, portal: 172.16.0.220,3260]
Aug 09 06:59:07 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088, portal: 172.16.0.220,3260] successful.
Aug 09 06:59:07 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aab042b-3b8d-4879-9468-8759b120da40]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6414781e-47d5-491b-8ad0-46dd3cffd483]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 06:59:07 user nova-compute[72809]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 06:59:07 user nova-compute[72809]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)
Aug 09 06:59:07 user nova-compute[72809]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 (non-flash)
Aug 09 06:59:07 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 06:59:07 user nova-compute[72809]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 06:59:07 user nova-compute[72809]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)
Aug 09 06:59:07 user nova-compute[72809]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 (non-flash)
Aug 09 06:59:07 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 06:59:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4a4454-abe5-44b3-acbe-187976d4b4eb]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:59:08 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: None {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 06:59:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:09 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 06:59:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iUnMqhej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 06:59:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:59:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23332646633303063', 'path': '/dev/sdd'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:59:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332646633303063', 'path': '/dev/sdd'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 06:59:09 user nova-compute[72809]: DEBUG nova.objects.instance [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lazy-loading 'flavor' on Instance uuid 6d210e25-aa29-40a5-ad99-27e54a51dd7a {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:59:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 06:59:09 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 06:59:09 user nova-compute[72809]:   <source dev="/dev/sdd"/>
Aug 09 06:59:09 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 06:59:09 user nova-compute[72809]:   <serial>be0a75df-172a-4e65-8eeb-1785aa48c088</serial>
Aug 09 06:59:09 user nova-compute[72809]: </disk>
Aug 09 06:59:09 user nova-compute[72809]:  {{(pid=72809) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 06:59:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:59:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:59:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] No VIF found with MAC fa:16:3e:53:81:3e, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:59:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d5dc8046-e688-48a2-aa29-fc224b5b992b tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "6d210e25-aa29-40a5-ad99-27e54a51dd7a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.422s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:59:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "07a5297e-4f60-4213-bcdb-cf6b4d987681" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:59:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "07a5297e-4f60-4213-bcdb-cf6b4d987681" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:59:12 user nova-compute[72809]: DEBUG nova.compute.manager [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 06:59:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:59:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:59:12 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 06:59:12 user nova-compute[72809]: INFO nova.compute.claims [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Claim successful on node user
Aug 09 06:59:12 user nova-compute[72809]: DEBUG nova.compute.manager [None req-f67cf887-ada0-4867-82bb-40e1f2b9c508 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:59:12 user nova-compute[72809]: INFO nova.compute.manager [None req-f67cf887-ada0-4867-82bb-40e1f2b9c508 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] instance snapshotting
Aug 09 06:59:12 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-f67cf887-ada0-4867-82bb-40e1f2b9c508 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Beginning live snapshot process
Aug 09 06:59:12 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:59:12 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:59:12 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f67cf887-ada0-4867-82bb-40e1f2b9c508 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json -f qcow2 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:59:12 user nova-compute[72809]: DEBUG nova.compute.manager [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG nova.compute.manager [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG nova.network.neutron [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 06:59:13 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 06:59:13 user nova-compute[72809]: DEBUG nova.compute.manager [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f67cf887-ada0-4867-82bb-40e1f2b9c508 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json -f qcow2" returned: 0 in 0.151s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f67cf887-ada0-4867-82bb-40e1f2b9c508 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json -f qcow2 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG nova.policy [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '87785e8362a14385a951638f4d7cf817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a7945f87914776a3f58bda58b7c90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG nova.compute.manager [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 06:59:13 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Creating image(s)
Aug 09 06:59:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "/opt/stack/data/nova/instances/07a5297e-4f60-4213-bcdb-cf6b4d987681/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "/opt/stack/data/nova/instances/07a5297e-4f60-4213-bcdb-cf6b4d987681/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "/opt/stack/data/nova/instances/07a5297e-4f60-4213-bcdb-cf6b4d987681/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f67cf887-ada0-4867-82bb-40e1f2b9c508 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json -f qcow2" returned: 0 in 0.165s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f67cf887-ada0-4867-82bb-40e1f2b9c508 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.148s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f67cf887-ada0-4867-82bb-40e1f2b9c508 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.163s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f67cf887-ada0-4867-82bb-40e1f2b9c508 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgkle87sf/bc353dcca2224d0aad009a9a83e6d164.delta 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f67cf887-ada0-4867-82bb-40e1f2b9c508 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgkle87sf/bc353dcca2224d0aad009a9a83e6d164.delta 1073741824" returned: 0 in 0.055s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:13 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-f67cf887-ada0-4867-82bb-40e1f2b9c508 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 06:59:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.165s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/07a5297e-4f60-4213-bcdb-cf6b4d987681/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/07a5297e-4f60-4213-bcdb-cf6b4d987681/disk 1073741824" returned: 0 in 0.049s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.132s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Checking if we can resize image /opt/stack/data/nova/instances/07a5297e-4f60-4213-bcdb-cf6b4d987681/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07a5297e-4f60-4213-bcdb-cf6b4d987681/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG nova.network.neutron [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Successfully created port: a3360ec8-df18-4a48-8005-d42ce8fac8a9 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07a5297e-4f60-4213-bcdb-cf6b4d987681/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Cannot resize image /opt/stack/data/nova/instances/07a5297e-4f60-4213-bcdb-cf6b4d987681/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG nova.objects.instance [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lazy-loading 'migration_context' on Instance uuid 07a5297e-4f60-4213-bcdb-cf6b4d987681 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Ensure instance console log exists: /opt/stack/data/nova/instances/07a5297e-4f60-4213-bcdb-cf6b4d987681/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:59:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:59:14 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-f67cf887-ada0-4867-82bb-40e1f2b9c508 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72809) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 06:59:14 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-f67cf887-ada0-4867-82bb-40e1f2b9c508 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72809) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 06:59:14 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-f67cf887-ada0-4867-82bb-40e1f2b9c508 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 06:59:14 user nova-compute[72809]: DEBUG nova.privsep.utils [None req-f67cf887-ada0-4867-82bb-40e1f2b9c508 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72809) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 06:59:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f67cf887-ada0-4867-82bb-40e1f2b9c508 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgkle87sf/bc353dcca2224d0aad009a9a83e6d164.delta /opt/stack/data/nova/instances/snapshots/tmpgkle87sf/bc353dcca2224d0aad009a9a83e6d164 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:14 user nova-compute[72809]: DEBUG nova.network.neutron [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Successfully updated port: a3360ec8-df18-4a48-8005-d42ce8fac8a9 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:59:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "refresh_cache-07a5297e-4f60-4213-bcdb-cf6b4d987681" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:59:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquired lock "refresh_cache-07a5297e-4f60-4213-bcdb-cf6b4d987681" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:59:14 user nova-compute[72809]: DEBUG nova.network.neutron [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:59:14 user nova-compute[72809]: DEBUG nova.compute.manager [req-eb4980fb-0616-4623-95b7-0ddb8d19c5a0 req-bd9e4ab2-ed8c-416d-8a11-1b6f8b724390 service nova] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Received event network-changed-a3360ec8-df18-4a48-8005-d42ce8fac8a9 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:59:14 user nova-compute[72809]: DEBUG nova.compute.manager [req-eb4980fb-0616-4623-95b7-0ddb8d19c5a0 req-bd9e4ab2-ed8c-416d-8a11-1b6f8b724390 service nova] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Refreshing instance network info cache due to event network-changed-a3360ec8-df18-4a48-8005-d42ce8fac8a9. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:59:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-eb4980fb-0616-4623-95b7-0ddb8d19c5a0 req-bd9e4ab2-ed8c-416d-8a11-1b6f8b724390 service nova] Acquiring lock "refresh_cache-07a5297e-4f60-4213-bcdb-cf6b4d987681" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:59:14 user nova-compute[72809]: DEBUG nova.network.neutron [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f67cf887-ada0-4867-82bb-40e1f2b9c508 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgkle87sf/bc353dcca2224d0aad009a9a83e6d164.delta /opt/stack/data/nova/instances/snapshots/tmpgkle87sf/bc353dcca2224d0aad009a9a83e6d164" returned: 0 in 0.349s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:15 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-f67cf887-ada0-4867-82bb-40e1f2b9c508 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Snapshot extracted, beginning image upload
Aug 09 06:59:15 user nova-compute[72809]: DEBUG nova.network.neutron [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Updating instance_info_cache with network_info: [{"id": "a3360ec8-df18-4a48-8005-d42ce8fac8a9", "address": "fa:16:3e:ed:86:d9", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3360ec8-df", "ovs_interfaceid": "a3360ec8-df18-4a48-8005-d42ce8fac8a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Releasing lock "refresh_cache-07a5297e-4f60-4213-bcdb-cf6b4d987681" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG nova.compute.manager [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Instance network_info: |[{"id": "a3360ec8-df18-4a48-8005-d42ce8fac8a9", "address": "fa:16:3e:ed:86:d9", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3360ec8-df", "ovs_interfaceid": "a3360ec8-df18-4a48-8005-d42ce8fac8a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-eb4980fb-0616-4623-95b7-0ddb8d19c5a0 req-bd9e4ab2-ed8c-416d-8a11-1b6f8b724390 service nova] Acquired lock "refresh_cache-07a5297e-4f60-4213-bcdb-cf6b4d987681" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG nova.network.neutron [req-eb4980fb-0616-4623-95b7-0ddb8d19c5a0 req-bd9e4ab2-ed8c-416d-8a11-1b6f8b724390 service nova] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Refreshing network info cache for port a3360ec8-df18-4a48-8005-d42ce8fac8a9 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Start _get_guest_xml network_info=[{"id": "a3360ec8-df18-4a48-8005-d42ce8fac8a9", "address": "fa:16:3e:ed:86:d9", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3360ec8-df", "ovs_interfaceid": "a3360ec8-df18-4a48-8005-d42ce8fac8a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:59:15 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:59:15 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:59:15 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:59:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1698664803',display_name='tempest-AttachVolumeTestJSON-server-1698664803',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1698664803',id=26,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4Qnq4ZYjYob73RZHDyRo4kM9HomnMqkXct1YNNdHcSI84n1UTjiauRomfT+nGKNoyU3pg/ue1/JFjwdppMPUU3VgAHs/AyPVL7RSmPsqe35+QGzDeOL4CyHWQtNAHZWw==',key_name='tempest-keypair-1787873700',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55a7945f87914776a3f58bda58b7c90c',ramdisk_id='',reservation_id='r-p6w0u5wf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1328011883',owner_user_name='tempest-AttachVolumeTestJSON-1328011883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:59:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87785e8362a14385a951638f4d7cf817',uuid=07a5297e-4f60-4213-bcdb-cf6b4d987681,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3360ec8-df18-4a48-8005-d42ce8fac8a9", "address": "fa:16:3e:ed:86:d9", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3360ec8-df", "ovs_interfaceid": "a3360ec8-df18-4a48-8005-d42ce8fac8a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Converting VIF {"id": "a3360ec8-df18-4a48-8005-d42ce8fac8a9", "address": "fa:16:3e:ed:86:d9", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3360ec8-df", "ovs_interfaceid": "a3360ec8-df18-4a48-8005-d42ce8fac8a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:86:d9,bridge_name='br-int',has_traffic_filtering=True,id=a3360ec8-df18-4a48-8005-d42ce8fac8a9,network=Network(3430cb1f-9729-4613-bc8b-0fcdafd88198),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3360ec8-df') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG nova.objects.instance [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lazy-loading 'pci_devices' on Instance uuid 07a5297e-4f60-4213-bcdb-cf6b4d987681 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:59:15 user nova-compute[72809]:   <uuid>07a5297e-4f60-4213-bcdb-cf6b4d987681</uuid>
Aug 09 06:59:15 user nova-compute[72809]:   <name>instance-0000001a</name>
Aug 09 06:59:15 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:59:15 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:59:15 user nova-compute[72809]:   <metadata>
Aug 09 06:59:15 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:59:15 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:59:15 user nova-compute[72809]:       <nova:name>tempest-AttachVolumeTestJSON-server-1698664803</nova:name>
Aug 09 06:59:15 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:59:15</nova:creationTime>
Aug 09 06:59:15 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:59:15 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:59:15 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:59:15 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:59:15 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:59:15 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:59:15 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:59:15 user nova-compute[72809]:       <nova:owner>
Aug 09 06:59:15 user nova-compute[72809]:         <nova:user uuid="87785e8362a14385a951638f4d7cf817">tempest-AttachVolumeTestJSON-1328011883-project-member</nova:user>
Aug 09 06:59:15 user nova-compute[72809]:         <nova:project uuid="55a7945f87914776a3f58bda58b7c90c">tempest-AttachVolumeTestJSON-1328011883</nova:project>
Aug 09 06:59:15 user nova-compute[72809]:       </nova:owner>
Aug 09 06:59:15 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:59:15 user nova-compute[72809]:       <nova:ports>
Aug 09 06:59:15 user nova-compute[72809]:         <nova:port uuid="a3360ec8-df18-4a48-8005-d42ce8fac8a9">
Aug 09 06:59:15 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 06:59:15 user nova-compute[72809]:         </nova:port>
Aug 09 06:59:15 user nova-compute[72809]:       </nova:ports>
Aug 09 06:59:15 user nova-compute[72809]:     </nova:instance>
Aug 09 06:59:15 user nova-compute[72809]:   </metadata>
Aug 09 06:59:15 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:59:15 user nova-compute[72809]:     <system>
Aug 09 06:59:15 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:59:15 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:59:15 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:59:15 user nova-compute[72809]:       <entry name="serial">07a5297e-4f60-4213-bcdb-cf6b4d987681</entry>
Aug 09 06:59:15 user nova-compute[72809]:       <entry name="uuid">07a5297e-4f60-4213-bcdb-cf6b4d987681</entry>
Aug 09 06:59:15 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:59:15 user nova-compute[72809]:     </system>
Aug 09 06:59:15 user nova-compute[72809]:   </sysinfo>
Aug 09 06:59:15 user nova-compute[72809]:   <os>
Aug 09 06:59:15 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:59:15 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 06:59:15 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:59:15 user nova-compute[72809]:   </os>
Aug 09 06:59:15 user nova-compute[72809]:   <features>
Aug 09 06:59:15 user nova-compute[72809]:     <acpi/>
Aug 09 06:59:15 user nova-compute[72809]:     <apic/>
Aug 09 06:59:15 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:59:15 user nova-compute[72809]:   </features>
Aug 09 06:59:15 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:59:15 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:59:15 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:59:15 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:59:15 user nova-compute[72809]:   </clock>
Aug 09 06:59:15 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:59:15 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:59:15 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:59:15 user nova-compute[72809]:   </cpu>
Aug 09 06:59:15 user nova-compute[72809]:   <devices>
Aug 09 06:59:15 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:59:15 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:59:15 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/07a5297e-4f60-4213-bcdb-cf6b4d987681/disk"/>
Aug 09 06:59:15 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:59:15 user nova-compute[72809]:     </disk>
Aug 09 06:59:15 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:59:15 user nova-compute[72809]:       <mac address="fa:16:3e:ed:86:d9"/>
Aug 09 06:59:15 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:59:15 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:59:15 user nova-compute[72809]:       <target dev="tapa3360ec8-df"/>
Aug 09 06:59:15 user nova-compute[72809]:     </interface>
Aug 09 06:59:15 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:59:15 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/07a5297e-4f60-4213-bcdb-cf6b4d987681/console.log" append="off"/>
Aug 09 06:59:15 user nova-compute[72809]:     </serial>
Aug 09 06:59:15 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:59:15 user nova-compute[72809]:     <video>
Aug 09 06:59:15 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:59:15 user nova-compute[72809]:     </video>
Aug 09 06:59:15 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:59:15 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:59:15 user nova-compute[72809]:     </rng>
Aug 09 06:59:15 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:59:15 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:59:15 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:59:15 user nova-compute[72809]:     </memballoon>
Aug 09 06:59:15 user nova-compute[72809]:   </devices>
Aug 09 06:59:15 user nova-compute[72809]: </domain>
Aug 09 06:59:15 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:59:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1698664803',display_name='tempest-AttachVolumeTestJSON-server-1698664803',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1698664803',id=26,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4Qnq4ZYjYob73RZHDyRo4kM9HomnMqkXct1YNNdHcSI84n1UTjiauRomfT+nGKNoyU3pg/ue1/JFjwdppMPUU3VgAHs/AyPVL7RSmPsqe35+QGzDeOL4CyHWQtNAHZWw==',key_name='tempest-keypair-1787873700',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55a7945f87914776a3f58bda58b7c90c',ramdisk_id='',reservation_id='r-p6w0u5wf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1328011883',owner_user_name='tempest-AttachVolumeTestJSON-1328011883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:59:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87785e8362a14385a951638f4d7cf817',uuid=07a5297e-4f60-4213-bcdb-cf6b4d987681,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3360ec8-df18-4a48-8005-d42ce8fac8a9", "address": "fa:16:3e:ed:86:d9", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3360ec8-df", "ovs_interfaceid": "a3360ec8-df18-4a48-8005-d42ce8fac8a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Converting VIF {"id": "a3360ec8-df18-4a48-8005-d42ce8fac8a9", "address": "fa:16:3e:ed:86:d9", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3360ec8-df", "ovs_interfaceid": "a3360ec8-df18-4a48-8005-d42ce8fac8a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:86:d9,bridge_name='br-int',has_traffic_filtering=True,id=a3360ec8-df18-4a48-8005-d42ce8fac8a9,network=Network(3430cb1f-9729-4613-bc8b-0fcdafd88198),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3360ec8-df') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG os_vif [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:86:d9,bridge_name='br-int',has_traffic_filtering=True,id=a3360ec8-df18-4a48-8005-d42ce8fac8a9,network=Network(3430cb1f-9729-4613-bc8b-0fcdafd88198),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3360ec8-df') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3360ec8-df, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa3360ec8-df, col_values=(('external_ids', {'iface-id': 'a3360ec8-df18-4a48-8005-d42ce8fac8a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:86:d9', 'vm-uuid': '07a5297e-4f60-4213-bcdb-cf6b4d987681'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:15 user nova-compute[72809]: INFO os_vif [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:86:d9,bridge_name='br-int',has_traffic_filtering=True,id=a3360ec8-df18-4a48-8005-d42ce8fac8a9,network=Network(3430cb1f-9729-4613-bc8b-0fcdafd88198),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3360ec8-df')
Aug 09 06:59:15 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] No VIF found with MAC fa:16:3e:ed:86:d9, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG nova.network.neutron [req-eb4980fb-0616-4623-95b7-0ddb8d19c5a0 req-bd9e4ab2-ed8c-416d-8a11-1b6f8b724390 service nova] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Updated VIF entry in instance network info cache for port a3360ec8-df18-4a48-8005-d42ce8fac8a9. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG nova.network.neutron [req-eb4980fb-0616-4623-95b7-0ddb8d19c5a0 req-bd9e4ab2-ed8c-416d-8a11-1b6f8b724390 service nova] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Updating instance_info_cache with network_info: [{"id": "a3360ec8-df18-4a48-8005-d42ce8fac8a9", "address": "fa:16:3e:ed:86:d9", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3360ec8-df", "ovs_interfaceid": "a3360ec8-df18-4a48-8005-d42ce8fac8a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:59:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-eb4980fb-0616-4623-95b7-0ddb8d19c5a0 req-bd9e4ab2-ed8c-416d-8a11-1b6f8b724390 service nova] Releasing lock "refresh_cache-07a5297e-4f60-4213-bcdb-cf6b4d987681" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:59:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:16 user nova-compute[72809]: DEBUG nova.compute.manager [req-39808e50-380e-44da-bb42-fabb1cbf1b4a req-236ab618-d211-4814-bb46-5a0e608d27dc service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Received event network-changed-eaaf2699-4583-4421-872a-117e799570e5 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:59:16 user nova-compute[72809]: DEBUG nova.compute.manager [req-39808e50-380e-44da-bb42-fabb1cbf1b4a req-236ab618-d211-4814-bb46-5a0e608d27dc service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Refreshing instance network info cache due to event network-changed-eaaf2699-4583-4421-872a-117e799570e5. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:59:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-39808e50-380e-44da-bb42-fabb1cbf1b4a req-236ab618-d211-4814-bb46-5a0e608d27dc service nova] Acquiring lock "refresh_cache-25943f41-2d28-4ffe-b38b-ae34a99426e1" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:59:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-39808e50-380e-44da-bb42-fabb1cbf1b4a req-236ab618-d211-4814-bb46-5a0e608d27dc service nova] Acquired lock "refresh_cache-25943f41-2d28-4ffe-b38b-ae34a99426e1" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:59:16 user nova-compute[72809]: DEBUG nova.network.neutron [req-39808e50-380e-44da-bb42-fabb1cbf1b4a req-236ab618-d211-4814-bb46-5a0e608d27dc service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Refreshing network info cache for port eaaf2699-4583-4421-872a-117e799570e5 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:59:16 user nova-compute[72809]: DEBUG nova.compute.manager [req-c6315b18-391b-46f3-9f49-0e28ea01944d req-fa48d849-9434-4151-b59a-3852bdbd070c service nova] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Received event network-vif-plugged-a3360ec8-df18-4a48-8005-d42ce8fac8a9 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:59:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c6315b18-391b-46f3-9f49-0e28ea01944d req-fa48d849-9434-4151-b59a-3852bdbd070c service nova] Acquiring lock "07a5297e-4f60-4213-bcdb-cf6b4d987681-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:59:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c6315b18-391b-46f3-9f49-0e28ea01944d req-fa48d849-9434-4151-b59a-3852bdbd070c service nova] Lock "07a5297e-4f60-4213-bcdb-cf6b4d987681-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:59:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c6315b18-391b-46f3-9f49-0e28ea01944d req-fa48d849-9434-4151-b59a-3852bdbd070c service nova] Lock "07a5297e-4f60-4213-bcdb-cf6b4d987681-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:59:16 user nova-compute[72809]: DEBUG nova.compute.manager [req-c6315b18-391b-46f3-9f49-0e28ea01944d req-fa48d849-9434-4151-b59a-3852bdbd070c service nova] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] No waiting events found dispatching network-vif-plugged-a3360ec8-df18-4a48-8005-d42ce8fac8a9 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:59:16 user nova-compute[72809]: WARNING nova.compute.manager [req-c6315b18-391b-46f3-9f49-0e28ea01944d req-fa48d849-9434-4151-b59a-3852bdbd070c service nova] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Received unexpected event network-vif-plugged-a3360ec8-df18-4a48-8005-d42ce8fac8a9 for instance with vm_state building and task_state spawning.
Aug 09 06:59:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:17 user nova-compute[72809]: INFO nova.compute.manager [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Rebuilding instance
Aug 09 06:59:17 user nova-compute[72809]: DEBUG nova.objects.instance [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lazy-loading 'trusted_certs' on Instance uuid 25943f41-2d28-4ffe-b38b-ae34a99426e1 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:59:17 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-f67cf887-ada0-4867-82bb-40e1f2b9c508 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Snapshot image upload complete
Aug 09 06:59:17 user nova-compute[72809]: INFO nova.compute.manager [None req-f67cf887-ada0-4867-82bb-40e1f2b9c508 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Took 5.20 seconds to snapshot the instance on the hypervisor.
Aug 09 06:59:17 user nova-compute[72809]: DEBUG nova.compute.manager [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:59:17 user nova-compute[72809]: DEBUG nova.objects.instance [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lazy-loading 'pci_requests' on Instance uuid 25943f41-2d28-4ffe-b38b-ae34a99426e1 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG nova.objects.instance [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lazy-loading 'pci_devices' on Instance uuid 25943f41-2d28-4ffe-b38b-ae34a99426e1 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG nova.objects.instance [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lazy-loading 'resources' on Instance uuid 25943f41-2d28-4ffe-b38b-ae34a99426e1 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG nova.objects.instance [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lazy-loading 'migration_context' on Instance uuid 25943f41-2d28-4ffe-b38b-ae34a99426e1 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG nova.objects.instance [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72809) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG nova.network.neutron [req-39808e50-380e-44da-bb42-fabb1cbf1b4a req-236ab618-d211-4814-bb46-5a0e608d27dc service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Updated VIF entry in instance network info cache for port eaaf2699-4583-4421-872a-117e799570e5. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG nova.network.neutron [req-39808e50-380e-44da-bb42-fabb1cbf1b4a req-236ab618-d211-4814-bb46-5a0e608d27dc service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Updating instance_info_cache with network_info: [{"id": "eaaf2699-4583-4421-872a-117e799570e5", "address": "fa:16:3e:47:32:ed", "network": {"id": "514e9a73-337b-46a7-b516-df614914735a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-23845660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b76be74ac2b46049686e6fdcef82dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf2699-45", "ovs_interfaceid": "eaaf2699-4583-4421-872a-117e799570e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-39808e50-380e-44da-bb42-fabb1cbf1b4a req-236ab618-d211-4814-bb46-5a0e608d27dc service nova] Releasing lock "refresh_cache-25943f41-2d28-4ffe-b38b-ae34a99426e1" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG nova.compute.manager [req-eb9fbe98-8ba3-4aee-8b10-98976239670b req-2905ac06-4b9a-4e01-a18b-246243aba972 service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Received event network-vif-unplugged-eaaf2699-4583-4421-872a-117e799570e5 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-eb9fbe98-8ba3-4aee-8b10-98976239670b req-2905ac06-4b9a-4e01-a18b-246243aba972 service nova] Acquiring lock "25943f41-2d28-4ffe-b38b-ae34a99426e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-eb9fbe98-8ba3-4aee-8b10-98976239670b req-2905ac06-4b9a-4e01-a18b-246243aba972 service nova] Lock "25943f41-2d28-4ffe-b38b-ae34a99426e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-eb9fbe98-8ba3-4aee-8b10-98976239670b req-2905ac06-4b9a-4e01-a18b-246243aba972 service nova] Lock "25943f41-2d28-4ffe-b38b-ae34a99426e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG nova.compute.manager [req-eb9fbe98-8ba3-4aee-8b10-98976239670b req-2905ac06-4b9a-4e01-a18b-246243aba972 service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] No waiting events found dispatching network-vif-unplugged-eaaf2699-4583-4421-872a-117e799570e5 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:59:18 user nova-compute[72809]: WARNING nova.compute.manager [req-eb9fbe98-8ba3-4aee-8b10-98976239670b req-2905ac06-4b9a-4e01-a18b-246243aba972 service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Received unexpected event network-vif-unplugged-eaaf2699-4583-4421-872a-117e799570e5 for instance with vm_state active and task_state rebuilding.
Aug 09 06:59:18 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Instance destroyed successfully.
Aug 09 06:59:18 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Instance destroyed successfully.
Aug 09 06:59:18 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:57:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1510155707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-746793904',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaQ4scRY1Gs40gnfMXMH9+94YnOoay8Xk4x1JUX9Bi5t92OrKSGMiljWmXUj+GTELgNUptiW7m1t9tJjH9WklkC4tVBDCva2tyGVNhU3VtR7ORGer1lOM2KxVeRyFujXA==',key_name='tempest-keypair-1187965605',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:57:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3b76be74ac2b46049686e6fdcef82dbb',ramdisk_id='',reservation_id='r-y0g6fmqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1383955831',owner_user_name='tempest-ServerActionsV293TestJSON-1383955831-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:59:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66208d0453c0457ea5402ee892558f33',uuid=25943f41-2d28-4ffe-b38b-ae34a99426e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eaaf2699-4583-4421-872a-117e799570e5", "address": "fa:16:3e:47:32:ed", "network": {"id": "514e9a73-337b-46a7-b516-df614914735a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-23845660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b76be74ac2b46049686e6fdcef82dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf2699-45", "ovs_interfaceid": "eaaf2699-4583-4421-872a-117e799570e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Converting VIF {"id": "eaaf2699-4583-4421-872a-117e799570e5", "address": "fa:16:3e:47:32:ed", "network": {"id": "514e9a73-337b-46a7-b516-df614914735a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-23845660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b76be74ac2b46049686e6fdcef82dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf2699-45", "ovs_interfaceid": "eaaf2699-4583-4421-872a-117e799570e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:32:ed,bridge_name='br-int',has_traffic_filtering=True,id=eaaf2699-4583-4421-872a-117e799570e5,network=Network(514e9a73-337b-46a7-b516-df614914735a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaaf2699-45') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG os_vif [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:32:ed,bridge_name='br-int',has_traffic_filtering=True,id=eaaf2699-4583-4421-872a-117e799570e5,network=Network(514e9a73-337b-46a7-b516-df614914735a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaaf2699-45') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeaaf2699-45, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:59:18 user nova-compute[72809]: INFO os_vif [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:32:ed,bridge_name='br-int',has_traffic_filtering=True,id=eaaf2699-4583-4421-872a-117e799570e5,network=Network(514e9a73-337b-46a7-b516-df614914735a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaaf2699-45')
Aug 09 06:59:18 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXAPdNUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:59:18 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 06:59:18 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d609f88-7a12-4222-bc2b-38a2030945b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23919bc-d8d7-4c16-9297-78ab10c3308f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 06:59:18 user nova-compute[72809]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 06:59:18 user nova-compute[72809]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)
Aug 09 06:59:18 user nova-compute[72809]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 (non-flash)
Aug 09 06:59:18 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 06:59:18 user nova-compute[72809]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 06:59:18 user nova-compute[72809]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)
Aug 09 06:59:18 user nova-compute[72809]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 (non-flash)
Aug 09 06:59:18 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc1385cf7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521'): ({'sde'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Removing single pathed devices sde {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5a0425-04d4-4996-9fa8-c320f15aa9a6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be44060-8deb-473c-8e54-01217d16282a]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Flushing IO for device /dev/sde {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae76f20d-9154-478c-ab12-16c3f51fb400]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 06:59:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[18957d78-c175-4823-a9c5-5886bf2f1b4f]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] SCSI volumes sde have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_6ec73fdf', '/dev/disk/by-id/scsi-26464653164376464', '/dev/disk/by-id/scsi-1SCST_BIO6ec73fdf-dde1d7dde559dc9b') {{(pid=83900) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 06:59:19 user nova-compute[72809]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_6ec73fdf
Aug 09 06:59:19 user nova-compute[72809]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26464653164376464
Aug 09 06:59:19 user nova-compute[72809]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO6ec73fdf-dde1d7dde559dc9b
Aug 09 06:59:19 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55d6256-39d3-4ea9-a113-adc48a1f91eb]: (4, None) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564359.0600846, 07a5297e-4f60-4213-bcdb-cf6b4d987681 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:59:19 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] VM Resumed (Lifecycle Event)
Aug 09 06:59:19 user nova-compute[72809]: DEBUG nova.compute.manager [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG nova.compute.manager [req-7c15cc90-7d74-4ebf-ba46-4052c47ec288 req-7d724a4a-1f41-4124-b7e6-242f9b9fbfb4 service nova] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Received event network-vif-plugged-a3360ec8-df18-4a48-8005-d42ce8fac8a9 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7c15cc90-7d74-4ebf-ba46-4052c47ec288 req-7d724a4a-1f41-4124-b7e6-242f9b9fbfb4 service nova] Acquiring lock "07a5297e-4f60-4213-bcdb-cf6b4d987681-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7c15cc90-7d74-4ebf-ba46-4052c47ec288 req-7d724a4a-1f41-4124-b7e6-242f9b9fbfb4 service nova] Lock "07a5297e-4f60-4213-bcdb-cf6b4d987681-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7c15cc90-7d74-4ebf-ba46-4052c47ec288 req-7d724a4a-1f41-4124-b7e6-242f9b9fbfb4 service nova] Lock "07a5297e-4f60-4213-bcdb-cf6b4d987681-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG nova.compute.manager [req-7c15cc90-7d74-4ebf-ba46-4052c47ec288 req-7d724a4a-1f41-4124-b7e6-242f9b9fbfb4 service nova] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] No waiting events found dispatching network-vif-plugged-a3360ec8-df18-4a48-8005-d42ce8fac8a9 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:59:19 user nova-compute[72809]: WARNING nova.compute.manager [req-7c15cc90-7d74-4ebf-ba46-4052c47ec288 req-7d724a4a-1f41-4124-b7e6-242f9b9fbfb4 service nova] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Received unexpected event network-vif-plugged-a3360ec8-df18-4a48-8005-d42ce8fac8a9 for instance with vm_state building and task_state spawning.
Aug 09 06:59:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcbfd4f-f6da-4e10-9b17-6858236aade0]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:59:19 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Instance spawned successfully.
Aug 09 06:59:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:59:19 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:59:19 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564359.060179, 07a5297e-4f60-4213-bcdb-cf6b4d987681 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:59:19 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] VM Started (Lifecycle Event)
Aug 09 06:59:19 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f494241-7d06-435c-b93a-7aadd10cde76]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521, portal: 172.16.0.220,3260]
Aug 09 06:59:19 user nova-compute[72809]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521, portal: 172.16.0.220,3260] successful.
Aug 09 06:59:19 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:19 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:59:19 user nova-compute[72809]: INFO nova.compute.manager [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Took 6.00 seconds to spawn the instance on the hypervisor.
Aug 09 06:59:19 user nova-compute[72809]: DEBUG nova.compute.manager [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed9dfd4-0bcd-41a6-bd94-86d1f71b7e0d]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] <== disconnect_volume: return (364ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 06:59:19 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Deleting instance files /opt/stack/data/nova/instances/25943f41-2d28-4ffe-b38b-ae34a99426e1_del
Aug 09 06:59:19 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Deletion of /opt/stack/data/nova/instances/25943f41-2d28-4ffe-b38b-ae34a99426e1_del complete
Aug 09 06:59:19 user nova-compute[72809]: INFO nova.compute.manager [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Took 6.76 seconds to build instance.
Aug 09 06:59:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d74afbf2-8eb4-4bf1-9d56-26626f4d5ddc tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "07a5297e-4f60-4213-bcdb-cf6b4d987681" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.890s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:59:19 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 25943f41-2d28-4ffe-b38b-ae34a99426e1 could not be found.
Aug 09 06:59:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXAPdNUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:59:19 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 06:59:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9488e46-cb97-46a9-bd46-690f1550cb6f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bd0457-4f2c-4a6d-904a-22960a0d1da9]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 06:59:19 user nova-compute[72809]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)
Aug 09 06:59:19 user nova-compute[72809]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 (non-flash)
Aug 09 06:59:19 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 06:59:19 user nova-compute[72809]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)
Aug 09 06:59:19 user nova-compute[72809]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 (non-flash)
Aug 09 06:59:19 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc1385cc790>, {}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Disconnecting from: [] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.061s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] <== disconnect_volume: return (62ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:59:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 06:59:20 user nova-compute[72809]: DEBUG nova.compute.manager [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Preparing to wait for external event volume-reimaged-63dec66c-f14e-46ac-becb-481479048521 {{(pid=72809) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 09 06:59:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Acquiring lock "25943f41-2d28-4ffe-b38b-ae34a99426e1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:59:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lock "25943f41-2d28-4ffe-b38b-ae34a99426e1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:59:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lock "25943f41-2d28-4ffe-b38b-ae34a99426e1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:59:20 user nova-compute[72809]: DEBUG nova.compute.manager [req-666622a9-546e-49f0-a6af-0ae3c7a10c3a req-4c9e225e-9c3e-4bb4-a2bb-fa25566fcf4a service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Received event network-vif-plugged-eaaf2699-4583-4421-872a-117e799570e5 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:59:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-666622a9-546e-49f0-a6af-0ae3c7a10c3a req-4c9e225e-9c3e-4bb4-a2bb-fa25566fcf4a service nova] Acquiring lock "25943f41-2d28-4ffe-b38b-ae34a99426e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:59:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-666622a9-546e-49f0-a6af-0ae3c7a10c3a req-4c9e225e-9c3e-4bb4-a2bb-fa25566fcf4a service nova] Lock "25943f41-2d28-4ffe-b38b-ae34a99426e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:59:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-666622a9-546e-49f0-a6af-0ae3c7a10c3a req-4c9e225e-9c3e-4bb4-a2bb-fa25566fcf4a service nova] Lock "25943f41-2d28-4ffe-b38b-ae34a99426e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:59:20 user nova-compute[72809]: DEBUG nova.compute.manager [req-666622a9-546e-49f0-a6af-0ae3c7a10c3a req-4c9e225e-9c3e-4bb4-a2bb-fa25566fcf4a service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] No event matching network-vif-plugged-eaaf2699-4583-4421-872a-117e799570e5 in dict_keys([('volume-reimaged', '63dec66c-f14e-46ac-becb-481479048521')]) {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Aug 09 06:59:20 user nova-compute[72809]: WARNING nova.compute.manager [req-666622a9-546e-49f0-a6af-0ae3c7a10c3a req-4c9e225e-9c3e-4bb4-a2bb-fa25566fcf4a service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Received unexpected event network-vif-plugged-eaaf2699-4583-4421-872a-117e799570e5 for instance with vm_state active and task_state rebuilding.
Aug 09 06:59:20 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "40bc627e-28c9-4450-9532-bf6db60845b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:59:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "40bc627e-28c9-4450-9532-bf6db60845b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:59:24 user nova-compute[72809]: DEBUG nova.compute.manager [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 06:59:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:59:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:59:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 06:59:24 user nova-compute[72809]: INFO nova.compute.claims [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Claim successful on node user
Aug 09 06:59:25 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:59:25 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:59:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.457s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:59:25 user nova-compute[72809]: DEBUG nova.compute.manager [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 06:59:25 user nova-compute[72809]: DEBUG nova.compute.manager [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 06:59:25 user nova-compute[72809]: DEBUG nova.network.neutron [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 06:59:25 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 06:59:25 user nova-compute[72809]: DEBUG nova.compute.manager [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 06:59:25 user nova-compute[72809]: DEBUG nova.policy [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e51e8a984c724efe966662c14b0dbffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec36de19d984ff3a150db4fdd8ce327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 06:59:25 user nova-compute[72809]: DEBUG nova.compute.manager [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 06:59:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 06:59:25 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Creating image(s)
Aug 09 06:59:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "/opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:59:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "/opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:59:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "/opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:59:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:25 user nova-compute[72809]: DEBUG nova.compute.manager [req-fc75fa54-4c2d-4831-a386-bc73f092bc3d req-c67cdcbc-7dda-4131-bae9-c931cafa6bb1 service nova] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Received event network-changed-31867152-d058-43b9-a8af-f1a7c61f5299 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:59:25 user nova-compute[72809]: DEBUG nova.compute.manager [req-fc75fa54-4c2d-4831-a386-bc73f092bc3d req-c67cdcbc-7dda-4131-bae9-c931cafa6bb1 service nova] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Refreshing instance network info cache due to event network-changed-31867152-d058-43b9-a8af-f1a7c61f5299. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:59:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-fc75fa54-4c2d-4831-a386-bc73f092bc3d req-c67cdcbc-7dda-4131-bae9-c931cafa6bb1 service nova] Acquiring lock "refresh_cache-e8e7fc37-b821-4ee9-9ec6-2b2254287d26" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:59:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-fc75fa54-4c2d-4831-a386-bc73f092bc3d req-c67cdcbc-7dda-4131-bae9-c931cafa6bb1 service nova] Acquired lock "refresh_cache-e8e7fc37-b821-4ee9-9ec6-2b2254287d26" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:59:25 user nova-compute[72809]: DEBUG nova.network.neutron [req-fc75fa54-4c2d-4831-a386-bc73f092bc3d req-c67cdcbc-7dda-4131-bae9-c931cafa6bb1 service nova] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Refreshing network info cache for port 31867152-d058-43b9-a8af-f1a7c61f5299 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:59:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.158s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:59:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:59:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.178s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk 1073741824" returned: 0 in 0.066s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:59:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.182s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:26 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Checking if we can resize image /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 06:59:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-769b7071-1734-4806-ab70-620223af5eee tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "e8e7fc37-b821-4ee9-9ec6-2b2254287d26" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:59:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-769b7071-1734-4806-ab70-620223af5eee tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "e8e7fc37-b821-4ee9-9ec6-2b2254287d26" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:59:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-769b7071-1734-4806-ab70-620223af5eee tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "e8e7fc37-b821-4ee9-9ec6-2b2254287d26-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:59:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-769b7071-1734-4806-ab70-620223af5eee tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "e8e7fc37-b821-4ee9-9ec6-2b2254287d26-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:59:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-769b7071-1734-4806-ab70-620223af5eee tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "e8e7fc37-b821-4ee9-9ec6-2b2254287d26-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:59:26 user nova-compute[72809]: INFO nova.compute.manager [None req-769b7071-1734-4806-ab70-620223af5eee tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Terminating instance
Aug 09 06:59:26 user nova-compute[72809]: DEBUG nova.compute.manager [None req-769b7071-1734-4806-ab70-620223af5eee tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 06:59:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:26 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Cannot resize image /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 06:59:26 user nova-compute[72809]: DEBUG nova.objects.instance [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lazy-loading 'migration_context' on Instance uuid 40bc627e-28c9-4450-9532-bf6db60845b2 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:59:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 06:59:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Ensure instance console log exists: /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 06:59:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:59:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:59:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:59:26 user nova-compute[72809]: DEBUG nova.network.neutron [req-fc75fa54-4c2d-4831-a386-bc73f092bc3d req-c67cdcbc-7dda-4131-bae9-c931cafa6bb1 service nova] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Updated VIF entry in instance network info cache for port 31867152-d058-43b9-a8af-f1a7c61f5299. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:59:26 user nova-compute[72809]: DEBUG nova.network.neutron [req-fc75fa54-4c2d-4831-a386-bc73f092bc3d req-c67cdcbc-7dda-4131-bae9-c931cafa6bb1 service nova] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Updating instance_info_cache with network_info: [{"id": "31867152-d058-43b9-a8af-f1a7c61f5299", "address": "fa:16:3e:4a:61:62", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31867152-d0", "ovs_interfaceid": "31867152-d058-43b9-a8af-f1a7c61f5299", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:59:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-fc75fa54-4c2d-4831-a386-bc73f092bc3d req-c67cdcbc-7dda-4131-bae9-c931cafa6bb1 service nova] Releasing lock "refresh_cache-e8e7fc37-b821-4ee9-9ec6-2b2254287d26" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:59:26 user nova-compute[72809]: DEBUG nova.network.neutron [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Successfully created port: e17ef1fb-761f-4b49-803c-b4c55115eb7c {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 06:59:26 user nova-compute[72809]: DEBUG nova.compute.manager [req-3feaacaf-31c7-4ef7-9f7e-c3c20bd1e34d req-2962311a-2244-4c75-9415-b7beac138d6d service nova] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Received event network-vif-unplugged-31867152-d058-43b9-a8af-f1a7c61f5299 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:59:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3feaacaf-31c7-4ef7-9f7e-c3c20bd1e34d req-2962311a-2244-4c75-9415-b7beac138d6d service nova] Acquiring lock "e8e7fc37-b821-4ee9-9ec6-2b2254287d26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:59:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3feaacaf-31c7-4ef7-9f7e-c3c20bd1e34d req-2962311a-2244-4c75-9415-b7beac138d6d service nova] Lock "e8e7fc37-b821-4ee9-9ec6-2b2254287d26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:59:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3feaacaf-31c7-4ef7-9f7e-c3c20bd1e34d req-2962311a-2244-4c75-9415-b7beac138d6d service nova] Lock "e8e7fc37-b821-4ee9-9ec6-2b2254287d26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:59:26 user nova-compute[72809]: DEBUG nova.compute.manager [req-3feaacaf-31c7-4ef7-9f7e-c3c20bd1e34d req-2962311a-2244-4c75-9415-b7beac138d6d service nova] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] No waiting events found dispatching network-vif-unplugged-31867152-d058-43b9-a8af-f1a7c61f5299 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:59:26 user nova-compute[72809]: DEBUG nova.compute.manager [req-3feaacaf-31c7-4ef7-9f7e-c3c20bd1e34d req-2962311a-2244-4c75-9415-b7beac138d6d service nova] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Received event network-vif-unplugged-31867152-d058-43b9-a8af-f1a7c61f5299 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 06:59:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:27 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Instance destroyed successfully.
Aug 09 06:59:27 user nova-compute[72809]: DEBUG nova.objects.instance [None req-769b7071-1734-4806-ab70-620223af5eee tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lazy-loading 'resources' on Instance uuid e8e7fc37-b821-4ee9-9ec6-2b2254287d26 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:59:27 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-769b7071-1734-4806-ab70-620223af5eee tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:57:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2020653027',display_name='tempest-AttachVolumeNegativeTest-server-2020653027',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2020653027',id=24,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3qsxN9hvPZaRYdUdKj5df7i8xIln+d6mIxvqvqlx6aSLo10WvOlmy1kltP88yZht7ZcR13a+zCkhm2yxq+93u6U4WcheeviO6+nEFj+vuuVgb4E6iHijyIlD/v4vnMXA==',key_name='tempest-keypair-1514945260',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:57:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ce7c486aaca4ef89eb7e392b717e3d7',ramdisk_id='',reservation_id='r-0igc7fzn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2066250801',owner_user_name='tempest-AttachVolumeNegativeTest-2066250801-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:57:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f85a1f2a88fd40a48d1c4dba13f0ac09',uuid=e8e7fc37-b821-4ee9-9ec6-2b2254287d26,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31867152-d058-43b9-a8af-f1a7c61f5299", "address": "fa:16:3e:4a:61:62", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31867152-d0", "ovs_interfaceid": "31867152-d058-43b9-a8af-f1a7c61f5299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 06:59:27 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-769b7071-1734-4806-ab70-620223af5eee tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Converting VIF {"id": "31867152-d058-43b9-a8af-f1a7c61f5299", "address": "fa:16:3e:4a:61:62", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31867152-d0", "ovs_interfaceid": "31867152-d058-43b9-a8af-f1a7c61f5299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:59:27 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-769b7071-1734-4806-ab70-620223af5eee tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:61:62,bridge_name='br-int',has_traffic_filtering=True,id=31867152-d058-43b9-a8af-f1a7c61f5299,network=Network(1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31867152-d0') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:59:27 user nova-compute[72809]: DEBUG os_vif [None req-769b7071-1734-4806-ab70-620223af5eee tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:61:62,bridge_name='br-int',has_traffic_filtering=True,id=31867152-d058-43b9-a8af-f1a7c61f5299,network=Network(1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31867152-d0') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 06:59:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31867152-d0, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:59:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:59:27 user nova-compute[72809]: INFO os_vif [None req-769b7071-1734-4806-ab70-620223af5eee tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:61:62,bridge_name='br-int',has_traffic_filtering=True,id=31867152-d058-43b9-a8af-f1a7c61f5299,network=Network(1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31867152-d0')
Aug 09 06:59:27 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-769b7071-1734-4806-ab70-620223af5eee tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Deleting instance files /opt/stack/data/nova/instances/e8e7fc37-b821-4ee9-9ec6-2b2254287d26_del
Aug 09 06:59:27 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-769b7071-1734-4806-ab70-620223af5eee tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Deletion of /opt/stack/data/nova/instances/e8e7fc37-b821-4ee9-9ec6-2b2254287d26_del complete
Aug 09 06:59:27 user nova-compute[72809]: INFO nova.compute.manager [None req-769b7071-1734-4806-ab70-620223af5eee tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 09 06:59:27 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-769b7071-1734-4806-ab70-620223af5eee tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 06:59:27 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 06:59:27 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 06:59:27 user nova-compute[72809]: DEBUG nova.network.neutron [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Successfully updated port: e17ef1fb-761f-4b49-803c-b4c55115eb7c {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 06:59:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "refresh_cache-40bc627e-28c9-4450-9532-bf6db60845b2" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:59:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquired lock "refresh_cache-40bc627e-28c9-4450-9532-bf6db60845b2" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:59:27 user nova-compute[72809]: DEBUG nova.network.neutron [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 06:59:27 user nova-compute[72809]: DEBUG nova.network.neutron [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:59:28 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Took 0.89 seconds to deallocate network for instance.
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.compute.manager [req-bb533baf-7105-488c-bd97-3f9b44adb413 req-7a117ad8-b66c-48f3-b544-d25017925bd1 service nova] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Received event network-vif-deleted-31867152-d058-43b9-a8af-f1a7c61f5299 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-769b7071-1734-4806-ab70-620223af5eee tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-769b7071-1734-4806-ab70-620223af5eee tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.network.neutron [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Updating instance_info_cache with network_info: [{"id": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "address": "fa:16:3e:15:53:7d", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape17ef1fb-76", "ovs_interfaceid": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Releasing lock "refresh_cache-40bc627e-28c9-4450-9532-bf6db60845b2" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.compute.manager [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Instance network_info: |[{"id": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "address": "fa:16:3e:15:53:7d", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape17ef1fb-76", "ovs_interfaceid": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Start _get_guest_xml network_info=[{"id": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "address": "fa:16:3e:15:53:7d", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape17ef1fb-76", "ovs_interfaceid": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 06:59:28 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:59:28 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:59:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-301681722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-301681722',id=27,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiPUyyU9HwEFMGL8DnXEkkfedQ6deONPsZPZUAGuNY6FGS6oRpyMZpNJ7zXpxN+k6Z2hKUAdewWqVFpwArkxpr2rp1VkYEweMSI5/AQLY/62y6Lc4WGoK047l4JlSqa1Q==',key_name='tempest-keypair-1856803890',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ec36de19d984ff3a150db4fdd8ce327',ramdisk_id='',reservation_id='r-3ai7s74q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1006961404',owner_user_name='tempest-AttachVolumeShelveTestJSON-1006961404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:59:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e51e8a984c724efe966662c14b0dbffc',uuid=40bc627e-28c9-4450-9532-bf6db60845b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "address": "fa:16:3e:15:53:7d", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape17ef1fb-76", "ovs_interfaceid": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Converting VIF {"id": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "address": "fa:16:3e:15:53:7d", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape17ef1fb-76", "ovs_interfaceid": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:53:7d,bridge_name='br-int',has_traffic_filtering=True,id=e17ef1fb-761f-4b49-803c-b4c55115eb7c,network=Network(39277410-6754-4b40-b1bc-9777841910ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape17ef1fb-76') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.objects.instance [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lazy-loading 'pci_devices' on Instance uuid 40bc627e-28c9-4450-9532-bf6db60845b2 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] End _get_guest_xml xml=<domain type="kvm">
Aug 09 06:59:28 user nova-compute[72809]:   <uuid>40bc627e-28c9-4450-9532-bf6db60845b2</uuid>
Aug 09 06:59:28 user nova-compute[72809]:   <name>instance-0000001b</name>
Aug 09 06:59:28 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 06:59:28 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 06:59:28 user nova-compute[72809]:   <metadata>
Aug 09 06:59:28 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 06:59:28 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 06:59:28 user nova-compute[72809]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-301681722</nova:name>
Aug 09 06:59:28 user nova-compute[72809]:       <nova:creationTime>2023-08-09 06:59:28</nova:creationTime>
Aug 09 06:59:28 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 06:59:28 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 06:59:28 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 06:59:28 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 06:59:28 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 06:59:28 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 06:59:28 user nova-compute[72809]:       </nova:flavor>
Aug 09 06:59:28 user nova-compute[72809]:       <nova:owner>
Aug 09 06:59:28 user nova-compute[72809]:         <nova:user uuid="e51e8a984c724efe966662c14b0dbffc">tempest-AttachVolumeShelveTestJSON-1006961404-project-member</nova:user>
Aug 09 06:59:28 user nova-compute[72809]:         <nova:project uuid="0ec36de19d984ff3a150db4fdd8ce327">tempest-AttachVolumeShelveTestJSON-1006961404</nova:project>
Aug 09 06:59:28 user nova-compute[72809]:       </nova:owner>
Aug 09 06:59:28 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 06:59:28 user nova-compute[72809]:       <nova:ports>
Aug 09 06:59:28 user nova-compute[72809]:         <nova:port uuid="e17ef1fb-761f-4b49-803c-b4c55115eb7c">
Aug 09 06:59:28 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 06:59:28 user nova-compute[72809]:         </nova:port>
Aug 09 06:59:28 user nova-compute[72809]:       </nova:ports>
Aug 09 06:59:28 user nova-compute[72809]:     </nova:instance>
Aug 09 06:59:28 user nova-compute[72809]:   </metadata>
Aug 09 06:59:28 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 06:59:28 user nova-compute[72809]:     <system>
Aug 09 06:59:28 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 06:59:28 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 06:59:28 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 06:59:28 user nova-compute[72809]:       <entry name="serial">40bc627e-28c9-4450-9532-bf6db60845b2</entry>
Aug 09 06:59:28 user nova-compute[72809]:       <entry name="uuid">40bc627e-28c9-4450-9532-bf6db60845b2</entry>
Aug 09 06:59:28 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 06:59:28 user nova-compute[72809]:     </system>
Aug 09 06:59:28 user nova-compute[72809]:   </sysinfo>
Aug 09 06:59:28 user nova-compute[72809]:   <os>
Aug 09 06:59:28 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 06:59:28 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 06:59:28 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 06:59:28 user nova-compute[72809]:   </os>
Aug 09 06:59:28 user nova-compute[72809]:   <features>
Aug 09 06:59:28 user nova-compute[72809]:     <acpi/>
Aug 09 06:59:28 user nova-compute[72809]:     <apic/>
Aug 09 06:59:28 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 06:59:28 user nova-compute[72809]:   </features>
Aug 09 06:59:28 user nova-compute[72809]:   <clock offset="utc">
Aug 09 06:59:28 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 06:59:28 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 06:59:28 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 06:59:28 user nova-compute[72809]:   </clock>
Aug 09 06:59:28 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 06:59:28 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 06:59:28 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 06:59:28 user nova-compute[72809]:   </cpu>
Aug 09 06:59:28 user nova-compute[72809]:   <devices>
Aug 09 06:59:28 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 06:59:28 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 06:59:28 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk"/>
Aug 09 06:59:28 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 06:59:28 user nova-compute[72809]:     </disk>
Aug 09 06:59:28 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 06:59:28 user nova-compute[72809]:       <mac address="fa:16:3e:15:53:7d"/>
Aug 09 06:59:28 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:59:28 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 06:59:28 user nova-compute[72809]:       <target dev="tape17ef1fb-76"/>
Aug 09 06:59:28 user nova-compute[72809]:     </interface>
Aug 09 06:59:28 user nova-compute[72809]:     <serial type="pty">
Aug 09 06:59:28 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/console.log" append="off"/>
Aug 09 06:59:28 user nova-compute[72809]:     </serial>
Aug 09 06:59:28 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 06:59:28 user nova-compute[72809]:     <video>
Aug 09 06:59:28 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 06:59:28 user nova-compute[72809]:     </video>
Aug 09 06:59:28 user nova-compute[72809]:     <rng model="virtio">
Aug 09 06:59:28 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 06:59:28 user nova-compute[72809]:     </rng>
Aug 09 06:59:28 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 06:59:28 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 06:59:28 user nova-compute[72809]:       <stats period="10"/>
Aug 09 06:59:28 user nova-compute[72809]:     </memballoon>
Aug 09 06:59:28 user nova-compute[72809]:   </devices>
Aug 09 06:59:28 user nova-compute[72809]: </domain>
Aug 09 06:59:28 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:59:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-301681722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-301681722',id=27,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiPUyyU9HwEFMGL8DnXEkkfedQ6deONPsZPZUAGuNY6FGS6oRpyMZpNJ7zXpxN+k6Z2hKUAdewWqVFpwArkxpr2rp1VkYEweMSI5/AQLY/62y6Lc4WGoK047l4JlSqa1Q==',key_name='tempest-keypair-1856803890',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ec36de19d984ff3a150db4fdd8ce327',ramdisk_id='',reservation_id='r-3ai7s74q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1006961404',owner_user_name='tempest-AttachVolumeShelveTestJSON-1006961404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:59:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e51e8a984c724efe966662c14b0dbffc',uuid=40bc627e-28c9-4450-9532-bf6db60845b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "address": "fa:16:3e:15:53:7d", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape17ef1fb-76", "ovs_interfaceid": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Converting VIF {"id": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "address": "fa:16:3e:15:53:7d", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape17ef1fb-76", "ovs_interfaceid": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:53:7d,bridge_name='br-int',has_traffic_filtering=True,id=e17ef1fb-761f-4b49-803c-b4c55115eb7c,network=Network(39277410-6754-4b40-b1bc-9777841910ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape17ef1fb-76') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG os_vif [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:53:7d,bridge_name='br-int',has_traffic_filtering=True,id=e17ef1fb-761f-4b49-803c-b4c55115eb7c,network=Network(39277410-6754-4b40-b1bc-9777841910ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape17ef1fb-76') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape17ef1fb-76, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape17ef1fb-76, col_values=(('external_ids', {'iface-id': 'e17ef1fb-761f-4b49-803c-b4c55115eb7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:53:7d', 'vm-uuid': '40bc627e-28c9-4450-9532-bf6db60845b2'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:28 user nova-compute[72809]: INFO os_vif [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:53:7d,bridge_name='br-int',has_traffic_filtering=True,id=e17ef1fb-761f-4b49-803c-b4c55115eb7c,network=Network(39277410-6754-4b40-b1bc-9777841910ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape17ef1fb-76')
Aug 09 06:59:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] No VIF found with MAC fa:16:3e:15:53:7d, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-769b7071-1734-4806-ab70-620223af5eee tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-769b7071-1734-4806-ab70-620223af5eee tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-769b7071-1734-4806-ab70-620223af5eee tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.529s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:59:28 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-769b7071-1734-4806-ab70-620223af5eee tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Deleted allocations for instance e8e7fc37-b821-4ee9-9ec6-2b2254287d26
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.compute.manager [req-0ea93281-f842-4ce7-bae8-90d38ccba14f req-ce3fb11d-efed-47f6-a13a-30b15c62f01c service nova] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Received event network-vif-plugged-31867152-d058-43b9-a8af-f1a7c61f5299 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0ea93281-f842-4ce7-bae8-90d38ccba14f req-ce3fb11d-efed-47f6-a13a-30b15c62f01c service nova] Acquiring lock "e8e7fc37-b821-4ee9-9ec6-2b2254287d26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0ea93281-f842-4ce7-bae8-90d38ccba14f req-ce3fb11d-efed-47f6-a13a-30b15c62f01c service nova] Lock "e8e7fc37-b821-4ee9-9ec6-2b2254287d26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0ea93281-f842-4ce7-bae8-90d38ccba14f req-ce3fb11d-efed-47f6-a13a-30b15c62f01c service nova] Lock "e8e7fc37-b821-4ee9-9ec6-2b2254287d26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.compute.manager [req-0ea93281-f842-4ce7-bae8-90d38ccba14f req-ce3fb11d-efed-47f6-a13a-30b15c62f01c service nova] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] No waiting events found dispatching network-vif-plugged-31867152-d058-43b9-a8af-f1a7c61f5299 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:59:28 user nova-compute[72809]: WARNING nova.compute.manager [req-0ea93281-f842-4ce7-bae8-90d38ccba14f req-ce3fb11d-efed-47f6-a13a-30b15c62f01c service nova] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Received unexpected event network-vif-plugged-31867152-d058-43b9-a8af-f1a7c61f5299 for instance with vm_state deleted and task_state None.
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.compute.manager [req-0ea93281-f842-4ce7-bae8-90d38ccba14f req-ce3fb11d-efed-47f6-a13a-30b15c62f01c service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Received event network-changed-e17ef1fb-761f-4b49-803c-b4c55115eb7c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.compute.manager [req-0ea93281-f842-4ce7-bae8-90d38ccba14f req-ce3fb11d-efed-47f6-a13a-30b15c62f01c service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Refreshing instance network info cache due to event network-changed-e17ef1fb-761f-4b49-803c-b4c55115eb7c. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0ea93281-f842-4ce7-bae8-90d38ccba14f req-ce3fb11d-efed-47f6-a13a-30b15c62f01c service nova] Acquiring lock "refresh_cache-40bc627e-28c9-4450-9532-bf6db60845b2" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0ea93281-f842-4ce7-bae8-90d38ccba14f req-ce3fb11d-efed-47f6-a13a-30b15c62f01c service nova] Acquired lock "refresh_cache-40bc627e-28c9-4450-9532-bf6db60845b2" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG nova.network.neutron [req-0ea93281-f842-4ce7-bae8-90d38ccba14f req-ce3fb11d-efed-47f6-a13a-30b15c62f01c service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Refreshing network info cache for port e17ef1fb-761f-4b49-803c-b4c55115eb7c {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 06:59:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-769b7071-1734-4806-ab70-620223af5eee tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "e8e7fc37-b821-4ee9-9ec6-2b2254287d26" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.544s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:59:29 user nova-compute[72809]: DEBUG nova.network.neutron [req-0ea93281-f842-4ce7-bae8-90d38ccba14f req-ce3fb11d-efed-47f6-a13a-30b15c62f01c service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Updated VIF entry in instance network info cache for port e17ef1fb-761f-4b49-803c-b4c55115eb7c. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 06:59:29 user nova-compute[72809]: DEBUG nova.network.neutron [req-0ea93281-f842-4ce7-bae8-90d38ccba14f req-ce3fb11d-efed-47f6-a13a-30b15c62f01c service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Updating instance_info_cache with network_info: [{"id": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "address": "fa:16:3e:15:53:7d", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape17ef1fb-76", "ovs_interfaceid": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:59:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0ea93281-f842-4ce7-bae8-90d38ccba14f req-ce3fb11d-efed-47f6-a13a-30b15c62f01c service nova] Releasing lock "refresh_cache-40bc627e-28c9-4450-9532-bf6db60845b2" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:59:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:30 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:59:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-a279ee82-8c18-4f26-9eb3-39c1eebae97d req-cfcc6bd9-2c38-483d-a946-1a0b26762175 service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Received event network-vif-plugged-e17ef1fb-761f-4b49-803c-b4c55115eb7c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:59:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a279ee82-8c18-4f26-9eb3-39c1eebae97d req-cfcc6bd9-2c38-483d-a946-1a0b26762175 service nova] Acquiring lock "40bc627e-28c9-4450-9532-bf6db60845b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:59:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a279ee82-8c18-4f26-9eb3-39c1eebae97d req-cfcc6bd9-2c38-483d-a946-1a0b26762175 service nova] Lock "40bc627e-28c9-4450-9532-bf6db60845b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:59:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a279ee82-8c18-4f26-9eb3-39c1eebae97d req-cfcc6bd9-2c38-483d-a946-1a0b26762175 service nova] Lock "40bc627e-28c9-4450-9532-bf6db60845b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:59:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-a279ee82-8c18-4f26-9eb3-39c1eebae97d req-cfcc6bd9-2c38-483d-a946-1a0b26762175 service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] No waiting events found dispatching network-vif-plugged-e17ef1fb-761f-4b49-803c-b4c55115eb7c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:59:30 user nova-compute[72809]: WARNING nova.compute.manager [req-a279ee82-8c18-4f26-9eb3-39c1eebae97d req-cfcc6bd9-2c38-483d-a946-1a0b26762175 service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Received unexpected event network-vif-plugged-e17ef1fb-761f-4b49-803c-b4c55115eb7c for instance with vm_state building and task_state spawning.
Aug 09 06:59:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-a279ee82-8c18-4f26-9eb3-39c1eebae97d req-cfcc6bd9-2c38-483d-a946-1a0b26762175 service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Received event network-vif-plugged-e17ef1fb-761f-4b49-803c-b4c55115eb7c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:59:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a279ee82-8c18-4f26-9eb3-39c1eebae97d req-cfcc6bd9-2c38-483d-a946-1a0b26762175 service nova] Acquiring lock "40bc627e-28c9-4450-9532-bf6db60845b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:59:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a279ee82-8c18-4f26-9eb3-39c1eebae97d req-cfcc6bd9-2c38-483d-a946-1a0b26762175 service nova] Lock "40bc627e-28c9-4450-9532-bf6db60845b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:59:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a279ee82-8c18-4f26-9eb3-39c1eebae97d req-cfcc6bd9-2c38-483d-a946-1a0b26762175 service nova] Lock "40bc627e-28c9-4450-9532-bf6db60845b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:59:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-a279ee82-8c18-4f26-9eb3-39c1eebae97d req-cfcc6bd9-2c38-483d-a946-1a0b26762175 service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] No waiting events found dispatching network-vif-plugged-e17ef1fb-761f-4b49-803c-b4c55115eb7c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 06:59:30 user nova-compute[72809]: WARNING nova.compute.manager [req-a279ee82-8c18-4f26-9eb3-39c1eebae97d req-cfcc6bd9-2c38-483d-a946-1a0b26762175 service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Received unexpected event network-vif-plugged-e17ef1fb-761f-4b49-803c-b4c55115eb7c for instance with vm_state building and task_state spawning.
Aug 09 06:59:31 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:59:31 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 06:59:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-1bde423f-0b73-448f-bdce-8d6af96d8fc6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 06:59:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-1bde423f-0b73-448f-bdce-8d6af96d8fc6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 06:59:31 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 06:59:32 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564372.0148957, 40bc627e-28c9-4450-9532-bf6db60845b2 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:59:32 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] VM Resumed (Lifecycle Event)
Aug 09 06:59:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:59:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 06:59:32 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Instance spawned successfully.
Aug 09 06:59:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 06:59:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:59:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:59:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:59:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:59:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:59:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:59:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:59:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 06:59:32 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:59:32 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564372.018854, 40bc627e-28c9-4450-9532-bf6db60845b2 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:59:32 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] VM Started (Lifecycle Event)
Aug 09 06:59:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:59:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 06:59:32 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 06:59:32 user nova-compute[72809]: INFO nova.compute.manager [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Took 6.61 seconds to spawn the instance on the hypervisor.
Aug 09 06:59:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:59:32 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Updating instance_info_cache with network_info: [{"id": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "address": "fa:16:3e:3b:e0:d8", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81017ed8-c8", "ovs_interfaceid": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 06:59:32 user nova-compute[72809]: INFO nova.compute.manager [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Took 7.52 seconds to build instance.
Aug 09 06:59:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-08997b14-acf2-41b5-8f89-0e5294dfeca3 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "40bc627e-28c9-4450-9532-bf6db60845b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.610s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:59:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-1bde423f-0b73-448f-bdce-8d6af96d8fc6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 06:59:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 06:59:32 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:59:32 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:59:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:59:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:59:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:59:32 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 06:59:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07a5297e-4f60-4213-bcdb-cf6b4d987681/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07a5297e-4f60-4213-bcdb-cf6b4d987681/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07a5297e-4f60-4213-bcdb-cf6b4d987681/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07a5297e-4f60-4213-bcdb-cf6b4d987681/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 06:59:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:33 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691564358.7861063, 25943f41-2d28-4ffe-b38b-ae34a99426e1 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:59:33 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] VM Stopped (Lifecycle Event)
Aug 09 06:59:33 user nova-compute[72809]: DEBUG nova.compute.manager [None req-241dac2a-d947-40dc-bab3-b1caa4705286 None None] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:59:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 06:59:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d210e25-aa29-40a5-ad99-27e54a51dd7a/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d210e25-aa29-40a5-ad99-27e54a51dd7a/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d210e25-aa29-40a5-ad99-27e54a51dd7a/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d210e25-aa29-40a5-ad99-27e54a51dd7a/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 06:59:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:36 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:59:36 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 06:59:36 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=7400MB free_disk=25.359500885009766GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 06:59:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:59:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:59:37 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 336770eb-4f09-4134-92ef-f96039bf4fa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:59:37 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 5251cef4-9a49-4220-984e-75d1198f95b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:59:37 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 1bde423f-0b73-448f-bdce-8d6af96d8fc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:59:37 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance bebd5a14-6272-4de1-a1a1-4fb45b867c7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:59:37 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 6d210e25-aa29-40a5-ad99-27e54a51dd7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:59:37 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 339372ed-140d-4226-ba00-2cc682214d5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:59:37 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 25943f41-2d28-4ffe-b38b-ae34a99426e1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:59:37 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 38319c37-9cc0-4e84-8415-ddcf37451daf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:59:37 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 07a5297e-4f60-4213-bcdb-cf6b4d987681 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:59:37 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 40bc627e-28c9-4450-9532-bf6db60845b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 06:59:37 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 06:59:37 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 06:59:37 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 06:59:37 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 06:59:37 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 06:59:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.560s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:59:37 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:59:37 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Cleaning up deleted instances {{(pid=72809) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 06:59:37 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] There are 0 instances to clean {{(pid=72809) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 06:59:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:40 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:59:40 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:59:40 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:59:40 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:59:40 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:59:40 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:59:40 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 06:59:42 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691564366.9984286, e8e7fc37-b821-4ee9-9ec6-2b2254287d26 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 06:59:42 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] VM Stopped (Lifecycle Event)
Aug 09 06:59:42 user nova-compute[72809]: DEBUG nova.compute.manager [None req-72f54162-4e9f-4e97-901d-fd244634d838 None None] [instance: e8e7fc37-b821-4ee9-9ec6-2b2254287d26] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 06:59:43 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:43 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:49 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 06:59:49 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72809) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 06:59:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:55 user nova-compute[72809]: DEBUG nova.compute.manager [req-b0fb987a-c253-4e08-84e6-881d661dfd7a req-e68fcedb-64d6-47e1-92ed-fcec5efce317 service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Received event volume-reimaged-63dec66c-f14e-46ac-becb-481479048521 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 06:59:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b0fb987a-c253-4e08-84e6-881d661dfd7a req-e68fcedb-64d6-47e1-92ed-fcec5efce317 service nova] Acquiring lock "25943f41-2d28-4ffe-b38b-ae34a99426e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 06:59:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b0fb987a-c253-4e08-84e6-881d661dfd7a req-e68fcedb-64d6-47e1-92ed-fcec5efce317 service nova] Lock "25943f41-2d28-4ffe-b38b-ae34a99426e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 06:59:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b0fb987a-c253-4e08-84e6-881d661dfd7a req-e68fcedb-64d6-47e1-92ed-fcec5efce317 service nova] Lock "25943f41-2d28-4ffe-b38b-ae34a99426e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 06:59:55 user nova-compute[72809]: DEBUG nova.compute.manager [req-b0fb987a-c253-4e08-84e6-881d661dfd7a req-e68fcedb-64d6-47e1-92ed-fcec5efce317 service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Processing event volume-reimaged-63dec66c-f14e-46ac-becb-481479048521 {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 09 06:59:55 user nova-compute[72809]: DEBUG nova.compute.manager [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Instance event wait completed in 34 seconds for volume-reimaged {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 06:59:55 user nova-compute[72809]: INFO nova.virt.block_device [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Booting with volume 63dec66c-f14e-46ac-becb-481479048521 at /dev/vda
Aug 09 06:59:55 user nova-compute[72809]: DEBUG os_brick.utils [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 06:59:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:55 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f83fc6-ed77-48dc-a1e6-912f91d49546]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:59:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:55 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fbe329-6e6e-443c-b19a-afb02e12886a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:59:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 06:59:55 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a322142a-19ee-4e31-b1a3-ff6d9bcb3793]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:59:55 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af931f5-a764-4d36-a821-83c8def390ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:59:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:59:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 06:59:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 06:59:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 06:59:55 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 06:59:55 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbc5716-f4eb-4f5f-a895-5d7a2685bb4f]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 06:59:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 06:59:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 06:59:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 06:59:55 user nova-compute[72809]: DEBUG os_brick.utils [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 06:59:55 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Updating existing volume attachment record: 957c1919-b45c-4402-80b6-32c3d1077cda {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 06:59:55 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 06:59:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquiring lock "6d210e25-aa29-40a5-ad99-27e54a51dd7a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:00:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "6d210e25-aa29-40a5-ad99-27e54a51dd7a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:00:06 user nova-compute[72809]: INFO nova.compute.manager [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Detaching volume be0a75df-172a-4e65-8eeb-1785aa48c088
Aug 09 07:00:06 user nova-compute[72809]: INFO nova.virt.block_device [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Attempting to driver detach volume be0a75df-172a-4e65-8eeb-1785aa48c088 from mountpoint /dev/vdb
Aug 09 07:00:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Attempting to detach device vdb from instance 6d210e25-aa29-40a5-ad99-27e54a51dd7a from the persistent domain config. {{(pid=72809) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 07:00:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:00:06 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:00:06 user nova-compute[72809]:   <source dev="/dev/sdd"/>
Aug 09 07:00:06 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:00:06 user nova-compute[72809]:   <serial>be0a75df-172a-4e65-8eeb-1785aa48c088</serial>
Aug 09 07:00:06 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 07:00:06 user nova-compute[72809]: </disk>
Aug 09 07:00:06 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:00:06 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Successfully detached device vdb from instance 6d210e25-aa29-40a5-ad99-27e54a51dd7a from the persistent domain config.
Aug 09 07:00:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6d210e25-aa29-40a5-ad99-27e54a51dd7a from the live domain config. {{(pid=72809) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 07:00:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:00:06 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:00:06 user nova-compute[72809]:   <source dev="/dev/sdd"/>
Aug 09 07:00:06 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:00:06 user nova-compute[72809]:   <serial>be0a75df-172a-4e65-8eeb-1785aa48c088</serial>
Aug 09 07:00:06 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 07:00:06 user nova-compute[72809]: </disk>
Aug 09 07:00:06 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:00:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquiring lock "6d210e25-aa29-40a5-ad99-27e54a51dd7a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Received event <DeviceRemovedEvent: 1691564407.1049128, 6d210e25-aa29-40a5-ad99-27e54a51dd7a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72809) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6d210e25-aa29-40a5-ad99-27e54a51dd7a {{(pid=72809) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 07:00:07 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Successfully detached device vdb from instance 6d210e25-aa29-40a5-ad99-27e54a51dd7a from the live domain config.
Aug 09 07:00:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iUnMqhej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:00:07 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:00:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5660d2e9-8fcf-44f5-bb0b-97bf28926aa2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b99b2e2-cfa5-485b-bcdf-5e742838f97b]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 07:00:07 user nova-compute[72809]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)
Aug 09 07:00:07 user nova-compute[72809]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 (non-flash)
Aug 09 07:00:07 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 07:00:07 user nova-compute[72809]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)
Aug 09 07:00:07 user nova-compute[72809]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 (non-flash)
Aug 09 07:00:07 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc1385cc430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088'): ({'sdd'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Removing single pathed devices sdd {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d803e8-50d1-4097-a81c-7009efe9b724]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b452b87-3038-4438-b6d5-ae68a9f5136b]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Flushing IO for device /dev/sdd {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b92b071-ed1b-4c02-ba13-38397f2e42c6]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[720d8c95-58a3-4766-817b-d8a04a2c314e]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] SCSI volumes sdd have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[406e01dc-b4a5-4c6a-bba1-892464411d5f]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf226e5-4591-41d9-a433-b8b14865c051]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088, portal: 172.16.0.220,3260]
Aug 09 07:00:07 user nova-compute[72809]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088, portal: 172.16.0.220,3260] successful.
Aug 09 07:00:07 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4e0b94-1528-4d71-9813-5eb6ad774ebd]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] <== disconnect_volume: return (285ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Acquiring lock "51432417-89cc-4cee-855d-c4b148e4bd37" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "51432417-89cc-4cee-855d-c4b148e4bd37" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG nova.compute.manager [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 07:00:07 user nova-compute[72809]: INFO nova.compute.claims [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Claim successful on node user
Aug 09 07:00:07 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Refreshing inventories for resource provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Updating ProviderTree inventory for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Updating inventory in ProviderTree for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Refreshing aggregate associations for resource provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3, aggregates: None {{(pid=72809) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 07:00:07 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Refreshing trait associations for resource provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI {{(pid=72809) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 07:00:08 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:00:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:08 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:00:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.607s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:00:08 user nova-compute[72809]: DEBUG nova.compute.manager [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 07:00:08 user nova-compute[72809]: DEBUG nova.compute.manager [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 07:00:08 user nova-compute[72809]: DEBUG nova.network.neutron [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 07:00:08 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 07:00:08 user nova-compute[72809]: DEBUG nova.compute.manager [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 07:00:08 user nova-compute[72809]: DEBUG nova.policy [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ddd99e6c6a034fffa82466ae88ea098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77be39d2ba434d42bd6b08194503031d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 07:00:08 user nova-compute[72809]: DEBUG nova.compute.manager [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 07:00:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 07:00:08 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Creating image(s)
Aug 09 07:00:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Acquiring lock "/opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:00:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "/opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:00:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "/opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:00:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.161s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:00:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:00:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.133s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk 1073741824" returned: 0 in 0.054s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:00:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.143s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:09 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Checking if we can resize image /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 07:00:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:09 user nova-compute[72809]: DEBUG nova.network.neutron [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Successfully created port: f11de67a-407a-46d8-853e-267e19d82001 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 07:00:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:09 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Cannot resize image /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 07:00:09 user nova-compute[72809]: DEBUG nova.objects.instance [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lazy-loading 'migration_context' on Instance uuid 51432417-89cc-4cee-855d-c4b148e4bd37 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:00:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 07:00:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Ensure instance console log exists: /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 07:00:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:00:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:00:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:00:09 user nova-compute[72809]: DEBUG nova.network.neutron [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Successfully updated port: f11de67a-407a-46d8-853e-267e19d82001 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 07:00:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Acquiring lock "refresh_cache-51432417-89cc-4cee-855d-c4b148e4bd37" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:00:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Acquired lock "refresh_cache-51432417-89cc-4cee-855d-c4b148e4bd37" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:00:09 user nova-compute[72809]: DEBUG nova.network.neutron [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:00:09 user nova-compute[72809]: DEBUG nova.compute.manager [req-02ac259a-1fbe-437c-9dfa-07fa1f093316 req-433f53a8-b7cb-4ae2-9547-123653dae34d service nova] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Received event network-changed-f11de67a-407a-46d8-853e-267e19d82001 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:00:09 user nova-compute[72809]: DEBUG nova.compute.manager [req-02ac259a-1fbe-437c-9dfa-07fa1f093316 req-433f53a8-b7cb-4ae2-9547-123653dae34d service nova] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Refreshing instance network info cache due to event network-changed-f11de67a-407a-46d8-853e-267e19d82001. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:00:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-02ac259a-1fbe-437c-9dfa-07fa1f093316 req-433f53a8-b7cb-4ae2-9547-123653dae34d service nova] Acquiring lock "refresh_cache-51432417-89cc-4cee-855d-c4b148e4bd37" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:00:09 user nova-compute[72809]: DEBUG nova.network.neutron [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG nova.network.neutron [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Updating instance_info_cache with network_info: [{"id": "f11de67a-407a-46d8-853e-267e19d82001", "address": "fa:16:3e:a6:83:61", "network": {"id": "aaea335c-52d5-402b-b53c-b53cc3d7385d", "bridge": "br-int", "label": "tempest-TestStampPattern-1348939935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77be39d2ba434d42bd6b08194503031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11de67a-40", "ovs_interfaceid": "f11de67a-407a-46d8-853e-267e19d82001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Releasing lock "refresh_cache-51432417-89cc-4cee-855d-c4b148e4bd37" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG nova.compute.manager [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Instance network_info: |[{"id": "f11de67a-407a-46d8-853e-267e19d82001", "address": "fa:16:3e:a6:83:61", "network": {"id": "aaea335c-52d5-402b-b53c-b53cc3d7385d", "bridge": "br-int", "label": "tempest-TestStampPattern-1348939935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77be39d2ba434d42bd6b08194503031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11de67a-40", "ovs_interfaceid": "f11de67a-407a-46d8-853e-267e19d82001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-02ac259a-1fbe-437c-9dfa-07fa1f093316 req-433f53a8-b7cb-4ae2-9547-123653dae34d service nova] Acquired lock "refresh_cache-51432417-89cc-4cee-855d-c4b148e4bd37" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG nova.network.neutron [req-02ac259a-1fbe-437c-9dfa-07fa1f093316 req-433f53a8-b7cb-4ae2-9547-123653dae34d service nova] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Refreshing network info cache for port f11de67a-407a-46d8-853e-267e19d82001 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Start _get_guest_xml network_info=[{"id": "f11de67a-407a-46d8-853e-267e19d82001", "address": "fa:16:3e:a6:83:61", "network": {"id": "aaea335c-52d5-402b-b53c-b53cc3d7385d", "bridge": "br-int", "label": "tempest-TestStampPattern-1348939935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77be39d2ba434d42bd6b08194503031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11de67a-40", "ovs_interfaceid": "f11de67a-407a-46d8-853e-267e19d82001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 07:00:10 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:00:10 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:00:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:00:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-58730234',display_name='tempest-TestStampPattern-server-58730234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-58730234',id=28,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqS/2/2VeQQ93OP20t6ISd1xMlLR9FaU7uvyMUqE2hZscqHexQxbkOj1PbmtjEvjmecnyXPp9gBYtCCngYh9dMwRjEB6Of/ZdkUz4BqrXPYRgKqiRTv44Mwop2+/V3zEQ==',key_name='tempest-TestStampPattern-1744378759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77be39d2ba434d42bd6b08194503031d',ramdisk_id='',reservation_id='r-ct3mvjcp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1052665161',owner_user_name='tempest-TestStampPattern-1052665161-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:00:08Z,user_data=None,user_id='ddd99e6c6a034fffa82466ae88ea098d',uuid=51432417-89cc-4cee-855d-c4b148e4bd37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f11de67a-407a-46d8-853e-267e19d82001", "address": "fa:16:3e:a6:83:61", "network": {"id": "aaea335c-52d5-402b-b53c-b53cc3d7385d", "bridge": "br-int", "label": "tempest-TestStampPattern-1348939935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77be39d2ba434d42bd6b08194503031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11de67a-40", "ovs_interfaceid": "f11de67a-407a-46d8-853e-267e19d82001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Converting VIF {"id": "f11de67a-407a-46d8-853e-267e19d82001", "address": "fa:16:3e:a6:83:61", "network": {"id": "aaea335c-52d5-402b-b53c-b53cc3d7385d", "bridge": "br-int", "label": "tempest-TestStampPattern-1348939935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77be39d2ba434d42bd6b08194503031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11de67a-40", "ovs_interfaceid": "f11de67a-407a-46d8-853e-267e19d82001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:83:61,bridge_name='br-int',has_traffic_filtering=True,id=f11de67a-407a-46d8-853e-267e19d82001,network=Network(aaea335c-52d5-402b-b53c-b53cc3d7385d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11de67a-40') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG nova.objects.instance [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lazy-loading 'pci_devices' on Instance uuid 51432417-89cc-4cee-855d-c4b148e4bd37 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] End _get_guest_xml xml=<domain type="kvm">
Aug 09 07:00:10 user nova-compute[72809]:   <uuid>51432417-89cc-4cee-855d-c4b148e4bd37</uuid>
Aug 09 07:00:10 user nova-compute[72809]:   <name>instance-0000001c</name>
Aug 09 07:00:10 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 07:00:10 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 07:00:10 user nova-compute[72809]:   <metadata>
Aug 09 07:00:10 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 07:00:10 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 07:00:10 user nova-compute[72809]:       <nova:name>tempest-TestStampPattern-server-58730234</nova:name>
Aug 09 07:00:10 user nova-compute[72809]:       <nova:creationTime>2023-08-09 07:00:10</nova:creationTime>
Aug 09 07:00:10 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 07:00:10 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 07:00:10 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 07:00:10 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 07:00:10 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 07:00:10 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 07:00:10 user nova-compute[72809]:       </nova:flavor>
Aug 09 07:00:10 user nova-compute[72809]:       <nova:owner>
Aug 09 07:00:10 user nova-compute[72809]:         <nova:user uuid="ddd99e6c6a034fffa82466ae88ea098d">tempest-TestStampPattern-1052665161-project-member</nova:user>
Aug 09 07:00:10 user nova-compute[72809]:         <nova:project uuid="77be39d2ba434d42bd6b08194503031d">tempest-TestStampPattern-1052665161</nova:project>
Aug 09 07:00:10 user nova-compute[72809]:       </nova:owner>
Aug 09 07:00:10 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 07:00:10 user nova-compute[72809]:       <nova:ports>
Aug 09 07:00:10 user nova-compute[72809]:         <nova:port uuid="f11de67a-407a-46d8-853e-267e19d82001">
Aug 09 07:00:10 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 07:00:10 user nova-compute[72809]:         </nova:port>
Aug 09 07:00:10 user nova-compute[72809]:       </nova:ports>
Aug 09 07:00:10 user nova-compute[72809]:     </nova:instance>
Aug 09 07:00:10 user nova-compute[72809]:   </metadata>
Aug 09 07:00:10 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 07:00:10 user nova-compute[72809]:     <system>
Aug 09 07:00:10 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 07:00:10 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 07:00:10 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 07:00:10 user nova-compute[72809]:       <entry name="serial">51432417-89cc-4cee-855d-c4b148e4bd37</entry>
Aug 09 07:00:10 user nova-compute[72809]:       <entry name="uuid">51432417-89cc-4cee-855d-c4b148e4bd37</entry>
Aug 09 07:00:10 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 07:00:10 user nova-compute[72809]:     </system>
Aug 09 07:00:10 user nova-compute[72809]:   </sysinfo>
Aug 09 07:00:10 user nova-compute[72809]:   <os>
Aug 09 07:00:10 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 07:00:10 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 07:00:10 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 07:00:10 user nova-compute[72809]:   </os>
Aug 09 07:00:10 user nova-compute[72809]:   <features>
Aug 09 07:00:10 user nova-compute[72809]:     <acpi/>
Aug 09 07:00:10 user nova-compute[72809]:     <apic/>
Aug 09 07:00:10 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 07:00:10 user nova-compute[72809]:   </features>
Aug 09 07:00:10 user nova-compute[72809]:   <clock offset="utc">
Aug 09 07:00:10 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 07:00:10 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 07:00:10 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 07:00:10 user nova-compute[72809]:   </clock>
Aug 09 07:00:10 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 07:00:10 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 07:00:10 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 07:00:10 user nova-compute[72809]:   </cpu>
Aug 09 07:00:10 user nova-compute[72809]:   <devices>
Aug 09 07:00:10 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 07:00:10 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 07:00:10 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk"/>
Aug 09 07:00:10 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 07:00:10 user nova-compute[72809]:     </disk>
Aug 09 07:00:10 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 07:00:10 user nova-compute[72809]:       <mac address="fa:16:3e:a6:83:61"/>
Aug 09 07:00:10 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:00:10 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 07:00:10 user nova-compute[72809]:       <target dev="tapf11de67a-40"/>
Aug 09 07:00:10 user nova-compute[72809]:     </interface>
Aug 09 07:00:10 user nova-compute[72809]:     <serial type="pty">
Aug 09 07:00:10 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/console.log" append="off"/>
Aug 09 07:00:10 user nova-compute[72809]:     </serial>
Aug 09 07:00:10 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 07:00:10 user nova-compute[72809]:     <video>
Aug 09 07:00:10 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:00:10 user nova-compute[72809]:     </video>
Aug 09 07:00:10 user nova-compute[72809]:     <rng model="virtio">
Aug 09 07:00:10 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 07:00:10 user nova-compute[72809]:     </rng>
Aug 09 07:00:10 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 07:00:10 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 07:00:10 user nova-compute[72809]:       <stats period="10"/>
Aug 09 07:00:10 user nova-compute[72809]:     </memballoon>
Aug 09 07:00:10 user nova-compute[72809]:   </devices>
Aug 09 07:00:10 user nova-compute[72809]: </domain>
Aug 09 07:00:10 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:00:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-58730234',display_name='tempest-TestStampPattern-server-58730234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-58730234',id=28,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqS/2/2VeQQ93OP20t6ISd1xMlLR9FaU7uvyMUqE2hZscqHexQxbkOj1PbmtjEvjmecnyXPp9gBYtCCngYh9dMwRjEB6Of/ZdkUz4BqrXPYRgKqiRTv44Mwop2+/V3zEQ==',key_name='tempest-TestStampPattern-1744378759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77be39d2ba434d42bd6b08194503031d',ramdisk_id='',reservation_id='r-ct3mvjcp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1052665161',owner_user_name='tempest-TestStampPattern-1052665161-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:00:08Z,user_data=None,user_id='ddd99e6c6a034fffa82466ae88ea098d',uuid=51432417-89cc-4cee-855d-c4b148e4bd37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f11de67a-407a-46d8-853e-267e19d82001", "address": "fa:16:3e:a6:83:61", "network": {"id": "aaea335c-52d5-402b-b53c-b53cc3d7385d", "bridge": "br-int", "label": "tempest-TestStampPattern-1348939935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77be39d2ba434d42bd6b08194503031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11de67a-40", "ovs_interfaceid": "f11de67a-407a-46d8-853e-267e19d82001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Converting VIF {"id": "f11de67a-407a-46d8-853e-267e19d82001", "address": "fa:16:3e:a6:83:61", "network": {"id": "aaea335c-52d5-402b-b53c-b53cc3d7385d", "bridge": "br-int", "label": "tempest-TestStampPattern-1348939935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77be39d2ba434d42bd6b08194503031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11de67a-40", "ovs_interfaceid": "f11de67a-407a-46d8-853e-267e19d82001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:83:61,bridge_name='br-int',has_traffic_filtering=True,id=f11de67a-407a-46d8-853e-267e19d82001,network=Network(aaea335c-52d5-402b-b53c-b53cc3d7385d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11de67a-40') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG os_vif [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:83:61,bridge_name='br-int',has_traffic_filtering=True,id=f11de67a-407a-46d8-853e-267e19d82001,network=Network(aaea335c-52d5-402b-b53c-b53cc3d7385d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11de67a-40') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf11de67a-40, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf11de67a-40, col_values=(('external_ids', {'iface-id': 'f11de67a-407a-46d8-853e-267e19d82001', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:83:61', 'vm-uuid': '51432417-89cc-4cee-855d-c4b148e4bd37'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:10 user nova-compute[72809]: INFO os_vif [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:83:61,bridge_name='br-int',has_traffic_filtering=True,id=f11de67a-407a-46d8-853e-267e19d82001,network=Network(aaea335c-52d5-402b-b53c-b53cc3d7385d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11de67a-40')
Aug 09 07:00:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] No VIF found with MAC fa:16:3e:a6:83:61, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG nova.network.neutron [req-02ac259a-1fbe-437c-9dfa-07fa1f093316 req-433f53a8-b7cb-4ae2-9547-123653dae34d service nova] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Updated VIF entry in instance network info cache for port f11de67a-407a-46d8-853e-267e19d82001. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG nova.network.neutron [req-02ac259a-1fbe-437c-9dfa-07fa1f093316 req-433f53a8-b7cb-4ae2-9547-123653dae34d service nova] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Updating instance_info_cache with network_info: [{"id": "f11de67a-407a-46d8-853e-267e19d82001", "address": "fa:16:3e:a6:83:61", "network": {"id": "aaea335c-52d5-402b-b53c-b53cc3d7385d", "bridge": "br-int", "label": "tempest-TestStampPattern-1348939935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77be39d2ba434d42bd6b08194503031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11de67a-40", "ovs_interfaceid": "f11de67a-407a-46d8-853e-267e19d82001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:00:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-02ac259a-1fbe-437c-9dfa-07fa1f093316 req-433f53a8-b7cb-4ae2-9547-123653dae34d service nova] Releasing lock "refresh_cache-51432417-89cc-4cee-855d-c4b148e4bd37" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:00:11 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:11 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:11 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:11 user nova-compute[72809]: DEBUG nova.compute.manager [req-92c523d9-5fb6-4817-af98-09c1942d23a0 req-fc2674c0-b5cd-406d-b9b4-72f91c896bfb service nova] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Received event network-vif-plugged-f11de67a-407a-46d8-853e-267e19d82001 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:00:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-92c523d9-5fb6-4817-af98-09c1942d23a0 req-fc2674c0-b5cd-406d-b9b4-72f91c896bfb service nova] Acquiring lock "51432417-89cc-4cee-855d-c4b148e4bd37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:00:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-92c523d9-5fb6-4817-af98-09c1942d23a0 req-fc2674c0-b5cd-406d-b9b4-72f91c896bfb service nova] Lock "51432417-89cc-4cee-855d-c4b148e4bd37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:00:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-92c523d9-5fb6-4817-af98-09c1942d23a0 req-fc2674c0-b5cd-406d-b9b4-72f91c896bfb service nova] Lock "51432417-89cc-4cee-855d-c4b148e4bd37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:00:11 user nova-compute[72809]: DEBUG nova.compute.manager [req-92c523d9-5fb6-4817-af98-09c1942d23a0 req-fc2674c0-b5cd-406d-b9b4-72f91c896bfb service nova] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] No waiting events found dispatching network-vif-plugged-f11de67a-407a-46d8-853e-267e19d82001 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:00:11 user nova-compute[72809]: WARNING nova.compute.manager [req-92c523d9-5fb6-4817-af98-09c1942d23a0 req-fc2674c0-b5cd-406d-b9b4-72f91c896bfb service nova] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Received unexpected event network-vif-plugged-f11de67a-407a-46d8-853e-267e19d82001 for instance with vm_state building and task_state spawning.
Aug 09 07:00:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 07:00:13 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Creating image(s)
Aug 09 07:00:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Did not create local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Ensure instance console log exists: /opt/stack/data/nova/instances/25943f41-2d28-4ffe-b38b-ae34a99426e1/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Start _get_guest_xml network_info=[{"id": "eaaf2699-4583-4421-872a-117e799570e5", "address": "fa:16:3e:47:32:ed", "network": {"id": "514e9a73-337b-46a7-b516-df614914735a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-23845660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b76be74ac2b46049686e6fdcef82dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf2699-45", "ovs_interfaceid": "eaaf2699-4583-4421-872a-117e799570e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXAPdNUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '25943f41-2d28-4ffe-b38b-ae34a99426e1', 'attached_at': '', 'detached_at': '', 'volume_id': '63dec66c-f14e-46ac-becb-481479048521', 'serial': '63dec66c-f14e-46ac-becb-481479048521'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'boot_index': 0, 'attachment_id': '957c1919-b45c-4402-80b6-32c3d1077cda', 'volume_type': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 07:00:13 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 07:00:13 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 07:00:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG nova.objects.instance [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lazy-loading 'vcpu_model' on Instance uuid 25943f41-2d28-4ffe-b38b-ae34a99426e1 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXAPdNUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:00:13 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 07:00:13 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:00:13 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 07:00:13 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:00:13 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 07:00:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564413.9552023, 51432417-89cc-4cee-855d-c4b148e4bd37 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:00:13 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] VM Resumed (Lifecycle Event)
Aug 09 07:00:13 user nova-compute[72809]: DEBUG nova.compute.manager [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf12ed7-e826-4b0a-8f57-e3391e9deb5f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 07:00:13 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:13 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Instance spawned successfully.
Aug 09 07:00:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG nova.objects.instance [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lazy-loading 'flavor' on Instance uuid 6d210e25-aa29-40a5-ad99-27e54a51dd7a {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf3ceee-ac3f-474e-a812-09f88919679d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG nova.compute.manager [req-b464e162-850e-4659-b529-84af50075ec2 req-aef5420e-3083-4128-be15-2cca10d88968 service nova] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Received event network-vif-plugged-f11de67a-407a-46d8-853e-267e19d82001 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b464e162-850e-4659-b529-84af50075ec2 req-aef5420e-3083-4128-be15-2cca10d88968 service nova] Acquiring lock "51432417-89cc-4cee-855d-c4b148e4bd37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b464e162-850e-4659-b529-84af50075ec2 req-aef5420e-3083-4128-be15-2cca10d88968 service nova] Lock "51432417-89cc-4cee-855d-c4b148e4bd37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b464e162-850e-4659-b529-84af50075ec2 req-aef5420e-3083-4128-be15-2cca10d88968 service nova] Lock "51432417-89cc-4cee-855d-c4b148e4bd37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:00:13 user nova-compute[72809]: DEBUG nova.compute.manager [req-b464e162-850e-4659-b529-84af50075ec2 req-aef5420e-3083-4128-be15-2cca10d88968 service nova] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] No waiting events found dispatching network-vif-plugged-f11de67a-407a-46d8-853e-267e19d82001 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:00:13 user nova-compute[72809]: WARNING nova.compute.manager [req-b464e162-850e-4659-b529-84af50075ec2 req-aef5420e-3083-4128-be15-2cca10d88968 service nova] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Received unexpected event network-vif-plugged-f11de67a-407a-46d8-853e-267e19d82001 for instance with vm_state building and task_state spawning.
Aug 09 07:00:13 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521] added
Aug 09 07:00:13 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a30272-319d-4371-9fc9-9d23635256ab]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9f237649-4a07-4ecb-86eb-b216890464f9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "6d210e25-aa29-40a5-ad99-27e54a51dd7a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.493s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "6d210e25-aa29-40a5-ad99-27e54a51dd7a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 7.358s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquiring lock "6d210e25-aa29-40a5-ad99-27e54a51dd7a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "6d210e25-aa29-40a5-ad99-27e54a51dd7a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "6d210e25-aa29-40a5-ad99-27e54a51dd7a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:00:14 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:00:14 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564413.9554741, 51432417-89cc-4cee-855d-c4b148e4bd37 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:00:14 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] VM Started (Lifecycle Event)
Aug 09 07:00:14 user nova-compute[72809]: INFO nova.compute.manager [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Terminating instance
Aug 09 07:00:14 user nova-compute[72809]: DEBUG nova.compute.manager [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[002f9317-1c18-49dc-8ebf-e6d613a4ed4e]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DXAPdNUJ {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DXAPdNUJ" returned: 0 in 0.027s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde6d276-0203-44a2-a2f2-0ed6498abbb0]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DXAPdNUJ'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:00:14 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:00:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:14 user nova-compute[72809]: INFO nova.compute.manager [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Took 5.55 seconds to spawn the instance on the hypervisor.
Aug 09 07:00:14 user nova-compute[72809]: DEBUG nova.compute.manager [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca246443-0154-46cf-af5c-dcfc6675daee]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c41f09e-fb83-4939-af62-77a716c9ee7a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 07:00:14 user nova-compute[72809]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)
Aug 09 07:00:14 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 07:00:14 user nova-compute[72809]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)
Aug 09 07:00:14 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:14 user nova-compute[72809]: INFO nova.compute.manager [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Took 6.50 seconds to build instance.
Aug 09 07:00:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abcd400-bc21-48ea-8130-856d2234501c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521, portal: 172.16.0.220,3260]
Aug 09 07:00:14 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521, portal: 172.16.0.220,3260] successful.
Aug 09 07:00:14 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-42ce37fa-eb23-408c-8eee-2af101e677f7 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "51432417-89cc-4cee-855d-c4b148e4bd37" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.603s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[59084cd5-6f41-465a-a3c8-38830c5e1887]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a3aa6f-7235-4eee-92ad-24d117c3f2a2]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 07:00:14 user nova-compute[72809]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)
Aug 09 07:00:14 user nova-compute[72809]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 07:00:14 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 07:00:14 user nova-compute[72809]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)
Aug 09 07:00:14 user nova-compute[72809]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 07:00:14 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76dc545-af8e-4741-8471-0425872868eb]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXAPdNUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 07:00:14 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Instance destroyed successfully.
Aug 09 07:00:14 user nova-compute[72809]: DEBUG nova.objects.instance [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lazy-loading 'resources' on Instance uuid 6d210e25-aa29-40a5-ad99-27e54a51dd7a {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:56:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1705077597',display_name='tempest-VolumesSnapshotTestJSON-instance-1705077597',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1705077597',id=21,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmBzWuN9YAlVUXZ78dlLpVz2jDo6e+cwdcghKhC7Jw8Tg31xweUVMVvsm8ADEDDKY2gTpfz95vDn16G4HPtSeRXlbQtZc0g5xZO+CCYTQHnLqFXjj+ePS2O06qcds1aWw==',key_name='tempest-keypair-926098464',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:57:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f76e442312164689bdd7686973d25eda',ramdisk_id='',reservation_id='r-3lraetbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1130129930',owner_user_name='tempest-VolumesSnapshotTestJSON-1130129930-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:57:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9b206fdca44420984d9c279db01ef1b',uuid=6d210e25-aa29-40a5-ad99-27e54a51dd7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "245f99b8-570d-4077-b3ca-f05f03b309f2", "address": "fa:16:3e:53:81:3e", "network": {"id": "ae760578-06b0-479a-9f75-b5e781b1a087", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-541750148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76e442312164689bdd7686973d25eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245f99b8-57", "ovs_interfaceid": "245f99b8-570d-4077-b3ca-f05f03b309f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Converting VIF {"id": "245f99b8-570d-4077-b3ca-f05f03b309f2", "address": "fa:16:3e:53:81:3e", "network": {"id": "ae760578-06b0-479a-9f75-b5e781b1a087", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-541750148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76e442312164689bdd7686973d25eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245f99b8-57", "ovs_interfaceid": "245f99b8-570d-4077-b3ca-f05f03b309f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:81:3e,bridge_name='br-int',has_traffic_filtering=True,id=245f99b8-570d-4077-b3ca-f05f03b309f2,network=Network(ae760578-06b0-479a-9f75-b5e781b1a087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap245f99b8-57') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG os_vif [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:81:3e,bridge_name='br-int',has_traffic_filtering=True,id=245f99b8-570d-4077-b3ca-f05f03b309f2,network=Network(ae760578-06b0-479a-9f75-b5e781b1a087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap245f99b8-57') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap245f99b8-57, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:00:14 user nova-compute[72809]: INFO os_vif [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:81:3e,bridge_name='br-int',has_traffic_filtering=True,id=245f99b8-570d-4077-b3ca-f05f03b309f2,network=Network(ae760578-06b0-479a-9f75-b5e781b1a087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap245f99b8-57')
Aug 09 07:00:14 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:00:14 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iUnMqhej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:00:14 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:00:14 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26464653164376464', 'path': '/dev/sdd'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464653164376464', 'path': '/dev/sdd'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.451s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be0a75df-172a-4e65-8eeb-1785aa48c088', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3faeb0-95db-48a0-a80b-8b21492bfcfe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T06:57:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1510155707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-746793904',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaQ4scRY1Gs40gnfMXMH9+94YnOoay8Xk4x1JUX9Bi5t92OrKSGMiljWmXUj+GTELgNUptiW7m1t9tJjH9WklkC4tVBDCva2tyGVNhU3VtR7ORGer1lOM2KxVeRyFujXA==',key_name='tempest-keypair-1187965605',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:57:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3b76be74ac2b46049686e6fdcef82dbb',ramdisk_id='',reservation_id='r-y0g6fmqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1383955831',owner_user_name='tempest-ServerActionsV293TestJSON-1383955831-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:59:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66208d0453c0457ea5402ee892558f33',uuid=25943f41-2d28-4ffe-b38b-ae34a99426e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eaaf2699-4583-4421-872a-117e799570e5", "address": "fa:16:3e:47:32:ed", "network": {"id": "514e9a73-337b-46a7-b516-df614914735a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-23845660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b76be74ac2b46049686e6fdcef82dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf2699-45", "ovs_interfaceid": "eaaf2699-4583-4421-872a-117e799570e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Converting VIF {"id": "eaaf2699-4583-4421-872a-117e799570e5", "address": "fa:16:3e:47:32:ed", "network": {"id": "514e9a73-337b-46a7-b516-df614914735a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-23845660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b76be74ac2b46049686e6fdcef82dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf2699-45", "ovs_interfaceid": "eaaf2699-4583-4421-872a-117e799570e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:32:ed,bridge_name='br-int',has_traffic_filtering=True,id=eaaf2699-4583-4421-872a-117e799570e5,network=Network(514e9a73-337b-46a7-b516-df614914735a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaaf2699-45') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] End _get_guest_xml xml=<domain type="kvm">
Aug 09 07:00:15 user nova-compute[72809]:   <uuid>25943f41-2d28-4ffe-b38b-ae34a99426e1</uuid>
Aug 09 07:00:15 user nova-compute[72809]:   <name>instance-00000017</name>
Aug 09 07:00:15 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 07:00:15 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 07:00:15 user nova-compute[72809]:   <metadata>
Aug 09 07:00:15 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 07:00:15 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 07:00:15 user nova-compute[72809]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1510155707</nova:name>
Aug 09 07:00:15 user nova-compute[72809]:       <nova:creationTime>2023-08-09 07:00:13</nova:creationTime>
Aug 09 07:00:15 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 07:00:15 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 07:00:15 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 07:00:15 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 07:00:15 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 07:00:15 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 07:00:15 user nova-compute[72809]:       </nova:flavor>
Aug 09 07:00:15 user nova-compute[72809]:       <nova:owner>
Aug 09 07:00:15 user nova-compute[72809]:         <nova:user uuid="66208d0453c0457ea5402ee892558f33">tempest-ServerActionsV293TestJSON-1383955831-project-member</nova:user>
Aug 09 07:00:15 user nova-compute[72809]:         <nova:project uuid="3b76be74ac2b46049686e6fdcef82dbb">tempest-ServerActionsV293TestJSON-1383955831</nova:project>
Aug 09 07:00:15 user nova-compute[72809]:       </nova:owner>
Aug 09 07:00:15 user nova-compute[72809]:       <nova:ports>
Aug 09 07:00:15 user nova-compute[72809]:         <nova:port uuid="eaaf2699-4583-4421-872a-117e799570e5">
Aug 09 07:00:15 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 07:00:15 user nova-compute[72809]:         </nova:port>
Aug 09 07:00:15 user nova-compute[72809]:       </nova:ports>
Aug 09 07:00:15 user nova-compute[72809]:     </nova:instance>
Aug 09 07:00:15 user nova-compute[72809]:   </metadata>
Aug 09 07:00:15 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 07:00:15 user nova-compute[72809]:     <system>
Aug 09 07:00:15 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 07:00:15 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 07:00:15 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 07:00:15 user nova-compute[72809]:       <entry name="serial">25943f41-2d28-4ffe-b38b-ae34a99426e1</entry>
Aug 09 07:00:15 user nova-compute[72809]:       <entry name="uuid">25943f41-2d28-4ffe-b38b-ae34a99426e1</entry>
Aug 09 07:00:15 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 07:00:15 user nova-compute[72809]:     </system>
Aug 09 07:00:15 user nova-compute[72809]:   </sysinfo>
Aug 09 07:00:15 user nova-compute[72809]:   <os>
Aug 09 07:00:15 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 07:00:15 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 07:00:15 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 07:00:15 user nova-compute[72809]:   </os>
Aug 09 07:00:15 user nova-compute[72809]:   <features>
Aug 09 07:00:15 user nova-compute[72809]:     <acpi/>
Aug 09 07:00:15 user nova-compute[72809]:     <apic/>
Aug 09 07:00:15 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 07:00:15 user nova-compute[72809]:   </features>
Aug 09 07:00:15 user nova-compute[72809]:   <clock offset="utc">
Aug 09 07:00:15 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 07:00:15 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 07:00:15 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 07:00:15 user nova-compute[72809]:   </clock>
Aug 09 07:00:15 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 07:00:15 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 07:00:15 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 07:00:15 user nova-compute[72809]:   </cpu>
Aug 09 07:00:15 user nova-compute[72809]:   <devices>
Aug 09 07:00:15 user nova-compute[72809]:     <disk type="block" device="disk">
Aug 09 07:00:15 user nova-compute[72809]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:00:15 user nova-compute[72809]:       <source dev="/dev/sdd"/>
Aug 09 07:00:15 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 07:00:15 user nova-compute[72809]:       <serial>63dec66c-f14e-46ac-becb-481479048521</serial>
Aug 09 07:00:15 user nova-compute[72809]:     </disk>
Aug 09 07:00:15 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 07:00:15 user nova-compute[72809]:       <mac address="fa:16:3e:47:32:ed"/>
Aug 09 07:00:15 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:00:15 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 07:00:15 user nova-compute[72809]:       <target dev="tapeaaf2699-45"/>
Aug 09 07:00:15 user nova-compute[72809]:     </interface>
Aug 09 07:00:15 user nova-compute[72809]:     <serial type="pty">
Aug 09 07:00:15 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/25943f41-2d28-4ffe-b38b-ae34a99426e1/console.log" append="off"/>
Aug 09 07:00:15 user nova-compute[72809]:     </serial>
Aug 09 07:00:15 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 07:00:15 user nova-compute[72809]:     <video>
Aug 09 07:00:15 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:00:15 user nova-compute[72809]:     </video>
Aug 09 07:00:15 user nova-compute[72809]:     <rng model="virtio">
Aug 09 07:00:15 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 07:00:15 user nova-compute[72809]:     </rng>
Aug 09 07:00:15 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 07:00:15 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 07:00:15 user nova-compute[72809]:       <stats period="10"/>
Aug 09 07:00:15 user nova-compute[72809]:     </memballoon>
Aug 09 07:00:15 user nova-compute[72809]:   </devices>
Aug 09 07:00:15 user nova-compute[72809]: </domain>
Aug 09 07:00:15 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T06:57:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1510155707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-746793904',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaQ4scRY1Gs40gnfMXMH9+94YnOoay8Xk4x1JUX9Bi5t92OrKSGMiljWmXUj+GTELgNUptiW7m1t9tJjH9WklkC4tVBDCva2tyGVNhU3VtR7ORGer1lOM2KxVeRyFujXA==',key_name='tempest-keypair-1187965605',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:57:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3b76be74ac2b46049686e6fdcef82dbb',ramdisk_id='',reservation_id='r-y0g6fmqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1383955831',owner_user_name='tempest-ServerActionsV293TestJSON-1383955831-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:59:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66208d0453c0457ea5402ee892558f33',uuid=25943f41-2d28-4ffe-b38b-ae34a99426e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eaaf2699-4583-4421-872a-117e799570e5", "address": "fa:16:3e:47:32:ed", "network": {"id": "514e9a73-337b-46a7-b516-df614914735a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-23845660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b76be74ac2b46049686e6fdcef82dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf2699-45", "ovs_interfaceid": "eaaf2699-4583-4421-872a-117e799570e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Converting VIF {"id": "eaaf2699-4583-4421-872a-117e799570e5", "address": "fa:16:3e:47:32:ed", "network": {"id": "514e9a73-337b-46a7-b516-df614914735a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-23845660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b76be74ac2b46049686e6fdcef82dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf2699-45", "ovs_interfaceid": "eaaf2699-4583-4421-872a-117e799570e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:32:ed,bridge_name='br-int',has_traffic_filtering=True,id=eaaf2699-4583-4421-872a-117e799570e5,network=Network(514e9a73-337b-46a7-b516-df614914735a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaaf2699-45') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG os_vif [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:32:ed,bridge_name='br-int',has_traffic_filtering=True,id=eaaf2699-4583-4421-872a-117e799570e5,network=Network(514e9a73-337b-46a7-b516-df614914735a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaaf2699-45') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2171084-08f4-4ab3-8aae-f29597bf688c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 07:00:15 user nova-compute[72809]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)
Aug 09 07:00:15 user nova-compute[72809]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 07:00:15 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 07:00:15 user nova-compute[72809]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)
Aug 09 07:00:15 user nova-compute[72809]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 07:00:15 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc1385cff40>, {}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Disconnecting from: [] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.055s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] <== disconnect_volume: return (506ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:00:15 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Deleting instance files /opt/stack/data/nova/instances/6d210e25-aa29-40a5-ad99-27e54a51dd7a_del
Aug 09 07:00:15 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Deletion of /opt/stack/data/nova/instances/6d210e25-aa29-40a5-ad99-27e54a51dd7a_del complete
Aug 09 07:00:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeaaf2699-45, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeaaf2699-45, col_values=(('external_ids', {'iface-id': 'eaaf2699-4583-4421-872a-117e799570e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:32:ed', 'vm-uuid': '25943f41-2d28-4ffe-b38b-ae34a99426e1'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:15 user nova-compute[72809]: INFO os_vif [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:32:ed,bridge_name='br-int',has_traffic_filtering=True,id=eaaf2699-4583-4421-872a-117e799570e5,network=Network(514e9a73-337b-46a7-b516-df614914735a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaaf2699-45')
Aug 09 07:00:15 user nova-compute[72809]: INFO nova.compute.manager [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Took 1.39 seconds to destroy the instance on the hypervisor.
Aug 09 07:00:15 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:00:15 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] No VIF found with MAC fa:16:3e:47:32:ed, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:00:16 user nova-compute[72809]: DEBUG nova.compute.manager [req-31d52c7c-6a7b-47de-b41e-4483ff45085f req-6a4cff5c-358c-49c3-9192-7f850ed079ce service nova] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Received event network-vif-unplugged-245f99b8-570d-4077-b3ca-f05f03b309f2 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:00:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-31d52c7c-6a7b-47de-b41e-4483ff45085f req-6a4cff5c-358c-49c3-9192-7f850ed079ce service nova] Acquiring lock "6d210e25-aa29-40a5-ad99-27e54a51dd7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:00:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-31d52c7c-6a7b-47de-b41e-4483ff45085f req-6a4cff5c-358c-49c3-9192-7f850ed079ce service nova] Lock "6d210e25-aa29-40a5-ad99-27e54a51dd7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:00:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-31d52c7c-6a7b-47de-b41e-4483ff45085f req-6a4cff5c-358c-49c3-9192-7f850ed079ce service nova] Lock "6d210e25-aa29-40a5-ad99-27e54a51dd7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:00:16 user nova-compute[72809]: DEBUG nova.compute.manager [req-31d52c7c-6a7b-47de-b41e-4483ff45085f req-6a4cff5c-358c-49c3-9192-7f850ed079ce service nova] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] No waiting events found dispatching network-vif-unplugged-245f99b8-570d-4077-b3ca-f05f03b309f2 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:00:16 user nova-compute[72809]: DEBUG nova.compute.manager [req-31d52c7c-6a7b-47de-b41e-4483ff45085f req-6a4cff5c-358c-49c3-9192-7f850ed079ce service nova] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Received event network-vif-unplugged-245f99b8-570d-4077-b3ca-f05f03b309f2 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:00:16 user nova-compute[72809]: DEBUG nova.compute.manager [req-31d52c7c-6a7b-47de-b41e-4483ff45085f req-6a4cff5c-358c-49c3-9192-7f850ed079ce service nova] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Received event network-vif-plugged-245f99b8-570d-4077-b3ca-f05f03b309f2 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:00:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-31d52c7c-6a7b-47de-b41e-4483ff45085f req-6a4cff5c-358c-49c3-9192-7f850ed079ce service nova] Acquiring lock "6d210e25-aa29-40a5-ad99-27e54a51dd7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:00:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-31d52c7c-6a7b-47de-b41e-4483ff45085f req-6a4cff5c-358c-49c3-9192-7f850ed079ce service nova] Lock "6d210e25-aa29-40a5-ad99-27e54a51dd7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:00:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-31d52c7c-6a7b-47de-b41e-4483ff45085f req-6a4cff5c-358c-49c3-9192-7f850ed079ce service nova] Lock "6d210e25-aa29-40a5-ad99-27e54a51dd7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:00:16 user nova-compute[72809]: DEBUG nova.compute.manager [req-31d52c7c-6a7b-47de-b41e-4483ff45085f req-6a4cff5c-358c-49c3-9192-7f850ed079ce service nova] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] No waiting events found dispatching network-vif-plugged-245f99b8-570d-4077-b3ca-f05f03b309f2 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:00:16 user nova-compute[72809]: WARNING nova.compute.manager [req-31d52c7c-6a7b-47de-b41e-4483ff45085f req-6a4cff5c-358c-49c3-9192-7f850ed079ce service nova] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Received unexpected event network-vif-plugged-245f99b8-570d-4077-b3ca-f05f03b309f2 for instance with vm_state active and task_state deleting.
Aug 09 07:00:16 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:00:16 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Took 0.85 seconds to deallocate network for instance.
Aug 09 07:00:16 user nova-compute[72809]: DEBUG nova.compute.manager [req-538adfc6-a5c1-41b8-ad6f-454c3b58547e req-0e615ffd-c76b-4710-a931-4604c3bfde79 service nova] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Received event network-vif-deleted-245f99b8-570d-4077-b3ca-f05f03b309f2 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:00:16 user nova-compute[72809]: INFO nova.compute.manager [req-538adfc6-a5c1-41b8-ad6f-454c3b58547e req-0e615ffd-c76b-4710-a931-4604c3bfde79 service nova] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Neutron deleted interface 245f99b8-570d-4077-b3ca-f05f03b309f2; detaching it from the instance and deleting it from the info cache
Aug 09 07:00:16 user nova-compute[72809]: DEBUG nova.network.neutron [req-538adfc6-a5c1-41b8-ad6f-454c3b58547e req-0e615ffd-c76b-4710-a931-4604c3bfde79 service nova] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:00:16 user nova-compute[72809]: DEBUG nova.compute.manager [req-538adfc6-a5c1-41b8-ad6f-454c3b58547e req-0e615ffd-c76b-4710-a931-4604c3bfde79 service nova] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Detach interface failed, port_id=245f99b8-570d-4077-b3ca-f05f03b309f2, reason: Instance 6d210e25-aa29-40a5-ad99-27e54a51dd7a could not be found. {{(pid=72809) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 07:00:16 user nova-compute[72809]: WARNING nova.volume.cinder [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Attachment 6075ac8e-7f87-4b40-a96b-d8c884a234b5 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 6075ac8e-7f87-4b40-a96b-d8c884a234b5. (HTTP 404) (Request-ID: req-69dd9038-c4db-47c8-9b4b-aa456578c5a7)
Aug 09 07:00:16 user nova-compute[72809]: INFO nova.compute.manager [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Took 0.05 seconds to detach 1 volumes for instance.
Aug 09 07:00:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:00:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:00:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:16 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:00:16 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:00:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.477s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:00:16 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Deleted allocations for instance 6d210e25-aa29-40a5-ad99-27e54a51dd7a
Aug 09 07:00:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-27341049-c516-4692-a5d2-f3a345bbf7a9 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "6d210e25-aa29-40a5-ad99-27e54a51dd7a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.024s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:00:17 user nova-compute[72809]: DEBUG nova.compute.manager [req-1ffcd47d-e27e-4186-9c80-499d1ace29bd req-424e30f7-ce27-4c42-a017-3ff30276bc5c service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Received event network-vif-plugged-eaaf2699-4583-4421-872a-117e799570e5 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:00:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1ffcd47d-e27e-4186-9c80-499d1ace29bd req-424e30f7-ce27-4c42-a017-3ff30276bc5c service nova] Acquiring lock "25943f41-2d28-4ffe-b38b-ae34a99426e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:00:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1ffcd47d-e27e-4186-9c80-499d1ace29bd req-424e30f7-ce27-4c42-a017-3ff30276bc5c service nova] Lock "25943f41-2d28-4ffe-b38b-ae34a99426e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:00:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1ffcd47d-e27e-4186-9c80-499d1ace29bd req-424e30f7-ce27-4c42-a017-3ff30276bc5c service nova] Lock "25943f41-2d28-4ffe-b38b-ae34a99426e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:00:17 user nova-compute[72809]: DEBUG nova.compute.manager [req-1ffcd47d-e27e-4186-9c80-499d1ace29bd req-424e30f7-ce27-4c42-a017-3ff30276bc5c service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] No waiting events found dispatching network-vif-plugged-eaaf2699-4583-4421-872a-117e799570e5 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:00:17 user nova-compute[72809]: WARNING nova.compute.manager [req-1ffcd47d-e27e-4186-9c80-499d1ace29bd req-424e30f7-ce27-4c42-a017-3ff30276bc5c service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Received unexpected event network-vif-plugged-eaaf2699-4583-4421-872a-117e799570e5 for instance with vm_state active and task_state rebuild_spawning.
Aug 09 07:00:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "5251cef4-9a49-4220-984e-75d1198f95b6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:00:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "5251cef4-9a49-4220-984e-75d1198f95b6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:00:17 user nova-compute[72809]: INFO nova.compute.manager [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Detaching volume a4d75678-22d8-484d-abf4-58ef866de6bf
Aug 09 07:00:17 user nova-compute[72809]: INFO nova.virt.block_device [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Attempting to driver detach volume a4d75678-22d8-484d-abf4-58ef866de6bf from mountpoint /dev/vdb
Aug 09 07:00:17 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Attempting to detach device vdb from instance 5251cef4-9a49-4220-984e-75d1198f95b6 from the persistent domain config. {{(pid=72809) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 07:00:17 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:00:17 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:00:17 user nova-compute[72809]:   <source dev="/dev/sdb"/>
Aug 09 07:00:17 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:00:17 user nova-compute[72809]:   <serial>a4d75678-22d8-484d-abf4-58ef866de6bf</serial>
Aug 09 07:00:17 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 07:00:17 user nova-compute[72809]: </disk>
Aug 09 07:00:17 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:00:17 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Successfully detached device vdb from instance 5251cef4-9a49-4220-984e-75d1198f95b6 from the persistent domain config.
Aug 09 07:00:17 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5251cef4-9a49-4220-984e-75d1198f95b6 from the live domain config. {{(pid=72809) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 07:00:17 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:00:17 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:00:17 user nova-compute[72809]:   <source dev="/dev/sdb"/>
Aug 09 07:00:17 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:00:17 user nova-compute[72809]:   <serial>a4d75678-22d8-484d-abf4-58ef866de6bf</serial>
Aug 09 07:00:17 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 07:00:17 user nova-compute[72809]: </disk>
Aug 09 07:00:17 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Received event <DeviceRemovedEvent: 1691564418.2803159, 5251cef4-9a49-4220-984e-75d1198f95b6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72809) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5251cef4-9a49-4220-984e-75d1198f95b6 {{(pid=72809) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 07:00:18 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Successfully detached device vdb from instance 5251cef4-9a49-4220-984e-75d1198f95b6 from the live domain config.
Aug 09 07:00:18 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mBbdJqfA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:00:18 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:00:18 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b51b4d2-a05b-4fc8-b2eb-d22cadebe270]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd50b4cb-f7a2-495d-bb68-3a77cc0e4463]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 07:00:18 user nova-compute[72809]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)
Aug 09 07:00:18 user nova-compute[72809]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 07:00:18 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf (non-flash)
Aug 09 07:00:18 user nova-compute[72809]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)
Aug 09 07:00:18 user nova-compute[72809]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 07:00:18 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc138712710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf'): ({'sdb'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Removing single pathed devices sdb {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72dd933-28ac-4b81-a963-34b8f73d177a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96cd816-eb83-460a-92c0-7340c4b3c3b9]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Flushing IO for device /dev/sdb {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe445569-8456-4c20-80fa-179f83bddce6]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb720cc1-73ed-4f6b-82cb-43989899d8bc]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] SCSI volumes sdb have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dde910b-4612-4724-b40d-9412c7cf5c56]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e6219c-e0f1-4251-b908-2a7e25591596]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf, portal: 172.16.0.220,3260]
Aug 09 07:00:18 user nova-compute[72809]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf, portal: 172.16.0.220,3260] successful.
Aug 09 07:00:18 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4d75678-22d8-484d-abf4-58ef866de6bf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e46372-1d8d-422f-b658-b47ae748697f]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] <== disconnect_volume: return (273ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:00:18 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:00:19 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564419.0540342, 25943f41-2d28-4ffe-b38b-ae34a99426e1 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:00:19 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] VM Resumed (Lifecycle Event)
Aug 09 07:00:19 user nova-compute[72809]: DEBUG nova.compute.manager [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 07:00:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 07:00:19 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Instance spawned successfully.
Aug 09 07:00:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 07:00:19 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:00:19 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:00:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:00:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:00:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:00:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:00:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:00:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:00:19 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 07:00:19 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564419.0553076, 25943f41-2d28-4ffe-b38b-ae34a99426e1 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:00:19 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] VM Started (Lifecycle Event)
Aug 09 07:00:19 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:00:19 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:00:19 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 07:00:19 user nova-compute[72809]: DEBUG nova.compute.manager [req-a75f1427-0f29-443a-b90e-e4d291d4b4b7 req-9035929c-09bf-4a38-b49a-a886589cd5e4 service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Received event network-vif-plugged-eaaf2699-4583-4421-872a-117e799570e5 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:00:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a75f1427-0f29-443a-b90e-e4d291d4b4b7 req-9035929c-09bf-4a38-b49a-a886589cd5e4 service nova] Acquiring lock "25943f41-2d28-4ffe-b38b-ae34a99426e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:00:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a75f1427-0f29-443a-b90e-e4d291d4b4b7 req-9035929c-09bf-4a38-b49a-a886589cd5e4 service nova] Lock "25943f41-2d28-4ffe-b38b-ae34a99426e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:00:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a75f1427-0f29-443a-b90e-e4d291d4b4b7 req-9035929c-09bf-4a38-b49a-a886589cd5e4 service nova] Lock "25943f41-2d28-4ffe-b38b-ae34a99426e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:00:19 user nova-compute[72809]: DEBUG nova.compute.manager [req-a75f1427-0f29-443a-b90e-e4d291d4b4b7 req-9035929c-09bf-4a38-b49a-a886589cd5e4 service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] No waiting events found dispatching network-vif-plugged-eaaf2699-4583-4421-872a-117e799570e5 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:00:19 user nova-compute[72809]: WARNING nova.compute.manager [req-a75f1427-0f29-443a-b90e-e4d291d4b4b7 req-9035929c-09bf-4a38-b49a-a886589cd5e4 service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Received unexpected event network-vif-plugged-eaaf2699-4583-4421-872a-117e799570e5 for instance with vm_state active and task_state rebuild_spawning.
Aug 09 07:00:19 user nova-compute[72809]: DEBUG nova.compute.manager [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:00:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:00:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:00:19 user nova-compute[72809]: DEBUG nova.objects.instance [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72809) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 07:00:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b0fb987a-c253-4e08-84e6-881d661dfd7a tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.068s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:00:19 user nova-compute[72809]: DEBUG nova.objects.instance [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lazy-loading 'flavor' on Instance uuid 5251cef4-9a49-4220-984e-75d1198f95b6 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:00:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f306c66e-f33c-4be5-9f05-b28e649fdec6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "5251cef4-9a49-4220-984e-75d1198f95b6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.673s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:00:20 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "466a8e58-5f88-4ffe-a7fd-a346003f3508" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:00:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:00:20 user nova-compute[72809]: DEBUG nova.compute.manager [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 07:00:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:00:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:00:20 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 07:00:20 user nova-compute[72809]: INFO nova.compute.claims [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Claim successful on node user
Aug 09 07:00:20 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:00:20 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:00:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:00:20 user nova-compute[72809]: DEBUG nova.compute.manager [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 07:00:20 user nova-compute[72809]: DEBUG nova.compute.manager [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 07:00:20 user nova-compute[72809]: DEBUG nova.network.neutron [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 07:00:21 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 07:00:21 user nova-compute[72809]: DEBUG nova.compute.manager [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 07:00:21 user nova-compute[72809]: INFO nova.virt.block_device [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Booting with blank volume at /dev/vda
Aug 09 07:00:21 user nova-compute[72809]: DEBUG nova.policy [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c4c5942852b412885a5b4698552058d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1903437f7ed4c14a0660f64a2e0c647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 07:00:21 user nova-compute[72809]: DEBUG nova.network.neutron [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Successfully created port: 8a95ff1b-0686-455d-977c-cedac8be3930 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 07:00:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:22 user nova-compute[72809]: DEBUG nova.network.neutron [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Successfully updated port: 8a95ff1b-0686-455d-977c-cedac8be3930 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 07:00:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "refresh_cache-466a8e58-5f88-4ffe-a7fd-a346003f3508" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:00:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquired lock "refresh_cache-466a8e58-5f88-4ffe-a7fd-a346003f3508" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:00:22 user nova-compute[72809]: DEBUG nova.network.neutron [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:00:22 user nova-compute[72809]: DEBUG nova.compute.manager [req-f439f60a-67b6-4ef0-a786-bd4d65c48f9c req-ce7c36fd-6f27-4114-9c5f-0267cdb43f50 service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Received event network-changed-8a95ff1b-0686-455d-977c-cedac8be3930 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:00:22 user nova-compute[72809]: DEBUG nova.compute.manager [req-f439f60a-67b6-4ef0-a786-bd4d65c48f9c req-ce7c36fd-6f27-4114-9c5f-0267cdb43f50 service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Refreshing instance network info cache due to event network-changed-8a95ff1b-0686-455d-977c-cedac8be3930. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:00:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f439f60a-67b6-4ef0-a786-bd4d65c48f9c req-ce7c36fd-6f27-4114-9c5f-0267cdb43f50 service nova] Acquiring lock "refresh_cache-466a8e58-5f88-4ffe-a7fd-a346003f3508" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:00:22 user nova-compute[72809]: DEBUG nova.network.neutron [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 07:00:22 user nova-compute[72809]: DEBUG nova.network.neutron [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Updating instance_info_cache with network_info: [{"id": "8a95ff1b-0686-455d-977c-cedac8be3930", "address": "fa:16:3e:42:8d:bd", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a95ff1b-06", "ovs_interfaceid": "8a95ff1b-0686-455d-977c-cedac8be3930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:00:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Releasing lock "refresh_cache-466a8e58-5f88-4ffe-a7fd-a346003f3508" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:00:23 user nova-compute[72809]: DEBUG nova.compute.manager [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Instance network_info: |[{"id": "8a95ff1b-0686-455d-977c-cedac8be3930", "address": "fa:16:3e:42:8d:bd", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a95ff1b-06", "ovs_interfaceid": "8a95ff1b-0686-455d-977c-cedac8be3930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 07:00:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f439f60a-67b6-4ef0-a786-bd4d65c48f9c req-ce7c36fd-6f27-4114-9c5f-0267cdb43f50 service nova] Acquired lock "refresh_cache-466a8e58-5f88-4ffe-a7fd-a346003f3508" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:00:23 user nova-compute[72809]: DEBUG nova.network.neutron [req-f439f60a-67b6-4ef0-a786-bd4d65c48f9c req-ce7c36fd-6f27-4114-9c5f-0267cdb43f50 service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Refreshing network info cache for port 8a95ff1b-0686-455d-977c-cedac8be3930 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:00:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:23 user nova-compute[72809]: DEBUG nova.network.neutron [req-f439f60a-67b6-4ef0-a786-bd4d65c48f9c req-ce7c36fd-6f27-4114-9c5f-0267cdb43f50 service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Updated VIF entry in instance network info cache for port 8a95ff1b-0686-455d-977c-cedac8be3930. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:00:23 user nova-compute[72809]: DEBUG nova.network.neutron [req-f439f60a-67b6-4ef0-a786-bd4d65c48f9c req-ce7c36fd-6f27-4114-9c5f-0267cdb43f50 service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Updating instance_info_cache with network_info: [{"id": "8a95ff1b-0686-455d-977c-cedac8be3930", "address": "fa:16:3e:42:8d:bd", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a95ff1b-06", "ovs_interfaceid": "8a95ff1b-0686-455d-977c-cedac8be3930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:00:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f439f60a-67b6-4ef0-a786-bd4d65c48f9c req-ce7c36fd-6f27-4114-9c5f-0267cdb43f50 service nova] Releasing lock "refresh_cache-466a8e58-5f88-4ffe-a7fd-a346003f3508" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:00:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Acquiring lock "736f31cf-d864-4eeb-a612-12af39cd0d2d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:00:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lock "736f31cf-d864-4eeb-a612-12af39cd0d2d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:00:25 user nova-compute[72809]: DEBUG nova.compute.manager [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 07:00:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:00:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:00:25 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 07:00:25 user nova-compute[72809]: INFO nova.compute.claims [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Claim successful on node user
Aug 09 07:00:26 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:00:26 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:00:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.810s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:00:26 user nova-compute[72809]: DEBUG nova.compute.manager [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 07:00:26 user nova-compute[72809]: DEBUG nova.compute.manager [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 07:00:26 user nova-compute[72809]: DEBUG nova.network.neutron [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 07:00:26 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 07:00:26 user nova-compute[72809]: DEBUG nova.compute.manager [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 07:00:26 user nova-compute[72809]: DEBUG nova.policy [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9dc41dc12f02418eba58bfce4128b26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb54b76021d41c3b047dcad448441d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 07:00:26 user nova-compute[72809]: DEBUG os_brick.utils [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:00:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:26 user nova-compute[72809]: DEBUG nova.compute.manager [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 07:00:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 07:00:26 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Creating image(s)
Aug 09 07:00:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Acquiring lock "/opt/stack/data/nova/instances/736f31cf-d864-4eeb-a612-12af39cd0d2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:00:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lock "/opt/stack/data/nova/instances/736f31cf-d864-4eeb-a612-12af39cd0d2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:00:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lock "/opt/stack/data/nova/instances/736f31cf-d864-4eeb-a612-12af39cd0d2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:00:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:26 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[753aba78-cf97-40aa-b1f3-94fc0350786c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:26 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32f40ab-c75c-49ec-9905-d0b12581f0c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:26 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddbd3a6-dffd-43a8-bd81-ec09029f52ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:26 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[babb46c8-67e7-4d91-9fba-a4dab833461d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:00:27 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 07:00:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:00:27 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 07:00:27 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c5ec5a-812a-41e1-8e96-5ffb7fb8614a]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:27 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 07:00:27 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 07:00:27 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 07:00:27 user nova-compute[72809]: DEBUG os_brick.utils [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:00:27 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Updating existing volume attachment record: 4545ab56-5af6-41cd-8be6-05f233751c42 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 07:00:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.155s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:00:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:00:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.149s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/736f31cf-d864-4eeb-a612-12af39cd0d2d/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/736f31cf-d864-4eeb-a612-12af39cd0d2d/disk 1073741824" returned: 0 in 0.058s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:00:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:27 user nova-compute[72809]: DEBUG nova.network.neutron [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Successfully created port: 13ba3520-c10b-4938-b76a-c0861b5aad4b {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 07:00:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.163s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:27 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Checking if we can resize image /opt/stack/data/nova/instances/736f31cf-d864-4eeb-a612-12af39cd0d2d/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 07:00:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/736f31cf-d864-4eeb-a612-12af39cd0d2d/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/736f31cf-d864-4eeb-a612-12af39cd0d2d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:27 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Cannot resize image /opt/stack/data/nova/instances/736f31cf-d864-4eeb-a612-12af39cd0d2d/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 07:00:27 user nova-compute[72809]: DEBUG nova.objects.instance [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lazy-loading 'migration_context' on Instance uuid 736f31cf-d864-4eeb-a612-12af39cd0d2d {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:00:27 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 07:00:27 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Ensure instance console log exists: /opt/stack/data/nova/instances/736f31cf-d864-4eeb-a612-12af39cd0d2d/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 07:00:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:00:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:00:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.network.neutron [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Successfully updated port: 13ba3520-c10b-4938-b76a-c0861b5aad4b {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Acquiring lock "refresh_cache-736f31cf-d864-4eeb-a612-12af39cd0d2d" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Acquired lock "refresh_cache-736f31cf-d864-4eeb-a612-12af39cd0d2d" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.network.neutron [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.compute.manager [req-992da0b9-2d07-4c6f-9500-75d319c7705b req-b0080bf0-0f91-4831-95d1-005684d1c74f service nova] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Received event network-changed-13ba3520-c10b-4938-b76a-c0861b5aad4b {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.compute.manager [req-992da0b9-2d07-4c6f-9500-75d319c7705b req-b0080bf0-0f91-4831-95d1-005684d1c74f service nova] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Refreshing instance network info cache due to event network-changed-13ba3520-c10b-4938-b76a-c0861b5aad4b. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-992da0b9-2d07-4c6f-9500-75d319c7705b req-b0080bf0-0f91-4831-95d1-005684d1c74f service nova] Acquiring lock "refresh_cache-736f31cf-d864-4eeb-a612-12af39cd0d2d" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.network.neutron [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.network.neutron [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Updating instance_info_cache with network_info: [{"id": "13ba3520-c10b-4938-b76a-c0861b5aad4b", "address": "fa:16:3e:2e:31:8e", "network": {"id": "957d253a-5f0b-4a0d-89e0-5a4ee590929b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1432478722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb54b76021d41c3b047dcad448441d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ba3520-c1", "ovs_interfaceid": "13ba3520-c10b-4938-b76a-c0861b5aad4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Releasing lock "refresh_cache-736f31cf-d864-4eeb-a612-12af39cd0d2d" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.compute.manager [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Instance network_info: |[{"id": "13ba3520-c10b-4938-b76a-c0861b5aad4b", "address": "fa:16:3e:2e:31:8e", "network": {"id": "957d253a-5f0b-4a0d-89e0-5a4ee590929b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1432478722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb54b76021d41c3b047dcad448441d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ba3520-c1", "ovs_interfaceid": "13ba3520-c10b-4938-b76a-c0861b5aad4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-992da0b9-2d07-4c6f-9500-75d319c7705b req-b0080bf0-0f91-4831-95d1-005684d1c74f service nova] Acquired lock "refresh_cache-736f31cf-d864-4eeb-a612-12af39cd0d2d" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.network.neutron [req-992da0b9-2d07-4c6f-9500-75d319c7705b req-b0080bf0-0f91-4831-95d1-005684d1c74f service nova] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Refreshing network info cache for port 13ba3520-c10b-4938-b76a-c0861b5aad4b {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Start _get_guest_xml network_info=[{"id": "13ba3520-c10b-4938-b76a-c0861b5aad4b", "address": "fa:16:3e:2e:31:8e", "network": {"id": "957d253a-5f0b-4a0d-89e0-5a4ee590929b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1432478722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb54b76021d41c3b047dcad448441d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ba3520-c1", "ovs_interfaceid": "13ba3520-c10b-4938-b76a-c0861b5aad4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 07:00:28 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:00:28 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:00:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1461203006',display_name='tempest-ServersNegativeTestJSON-server-1461203006',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1461203006',id=30,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='adb54b76021d41c3b047dcad448441d0',ramdisk_id='',reservation_id='r-m0j2hmu5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-169525689',owner_user_name='tempest-ServersNegativeTestJSON-169525689-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:00:27Z,user_data=None,user_id='9dc41dc12f02418eba58bfce4128b26d',uuid=736f31cf-d864-4eeb-a612-12af39cd0d2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13ba3520-c10b-4938-b76a-c0861b5aad4b", "address": "fa:16:3e:2e:31:8e", "network": {"id": "957d253a-5f0b-4a0d-89e0-5a4ee590929b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1432478722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb54b76021d41c3b047dcad448441d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ba3520-c1", "ovs_interfaceid": "13ba3520-c10b-4938-b76a-c0861b5aad4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Converting VIF {"id": "13ba3520-c10b-4938-b76a-c0861b5aad4b", "address": "fa:16:3e:2e:31:8e", "network": {"id": "957d253a-5f0b-4a0d-89e0-5a4ee590929b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1432478722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb54b76021d41c3b047dcad448441d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ba3520-c1", "ovs_interfaceid": "13ba3520-c10b-4938-b76a-c0861b5aad4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:31:8e,bridge_name='br-int',has_traffic_filtering=True,id=13ba3520-c10b-4938-b76a-c0861b5aad4b,network=Network(957d253a-5f0b-4a0d-89e0-5a4ee590929b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13ba3520-c1') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.objects.instance [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lazy-loading 'pci_devices' on Instance uuid 736f31cf-d864-4eeb-a612-12af39cd0d2d {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] End _get_guest_xml xml=<domain type="kvm">
Aug 09 07:00:28 user nova-compute[72809]:   <uuid>736f31cf-d864-4eeb-a612-12af39cd0d2d</uuid>
Aug 09 07:00:28 user nova-compute[72809]:   <name>instance-0000001e</name>
Aug 09 07:00:28 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 07:00:28 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 07:00:28 user nova-compute[72809]:   <metadata>
Aug 09 07:00:28 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 07:00:28 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 07:00:28 user nova-compute[72809]:       <nova:name>tempest-ServersNegativeTestJSON-server-1461203006</nova:name>
Aug 09 07:00:28 user nova-compute[72809]:       <nova:creationTime>2023-08-09 07:00:28</nova:creationTime>
Aug 09 07:00:28 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 07:00:28 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 07:00:28 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 07:00:28 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 07:00:28 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 07:00:28 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 07:00:28 user nova-compute[72809]:       </nova:flavor>
Aug 09 07:00:28 user nova-compute[72809]:       <nova:owner>
Aug 09 07:00:28 user nova-compute[72809]:         <nova:user uuid="9dc41dc12f02418eba58bfce4128b26d">tempest-ServersNegativeTestJSON-169525689-project-member</nova:user>
Aug 09 07:00:28 user nova-compute[72809]:         <nova:project uuid="adb54b76021d41c3b047dcad448441d0">tempest-ServersNegativeTestJSON-169525689</nova:project>
Aug 09 07:00:28 user nova-compute[72809]:       </nova:owner>
Aug 09 07:00:28 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 07:00:28 user nova-compute[72809]:       <nova:ports>
Aug 09 07:00:28 user nova-compute[72809]:         <nova:port uuid="13ba3520-c10b-4938-b76a-c0861b5aad4b">
Aug 09 07:00:28 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 07:00:28 user nova-compute[72809]:         </nova:port>
Aug 09 07:00:28 user nova-compute[72809]:       </nova:ports>
Aug 09 07:00:28 user nova-compute[72809]:     </nova:instance>
Aug 09 07:00:28 user nova-compute[72809]:   </metadata>
Aug 09 07:00:28 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 07:00:28 user nova-compute[72809]:     <system>
Aug 09 07:00:28 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 07:00:28 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 07:00:28 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 07:00:28 user nova-compute[72809]:       <entry name="serial">736f31cf-d864-4eeb-a612-12af39cd0d2d</entry>
Aug 09 07:00:28 user nova-compute[72809]:       <entry name="uuid">736f31cf-d864-4eeb-a612-12af39cd0d2d</entry>
Aug 09 07:00:28 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 07:00:28 user nova-compute[72809]:     </system>
Aug 09 07:00:28 user nova-compute[72809]:   </sysinfo>
Aug 09 07:00:28 user nova-compute[72809]:   <os>
Aug 09 07:00:28 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 07:00:28 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 07:00:28 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 07:00:28 user nova-compute[72809]:   </os>
Aug 09 07:00:28 user nova-compute[72809]:   <features>
Aug 09 07:00:28 user nova-compute[72809]:     <acpi/>
Aug 09 07:00:28 user nova-compute[72809]:     <apic/>
Aug 09 07:00:28 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 07:00:28 user nova-compute[72809]:   </features>
Aug 09 07:00:28 user nova-compute[72809]:   <clock offset="utc">
Aug 09 07:00:28 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 07:00:28 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 07:00:28 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 07:00:28 user nova-compute[72809]:   </clock>
Aug 09 07:00:28 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 07:00:28 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 07:00:28 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 07:00:28 user nova-compute[72809]:   </cpu>
Aug 09 07:00:28 user nova-compute[72809]:   <devices>
Aug 09 07:00:28 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 07:00:28 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 07:00:28 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/736f31cf-d864-4eeb-a612-12af39cd0d2d/disk"/>
Aug 09 07:00:28 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 07:00:28 user nova-compute[72809]:     </disk>
Aug 09 07:00:28 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 07:00:28 user nova-compute[72809]:       <mac address="fa:16:3e:2e:31:8e"/>
Aug 09 07:00:28 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:00:28 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 07:00:28 user nova-compute[72809]:       <target dev="tap13ba3520-c1"/>
Aug 09 07:00:28 user nova-compute[72809]:     </interface>
Aug 09 07:00:28 user nova-compute[72809]:     <serial type="pty">
Aug 09 07:00:28 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/736f31cf-d864-4eeb-a612-12af39cd0d2d/console.log" append="off"/>
Aug 09 07:00:28 user nova-compute[72809]:     </serial>
Aug 09 07:00:28 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 07:00:28 user nova-compute[72809]:     <video>
Aug 09 07:00:28 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:00:28 user nova-compute[72809]:     </video>
Aug 09 07:00:28 user nova-compute[72809]:     <rng model="virtio">
Aug 09 07:00:28 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 07:00:28 user nova-compute[72809]:     </rng>
Aug 09 07:00:28 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 07:00:28 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 07:00:28 user nova-compute[72809]:       <stats period="10"/>
Aug 09 07:00:28 user nova-compute[72809]:     </memballoon>
Aug 09 07:00:28 user nova-compute[72809]:   </devices>
Aug 09 07:00:28 user nova-compute[72809]: </domain>
Aug 09 07:00:28 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:00:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1461203006',display_name='tempest-ServersNegativeTestJSON-server-1461203006',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1461203006',id=30,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='adb54b76021d41c3b047dcad448441d0',ramdisk_id='',reservation_id='r-m0j2hmu5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-169525689',owner_user_name='tempest-ServersNegativeTestJSON-169525689-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:00:27Z,user_data=None,user_id='9dc41dc12f02418eba58bfce4128b26d',uuid=736f31cf-d864-4eeb-a612-12af39cd0d2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13ba3520-c10b-4938-b76a-c0861b5aad4b", "address": "fa:16:3e:2e:31:8e", "network": {"id": "957d253a-5f0b-4a0d-89e0-5a4ee590929b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1432478722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb54b76021d41c3b047dcad448441d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ba3520-c1", "ovs_interfaceid": "13ba3520-c10b-4938-b76a-c0861b5aad4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Converting VIF {"id": "13ba3520-c10b-4938-b76a-c0861b5aad4b", "address": "fa:16:3e:2e:31:8e", "network": {"id": "957d253a-5f0b-4a0d-89e0-5a4ee590929b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1432478722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb54b76021d41c3b047dcad448441d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ba3520-c1", "ovs_interfaceid": "13ba3520-c10b-4938-b76a-c0861b5aad4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:31:8e,bridge_name='br-int',has_traffic_filtering=True,id=13ba3520-c10b-4938-b76a-c0861b5aad4b,network=Network(957d253a-5f0b-4a0d-89e0-5a4ee590929b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13ba3520-c1') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG os_vif [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:31:8e,bridge_name='br-int',has_traffic_filtering=True,id=13ba3520-c10b-4938-b76a-c0861b5aad4b,network=Network(957d253a-5f0b-4a0d-89e0-5a4ee590929b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13ba3520-c1') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13ba3520-c1, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13ba3520-c1, col_values=(('external_ids', {'iface-id': '13ba3520-c10b-4938-b76a-c0861b5aad4b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:31:8e', 'vm-uuid': '736f31cf-d864-4eeb-a612-12af39cd0d2d'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:28 user nova-compute[72809]: INFO os_vif [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:31:8e,bridge_name='br-int',has_traffic_filtering=True,id=13ba3520-c10b-4938-b76a-c0861b5aad4b,network=Network(957d253a-5f0b-4a0d-89e0-5a4ee590929b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13ba3520-c1')
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:00:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] No VIF found with MAC fa:16:3e:2e:31:8e, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:00:29 user nova-compute[72809]: DEBUG nova.network.neutron [req-992da0b9-2d07-4c6f-9500-75d319c7705b req-b0080bf0-0f91-4831-95d1-005684d1c74f service nova] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Updated VIF entry in instance network info cache for port 13ba3520-c10b-4938-b76a-c0861b5aad4b. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:00:29 user nova-compute[72809]: DEBUG nova.network.neutron [req-992da0b9-2d07-4c6f-9500-75d319c7705b req-b0080bf0-0f91-4831-95d1-005684d1c74f service nova] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Updating instance_info_cache with network_info: [{"id": "13ba3520-c10b-4938-b76a-c0861b5aad4b", "address": "fa:16:3e:2e:31:8e", "network": {"id": "957d253a-5f0b-4a0d-89e0-5a4ee590929b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1432478722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb54b76021d41c3b047dcad448441d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ba3520-c1", "ovs_interfaceid": "13ba3520-c10b-4938-b76a-c0861b5aad4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:00:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-992da0b9-2d07-4c6f-9500-75d319c7705b req-b0080bf0-0f91-4831-95d1-005684d1c74f service nova] Releasing lock "refresh_cache-736f31cf-d864-4eeb-a612-12af39cd0d2d" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:00:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "336770eb-4f09-4134-92ef-f96039bf4fa9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:00:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "336770eb-4f09-4134-92ef-f96039bf4fa9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:00:29 user nova-compute[72809]: INFO nova.compute.manager [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Detaching volume 558b89a2-6411-4dfc-937a-332585a1f186
Aug 09 07:00:29 user nova-compute[72809]: INFO nova.virt.block_device [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Attempting to driver detach volume 558b89a2-6411-4dfc-937a-332585a1f186 from mountpoint /dev/vdb
Aug 09 07:00:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Attempting to detach device vdb from instance 336770eb-4f09-4134-92ef-f96039bf4fa9 from the persistent domain config. {{(pid=72809) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 07:00:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:00:29 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:00:29 user nova-compute[72809]:   <source dev="/dev/sdc"/>
Aug 09 07:00:29 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:00:29 user nova-compute[72809]:   <serial>558b89a2-6411-4dfc-937a-332585a1f186</serial>
Aug 09 07:00:29 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 07:00:29 user nova-compute[72809]: </disk>
Aug 09 07:00:29 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:00:29 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Successfully detached device vdb from instance 336770eb-4f09-4134-92ef-f96039bf4fa9 from the persistent domain config.
Aug 09 07:00:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 336770eb-4f09-4134-92ef-f96039bf4fa9 from the live domain config. {{(pid=72809) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 07:00:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:00:29 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:00:29 user nova-compute[72809]:   <source dev="/dev/sdc"/>
Aug 09 07:00:29 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:00:29 user nova-compute[72809]:   <serial>558b89a2-6411-4dfc-937a-332585a1f186</serial>
Aug 09 07:00:29 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 07:00:29 user nova-compute[72809]: </disk>
Aug 09 07:00:29 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:00:29 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691564414.8128672, 6d210e25-aa29-40a5-ad99-27e54a51dd7a => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:00:29 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] VM Stopped (Lifecycle Event)
Aug 09 07:00:29 user nova-compute[72809]: DEBUG nova.compute.manager [None req-9fdcfbf9-78ec-4ed2-b7f9-2dbb3b73c102 None None] [instance: 6d210e25-aa29-40a5-ad99-27e54a51dd7a] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Received event <DeviceRemovedEvent: 1691564430.1211123, 336770eb-4f09-4134-92ef-f96039bf4fa9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72809) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 336770eb-4f09-4134-92ef-f96039bf4fa9 {{(pid=72809) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 07:00:30 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Successfully detached device vdb from instance 336770eb-4f09-4134-92ef-f96039bf4fa9 from the live domain config.
Aug 09 07:00:30 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QVSLipFZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:00:30 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:00:30 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a264ea-d7fa-4c00-9054-19e495c429be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[30dc8c6f-a786-412b-bd3f-c8746efdfc7b]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)
Aug 09 07:00:30 user nova-compute[72809]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 07:00:30 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 (non-flash)
Aug 09 07:00:30 user nova-compute[72809]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 07:00:30 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc158671090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186'): ({'sdc'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Removing single pathed devices sdc {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df19492-eb67-4a31-ab34-c97075e69bf0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d975a9c-f79c-4f74-80dc-4064b1c2b3ec]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Flushing IO for device /dev/sdc {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57e93e4-e4c7-4d2b-9e24-30c5e4aa31d8]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bef8e2-f972-4f54-adf7-b396cff8aecb]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] SCSI volumes sdc have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fa26fa-5847-4005-967e-e6d4f12f7c4f]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3de833-3ada-4774-859f-0a1dfc64f884]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186, portal: 172.16.0.220,3260]
Aug 09 07:00:30 user nova-compute[72809]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186, portal: 172.16.0.220,3260] successful.
Aug 09 07:00:30 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:558b89a2-6411-4dfc-937a-332585a1f186 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b5cd1c-240f-4949-8553-a494dd92c3f7]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] <== disconnect_volume: return (284ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-c3f6bc5c-743c-4b13-9b17-f4e6c5d2e361 req-2769fb5f-d9b1-4743-8c4b-fadec80968b2 service nova] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Received event network-vif-plugged-13ba3520-c10b-4938-b76a-c0861b5aad4b {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c3f6bc5c-743c-4b13-9b17-f4e6c5d2e361 req-2769fb5f-d9b1-4743-8c4b-fadec80968b2 service nova] Acquiring lock "736f31cf-d864-4eeb-a612-12af39cd0d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c3f6bc5c-743c-4b13-9b17-f4e6c5d2e361 req-2769fb5f-d9b1-4743-8c4b-fadec80968b2 service nova] Lock "736f31cf-d864-4eeb-a612-12af39cd0d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c3f6bc5c-743c-4b13-9b17-f4e6c5d2e361 req-2769fb5f-d9b1-4743-8c4b-fadec80968b2 service nova] Lock "736f31cf-d864-4eeb-a612-12af39cd0d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-c3f6bc5c-743c-4b13-9b17-f4e6c5d2e361 req-2769fb5f-d9b1-4743-8c4b-fadec80968b2 service nova] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] No waiting events found dispatching network-vif-plugged-13ba3520-c10b-4938-b76a-c0861b5aad4b {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:00:30 user nova-compute[72809]: WARNING nova.compute.manager [req-c3f6bc5c-743c-4b13-9b17-f4e6c5d2e361 req-2769fb5f-d9b1-4743-8c4b-fadec80968b2 service nova] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Received unexpected event network-vif-plugged-13ba3520-c10b-4938-b76a-c0861b5aad4b for instance with vm_state building and task_state spawning.
Aug 09 07:00:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:31 user nova-compute[72809]: DEBUG nova.objects.instance [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lazy-loading 'flavor' on Instance uuid 336770eb-4f09-4134-92ef-f96039bf4fa9 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:00:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c0f860ef-b912-418a-85cb-f41814e2120f tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "336770eb-4f09-4134-92ef-f96039bf4fa9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.828s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:00:32 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:00:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 07:00:32 user nova-compute[72809]: DEBUG nova.compute.manager [req-d7d4e6fb-6dd9-4794-b4c0-a365722c42de req-ac704dcb-33bc-43e5-bb6d-93eb1e0176ec service nova] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Received event network-vif-plugged-13ba3520-c10b-4938-b76a-c0861b5aad4b {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:00:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d7d4e6fb-6dd9-4794-b4c0-a365722c42de req-ac704dcb-33bc-43e5-bb6d-93eb1e0176ec service nova] Acquiring lock "736f31cf-d864-4eeb-a612-12af39cd0d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:00:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d7d4e6fb-6dd9-4794-b4c0-a365722c42de req-ac704dcb-33bc-43e5-bb6d-93eb1e0176ec service nova] Lock "736f31cf-d864-4eeb-a612-12af39cd0d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:00:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d7d4e6fb-6dd9-4794-b4c0-a365722c42de req-ac704dcb-33bc-43e5-bb6d-93eb1e0176ec service nova] Lock "736f31cf-d864-4eeb-a612-12af39cd0d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:00:32 user nova-compute[72809]: DEBUG nova.compute.manager [req-d7d4e6fb-6dd9-4794-b4c0-a365722c42de req-ac704dcb-33bc-43e5-bb6d-93eb1e0176ec service nova] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] No waiting events found dispatching network-vif-plugged-13ba3520-c10b-4938-b76a-c0861b5aad4b {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:00:32 user nova-compute[72809]: WARNING nova.compute.manager [req-d7d4e6fb-6dd9-4794-b4c0-a365722c42de req-ac704dcb-33bc-43e5-bb6d-93eb1e0176ec service nova] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Received unexpected event network-vif-plugged-13ba3520-c10b-4938-b76a-c0861b5aad4b for instance with vm_state building and task_state spawning.
Aug 09 07:00:32 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564432.8022614, 736f31cf-d864-4eeb-a612-12af39cd0d2d => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:00:32 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] VM Resumed (Lifecycle Event)
Aug 09 07:00:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 07:00:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 07:00:32 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Instance spawned successfully.
Aug 09 07:00:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 07:00:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:00:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-bebd5a14-6272-4de1-a1a1-4fb45b867c7f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:00:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-bebd5a14-6272-4de1-a1a1-4fb45b867c7f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:00:32 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 07:00:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:00:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:00:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:00:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:00:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:00:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:00:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:00:32 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:00:32 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564432.8039763, 736f31cf-d864-4eeb-a612-12af39cd0d2d => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:00:32 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] VM Started (Lifecycle Event)
Aug 09 07:00:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:00:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:00:32 user nova-compute[72809]: INFO nova.compute.manager [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Took 6.01 seconds to spawn the instance on the hypervisor.
Aug 09 07:00:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:00:32 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:00:33 user nova-compute[72809]: INFO nova.compute.manager [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Took 7.17 seconds to build instance.
Aug 09 07:00:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b7096a59-3b84-469a-a8c0-d1ae6dbb4af2 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lock "736f31cf-d864-4eeb-a612-12af39cd0d2d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.276s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:00:33 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Updating instance_info_cache with network_info: [{"id": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "address": "fa:16:3e:95:65:6f", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c034fd-3a", "ovs_interfaceid": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:00:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-bebd5a14-6272-4de1-a1a1-4fb45b867c7f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:00:33 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 07:00:33 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:00:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:33 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:00:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:00:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:00:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:00:33 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 07:00:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:00:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07a5297e-4f60-4213-bcdb-cf6b4d987681/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07a5297e-4f60-4213-bcdb-cf6b4d987681/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07a5297e-4f60-4213-bcdb-cf6b4d987681/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07a5297e-4f60-4213-bcdb-cf6b4d987681/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:35 user nova-compute[72809]: DEBUG nova.compute.manager [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 07:00:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 07:00:35 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Creating image(s)
Aug 09 07:00:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Did not create local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 07:00:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Ensure instance console log exists: /opt/stack/data/nova/instances/466a8e58-5f88-4ffe-a7fd-a346003f3508/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 07:00:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:00:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:00:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:00:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Start _get_guest_xml network_info=[{"id": "8a95ff1b-0686-455d-977c-cedac8be3930", "address": "fa:16:3e:42:8d:bd", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a95ff1b-06", "ovs_interfaceid": "8a95ff1b-0686-455d-977c-cedac8be3930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eqKCHkSV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '466a8e58-5f88-4ffe-a7fd-a346003f3508', 'attached_at': '', 'detached_at': '', 'volume_id': 'e2b861e9-396c-49cb-92d7-a7efb0adbf64', 'serial': 'e2b861e9-396c-49cb-92d7-a7efb0adbf64'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': 0, 'attachment_id': '4545ab56-5af6-41cd-8be6-05f233751c42', 'volume_type': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 07:00:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:35 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:00:35 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:00:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 07:00:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 07:00:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 07:00:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 07:00:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 07:00:35 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 07:00:35 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 07:00:35 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 07:00:35 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 07:00:35 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 07:00:35 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 07:00:35 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 07:00:35 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 07:00:35 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 07:00:35 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eqKCHkSV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:00:36 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:00:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:00:36 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:00:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:00:36 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7255808c-6907-43a5-a0ec-b3387674b36d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 07:00:36 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dce0eea-c3a8-4534-b823-8ec0a9f1caed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64] added
Aug 09 07:00:36 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a310a3-3f74-4be3-bfa0-f22c30a972e1]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb433cc-70e4-4172-a97a-0d7ed8340cc9]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eqKCHkSV {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eqKCHkSV" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cae2e1b-00f6-4d7b-8b46-95a107006a30]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eqKCHkSV'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[410f8b38-2e82-4305-a488-c2793b8cec4f]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c270b2c-16ee-4c34-bde2-4b7115eb2fa0]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 07:00:36 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 07:00:36 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6747d1c1-92cd-4e0b-8a1c-92af1b0bb528]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64, portal: 172.16.0.220,3260]
Aug 09 07:00:36 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64, portal: 172.16.0.220,3260] successful.
Aug 09 07:00:36 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[063167f2-b92d-492c-b3e7-ef4550966120]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cab7f12-8879-46f9-b048-1dfdc77e4c34]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 07:00:36 user nova-compute[72809]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:00:36 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 07:00:36 user nova-compute[72809]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:00:36 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/736f31cf-d864-4eeb-a612-12af39cd0d2d/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c00327-bbaa-4995-bf5d-b72025b322df]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eqKCHkSV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/736f31cf-d864-4eeb-a612-12af39cd0d2d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/736f31cf-d864-4eeb-a612-12af39cd0d2d/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/736f31cf-d864-4eeb-a612-12af39cd0d2d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:00:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:00:37 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.875s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:00:37 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] <== connect_volume: return (1878ms) {'type': 'block', 'scsi_wwn': '23862626137633833', 'path': '/dev/sdb'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:00:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862626137633833', 'path': '/dev/sdb'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 07:00:37 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:00:37 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:00:37 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=7106MB free_disk=25.33751678466797GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 07:00:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:00:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:00:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:00:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1511604475',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1511604475',id=29,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1903437f7ed4c14a0660f64a2e0c647',ramdisk_id='',reservation_id='r-n0o0w0e3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-917311946',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:00:21Z,user_data=None,user_id='6c4c5942852b412885a5b4698552058d',uuid=466a8e58-5f88-4ffe-a7fd-a346003f3508,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a95ff1b-0686-455d-977c-cedac8be3930", "address": "fa:16:3e:42:8d:bd", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a95ff1b-06", "ovs_interfaceid": "8a95ff1b-0686-455d-977c-cedac8be3930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 07:00:37 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Converting VIF {"id": "8a95ff1b-0686-455d-977c-cedac8be3930", "address": "fa:16:3e:42:8d:bd", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a95ff1b-06", "ovs_interfaceid": "8a95ff1b-0686-455d-977c-cedac8be3930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:00:37 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:8d:bd,bridge_name='br-int',has_traffic_filtering=True,id=8a95ff1b-0686-455d-977c-cedac8be3930,network=Network(5f03b0f9-e80d-428f-b0a6-57158568e620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a95ff1b-06') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:00:37 user nova-compute[72809]: DEBUG nova.objects.instance [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lazy-loading 'pci_devices' on Instance uuid 466a8e58-5f88-4ffe-a7fd-a346003f3508 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:00:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] End _get_guest_xml xml=<domain type="kvm">
Aug 09 07:00:37 user nova-compute[72809]:   <uuid>466a8e58-5f88-4ffe-a7fd-a346003f3508</uuid>
Aug 09 07:00:37 user nova-compute[72809]:   <name>instance-0000001d</name>
Aug 09 07:00:37 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 07:00:37 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 07:00:37 user nova-compute[72809]:   <metadata>
Aug 09 07:00:37 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 07:00:37 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 07:00:37 user nova-compute[72809]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1511604475</nova:name>
Aug 09 07:00:37 user nova-compute[72809]:       <nova:creationTime>2023-08-09 07:00:35</nova:creationTime>
Aug 09 07:00:37 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 07:00:37 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 07:00:37 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 07:00:37 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 07:00:37 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 07:00:37 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 07:00:37 user nova-compute[72809]:       </nova:flavor>
Aug 09 07:00:37 user nova-compute[72809]:       <nova:owner>
Aug 09 07:00:37 user nova-compute[72809]:         <nova:user uuid="6c4c5942852b412885a5b4698552058d">tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member</nova:user>
Aug 09 07:00:37 user nova-compute[72809]:         <nova:project uuid="b1903437f7ed4c14a0660f64a2e0c647">tempest-ServerBootFromVolumeStableRescueTest-917311946</nova:project>
Aug 09 07:00:37 user nova-compute[72809]:       </nova:owner>
Aug 09 07:00:37 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 07:00:37 user nova-compute[72809]:       <nova:ports>
Aug 09 07:00:37 user nova-compute[72809]:         <nova:port uuid="8a95ff1b-0686-455d-977c-cedac8be3930">
Aug 09 07:00:37 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 07:00:37 user nova-compute[72809]:         </nova:port>
Aug 09 07:00:37 user nova-compute[72809]:       </nova:ports>
Aug 09 07:00:37 user nova-compute[72809]:     </nova:instance>
Aug 09 07:00:37 user nova-compute[72809]:   </metadata>
Aug 09 07:00:37 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 07:00:37 user nova-compute[72809]:     <system>
Aug 09 07:00:37 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 07:00:37 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 07:00:37 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 07:00:37 user nova-compute[72809]:       <entry name="serial">466a8e58-5f88-4ffe-a7fd-a346003f3508</entry>
Aug 09 07:00:37 user nova-compute[72809]:       <entry name="uuid">466a8e58-5f88-4ffe-a7fd-a346003f3508</entry>
Aug 09 07:00:37 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 07:00:37 user nova-compute[72809]:     </system>
Aug 09 07:00:37 user nova-compute[72809]:   </sysinfo>
Aug 09 07:00:37 user nova-compute[72809]:   <os>
Aug 09 07:00:37 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 07:00:37 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 07:00:37 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 07:00:37 user nova-compute[72809]:   </os>
Aug 09 07:00:37 user nova-compute[72809]:   <features>
Aug 09 07:00:37 user nova-compute[72809]:     <acpi/>
Aug 09 07:00:37 user nova-compute[72809]:     <apic/>
Aug 09 07:00:37 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 07:00:37 user nova-compute[72809]:   </features>
Aug 09 07:00:37 user nova-compute[72809]:   <clock offset="utc">
Aug 09 07:00:37 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 07:00:37 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 07:00:37 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 07:00:37 user nova-compute[72809]:   </clock>
Aug 09 07:00:37 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 07:00:37 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 07:00:37 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 07:00:37 user nova-compute[72809]:   </cpu>
Aug 09 07:00:37 user nova-compute[72809]:   <devices>
Aug 09 07:00:37 user nova-compute[72809]:     <disk type="block" device="disk">
Aug 09 07:00:37 user nova-compute[72809]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:00:37 user nova-compute[72809]:       <source dev="/dev/sdb"/>
Aug 09 07:00:37 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 07:00:37 user nova-compute[72809]:       <serial>e2b861e9-396c-49cb-92d7-a7efb0adbf64</serial>
Aug 09 07:00:37 user nova-compute[72809]:     </disk>
Aug 09 07:00:37 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 07:00:37 user nova-compute[72809]:       <mac address="fa:16:3e:42:8d:bd"/>
Aug 09 07:00:37 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:00:37 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 07:00:37 user nova-compute[72809]:       <target dev="tap8a95ff1b-06"/>
Aug 09 07:00:37 user nova-compute[72809]:     </interface>
Aug 09 07:00:37 user nova-compute[72809]:     <serial type="pty">
Aug 09 07:00:37 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/466a8e58-5f88-4ffe-a7fd-a346003f3508/console.log" append="off"/>
Aug 09 07:00:37 user nova-compute[72809]:     </serial>
Aug 09 07:00:37 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 07:00:37 user nova-compute[72809]:     <video>
Aug 09 07:00:37 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:00:37 user nova-compute[72809]:     </video>
Aug 09 07:00:37 user nova-compute[72809]:     <rng model="virtio">
Aug 09 07:00:37 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 07:00:37 user nova-compute[72809]:     </rng>
Aug 09 07:00:37 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 07:00:37 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 07:00:37 user nova-compute[72809]:       <stats period="10"/>
Aug 09 07:00:37 user nova-compute[72809]:     </memballoon>
Aug 09 07:00:37 user nova-compute[72809]:   </devices>
Aug 09 07:00:37 user nova-compute[72809]: </domain>
Aug 09 07:00:37 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 07:00:38 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:00:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1511604475',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1511604475',id=29,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1903437f7ed4c14a0660f64a2e0c647',ramdisk_id='',reservation_id='r-n0o0w0e3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-917311946',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:00:21Z,user_data=None,user_id='6c4c5942852b412885a5b4698552058d',uuid=466a8e58-5f88-4ffe-a7fd-a346003f3508,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a95ff1b-0686-455d-977c-cedac8be3930", "address": "fa:16:3e:42:8d:bd", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a95ff1b-06", "ovs_interfaceid": "8a95ff1b-0686-455d-977c-cedac8be3930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 07:00:38 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Converting VIF {"id": "8a95ff1b-0686-455d-977c-cedac8be3930", "address": "fa:16:3e:42:8d:bd", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a95ff1b-06", "ovs_interfaceid": "8a95ff1b-0686-455d-977c-cedac8be3930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:00:38 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:8d:bd,bridge_name='br-int',has_traffic_filtering=True,id=8a95ff1b-0686-455d-977c-cedac8be3930,network=Network(5f03b0f9-e80d-428f-b0a6-57158568e620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a95ff1b-06') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:00:38 user nova-compute[72809]: DEBUG os_vif [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:8d:bd,bridge_name='br-int',has_traffic_filtering=True,id=8a95ff1b-0686-455d-977c-cedac8be3930,network=Network(5f03b0f9-e80d-428f-b0a6-57158568e620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a95ff1b-06') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 07:00:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:00:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 07:00:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a95ff1b-06, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:00:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8a95ff1b-06, col_values=(('external_ids', {'iface-id': '8a95ff1b-0686-455d-977c-cedac8be3930', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:8d:bd', 'vm-uuid': '466a8e58-5f88-4ffe-a7fd-a346003f3508'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:00:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:00:38 user nova-compute[72809]: INFO os_vif [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:8d:bd,bridge_name='br-int',has_traffic_filtering=True,id=8a95ff1b-0686-455d-977c-cedac8be3930,network=Network(5f03b0f9-e80d-428f-b0a6-57158568e620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a95ff1b-06')
Aug 09 07:00:38 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:00:38 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] No VIF found with MAC fa:16:3e:42:8d:bd, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:00:38 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 336770eb-4f09-4134-92ef-f96039bf4fa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:00:38 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 5251cef4-9a49-4220-984e-75d1198f95b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:00:38 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 1bde423f-0b73-448f-bdce-8d6af96d8fc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:00:38 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance bebd5a14-6272-4de1-a1a1-4fb45b867c7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:00:38 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 339372ed-140d-4226-ba00-2cc682214d5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:00:38 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 25943f41-2d28-4ffe-b38b-ae34a99426e1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:00:38 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 38319c37-9cc0-4e84-8415-ddcf37451daf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:00:38 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 07a5297e-4f60-4213-bcdb-cf6b4d987681 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:00:38 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 40bc627e-28c9-4450-9532-bf6db60845b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:00:38 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 51432417-89cc-4cee-855d-c4b148e4bd37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:00:38 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 466a8e58-5f88-4ffe-a7fd-a346003f3508 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:00:38 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 736f31cf-d864-4eeb-a612-12af39cd0d2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:00:38 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 07:00:38 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 07:00:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:38 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:00:38 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:00:38 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 07:00:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.830s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:00:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:39 user nova-compute[72809]: DEBUG nova.compute.manager [req-d98487fe-a6ae-4cd3-90e3-0501212eeaf8 req-bd4d8d4d-d15e-41e5-b044-53f132cce63c service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Received event network-vif-plugged-8a95ff1b-0686-455d-977c-cedac8be3930 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:00:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d98487fe-a6ae-4cd3-90e3-0501212eeaf8 req-bd4d8d4d-d15e-41e5-b044-53f132cce63c service nova] Acquiring lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:00:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d98487fe-a6ae-4cd3-90e3-0501212eeaf8 req-bd4d8d4d-d15e-41e5-b044-53f132cce63c service nova] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:00:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d98487fe-a6ae-4cd3-90e3-0501212eeaf8 req-bd4d8d4d-d15e-41e5-b044-53f132cce63c service nova] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:00:39 user nova-compute[72809]: DEBUG nova.compute.manager [req-d98487fe-a6ae-4cd3-90e3-0501212eeaf8 req-bd4d8d4d-d15e-41e5-b044-53f132cce63c service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] No waiting events found dispatching network-vif-plugged-8a95ff1b-0686-455d-977c-cedac8be3930 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:00:39 user nova-compute[72809]: WARNING nova.compute.manager [req-d98487fe-a6ae-4cd3-90e3-0501212eeaf8 req-bd4d8d4d-d15e-41e5-b044-53f132cce63c service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Received unexpected event network-vif-plugged-8a95ff1b-0686-455d-977c-cedac8be3930 for instance with vm_state building and task_state spawning.
Aug 09 07:00:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:41 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:00:41 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:00:41 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:00:41 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:00:41 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:00:41 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:00:41 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 07:00:41 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564441.8553479, 466a8e58-5f88-4ffe-a7fd-a346003f3508 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:00:41 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] VM Resumed (Lifecycle Event)
Aug 09 07:00:41 user nova-compute[72809]: DEBUG nova.compute.manager [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 07:00:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 07:00:41 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Instance spawned successfully.
Aug 09 07:00:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 07:00:41 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:00:41 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:00:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:00:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:00:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:00:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:00:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:00:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:00:41 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:00:41 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564441.8593936, 466a8e58-5f88-4ffe-a7fd-a346003f3508 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:00:41 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] VM Started (Lifecycle Event)
Aug 09 07:00:41 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:00:41 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:00:41 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:00:41 user nova-compute[72809]: DEBUG nova.compute.manager [req-e281926f-86d1-46ee-9f58-5fa9fa825731 req-d8639252-af56-4682-b6b4-dd71793450e6 service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Received event network-vif-plugged-8a95ff1b-0686-455d-977c-cedac8be3930 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:00:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e281926f-86d1-46ee-9f58-5fa9fa825731 req-d8639252-af56-4682-b6b4-dd71793450e6 service nova] Acquiring lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:00:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e281926f-86d1-46ee-9f58-5fa9fa825731 req-d8639252-af56-4682-b6b4-dd71793450e6 service nova] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:00:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e281926f-86d1-46ee-9f58-5fa9fa825731 req-d8639252-af56-4682-b6b4-dd71793450e6 service nova] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:00:41 user nova-compute[72809]: DEBUG nova.compute.manager [req-e281926f-86d1-46ee-9f58-5fa9fa825731 req-d8639252-af56-4682-b6b4-dd71793450e6 service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] No waiting events found dispatching network-vif-plugged-8a95ff1b-0686-455d-977c-cedac8be3930 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:00:41 user nova-compute[72809]: WARNING nova.compute.manager [req-e281926f-86d1-46ee-9f58-5fa9fa825731 req-d8639252-af56-4682-b6b4-dd71793450e6 service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Received unexpected event network-vif-plugged-8a95ff1b-0686-455d-977c-cedac8be3930 for instance with vm_state building and task_state spawning.
Aug 09 07:00:42 user nova-compute[72809]: INFO nova.compute.manager [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Took 6.19 seconds to spawn the instance on the hypervisor.
Aug 09 07:00:42 user nova-compute[72809]: DEBUG nova.compute.manager [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:00:42 user nova-compute[72809]: INFO nova.compute.manager [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Took 21.65 seconds to build instance.
Aug 09 07:00:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8ffcb287-cd24-4a08-aa0c-4d23ea8d1492 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.738s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:00:43 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:43 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:43 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:00:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:00:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:02 user nova-compute[72809]: INFO nova.compute.manager [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Rescuing
Aug 09 07:01:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "refresh_cache-1bde423f-0b73-448f-bdce-8d6af96d8fc6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:01:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquired lock "refresh_cache-1bde423f-0b73-448f-bdce-8d6af96d8fc6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:01:02 user nova-compute[72809]: DEBUG nova.network.neutron [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:01:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:03 user nova-compute[72809]: DEBUG nova.network.neutron [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Updating instance_info_cache with network_info: [{"id": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "address": "fa:16:3e:3b:e0:d8", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81017ed8-c8", "ovs_interfaceid": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:01:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Releasing lock "refresh_cache-1bde423f-0b73-448f-bdce-8d6af96d8fc6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:01:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:03 user nova-compute[72809]: DEBUG nova.compute.manager [req-79abfd30-30c3-4372-a3be-9b06b468f5de req-23fe6f38-393a-4808-9b61-daf9d10e06f8 service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Received event network-vif-unplugged-81017ed8-c816-4a5d-aa4f-eb16d863571f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:01:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-79abfd30-30c3-4372-a3be-9b06b468f5de req-23fe6f38-393a-4808-9b61-daf9d10e06f8 service nova] Acquiring lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-79abfd30-30c3-4372-a3be-9b06b468f5de req-23fe6f38-393a-4808-9b61-daf9d10e06f8 service nova] Lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-79abfd30-30c3-4372-a3be-9b06b468f5de req-23fe6f38-393a-4808-9b61-daf9d10e06f8 service nova] Lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:03 user nova-compute[72809]: DEBUG nova.compute.manager [req-79abfd30-30c3-4372-a3be-9b06b468f5de req-23fe6f38-393a-4808-9b61-daf9d10e06f8 service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] No waiting events found dispatching network-vif-unplugged-81017ed8-c816-4a5d-aa4f-eb16d863571f {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:01:03 user nova-compute[72809]: WARNING nova.compute.manager [req-79abfd30-30c3-4372-a3be-9b06b468f5de req-23fe6f38-393a-4808-9b61-daf9d10e06f8 service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Received unexpected event network-vif-unplugged-81017ed8-c816-4a5d-aa4f-eb16d863571f for instance with vm_state active and task_state rescuing.
Aug 09 07:01:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:03 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Instance destroyed successfully.
Aug 09 07:01:03 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Attempting rescue
Aug 09 07:01:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72809) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 07:01:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Instance directory exists: not creating {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 07:01:03 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Creating image(s)
Aug 09 07:01:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "/opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "/opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "/opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:03 user nova-compute[72809]: DEBUG nova.objects.instance [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1bde423f-0b73-448f-bdce-8d6af96d8fc6 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.compute.manager [req-d697cbc4-3bd8-4c18-8b91-c86d43102a85 req-727ae7a2-23d9-4838-854e-ec6a778a7fd1 service nova] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Received event network-changed-a3360ec8-df18-4a48-8005-d42ce8fac8a9 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.compute.manager [req-d697cbc4-3bd8-4c18-8b91-c86d43102a85 req-727ae7a2-23d9-4838-854e-ec6a778a7fd1 service nova] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Refreshing instance network info cache due to event network-changed-a3360ec8-df18-4a48-8005-d42ce8fac8a9. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d697cbc4-3bd8-4c18-8b91-c86d43102a85 req-727ae7a2-23d9-4838-854e-ec6a778a7fd1 service nova] Acquiring lock "refresh_cache-07a5297e-4f60-4213-bcdb-cf6b4d987681" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d697cbc4-3bd8-4c18-8b91-c86d43102a85 req-727ae7a2-23d9-4838-854e-ec6a778a7fd1 service nova] Acquired lock "refresh_cache-07a5297e-4f60-4213-bcdb-cf6b4d987681" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.network.neutron [req-d697cbc4-3bd8-4c18-8b91-c86d43102a85 req-727ae7a2-23d9-4838-854e-ec6a778a7fd1 service nova] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Refreshing network info cache for port a3360ec8-df18-4a48-8005-d42ce8fac8a9 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.147s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk.rescue {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk.rescue" returned: 0 in 0.058s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.objects.instance [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lazy-loading 'migration_context' on Instance uuid 1bde423f-0b73-448f-bdce-8d6af96d8fc6 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Start _get_guest_xml network_info=[{"id": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "address": "fa:16:3e:3b:e0:d8", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "vif_mac": "fa:16:3e:3b:e0:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81017ed8-c8", "ovs_interfaceid": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.objects.instance [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lazy-loading 'resources' on Instance uuid 1bde423f-0b73-448f-bdce-8d6af96d8fc6 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.objects.instance [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lazy-loading 'numa_topology' on Instance uuid 1bde423f-0b73-448f-bdce-8d6af96d8fc6 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:01:04 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:01:04 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.objects.instance [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1bde423f-0b73-448f-bdce-8d6af96d8fc6 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:56:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1321868338',display_name='tempest-ServerRescueNegativeTestJSON-server-1321868338',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1321868338',id=19,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:56:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e75b8536be334abba712e1c6f6886cdf',ramdisk_id='',reservation_id='r-8i7rj3wa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1153742012',owner_user_name='tempest-ServerRescueNegativeTestJSON-1153742012-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T06:56:25Z,user_data=None,user_id='740071d735364ce5b0e6a7bb0dbdffe3',uuid=1bde423f-0b73-448f-bdce-8d6af96d8fc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "address": "fa:16:3e:3b:e0:d8", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "vif_mac": "fa:16:3e:3b:e0:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81017ed8-c8", "ovs_interfaceid": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Converting VIF {"id": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "address": "fa:16:3e:3b:e0:d8", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "vif_mac": "fa:16:3e:3b:e0:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81017ed8-c8", "ovs_interfaceid": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:e0:d8,bridge_name='br-int',has_traffic_filtering=True,id=81017ed8-c816-4a5d-aa4f-eb16d863571f,network=Network(fb9ae39b-117a-4cca-8080-683f63e8a318),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81017ed8-c8') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.objects.instance [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lazy-loading 'pci_devices' on Instance uuid 1bde423f-0b73-448f-bdce-8d6af96d8fc6 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] End _get_guest_xml xml=<domain type="kvm">
Aug 09 07:01:04 user nova-compute[72809]:   <uuid>1bde423f-0b73-448f-bdce-8d6af96d8fc6</uuid>
Aug 09 07:01:04 user nova-compute[72809]:   <name>instance-00000013</name>
Aug 09 07:01:04 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 07:01:04 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 07:01:04 user nova-compute[72809]:   <metadata>
Aug 09 07:01:04 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 07:01:04 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 07:01:04 user nova-compute[72809]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1321868338</nova:name>
Aug 09 07:01:04 user nova-compute[72809]:       <nova:creationTime>2023-08-09 07:01:04</nova:creationTime>
Aug 09 07:01:04 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 07:01:04 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 07:01:04 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 07:01:04 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 07:01:04 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 07:01:04 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 07:01:04 user nova-compute[72809]:       </nova:flavor>
Aug 09 07:01:04 user nova-compute[72809]:       <nova:owner>
Aug 09 07:01:04 user nova-compute[72809]:         <nova:user uuid="740071d735364ce5b0e6a7bb0dbdffe3">tempest-ServerRescueNegativeTestJSON-1153742012-project-member</nova:user>
Aug 09 07:01:04 user nova-compute[72809]:         <nova:project uuid="e75b8536be334abba712e1c6f6886cdf">tempest-ServerRescueNegativeTestJSON-1153742012</nova:project>
Aug 09 07:01:04 user nova-compute[72809]:       </nova:owner>
Aug 09 07:01:04 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 07:01:04 user nova-compute[72809]:       <nova:ports>
Aug 09 07:01:04 user nova-compute[72809]:         <nova:port uuid="81017ed8-c816-4a5d-aa4f-eb16d863571f">
Aug 09 07:01:04 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 07:01:04 user nova-compute[72809]:         </nova:port>
Aug 09 07:01:04 user nova-compute[72809]:       </nova:ports>
Aug 09 07:01:04 user nova-compute[72809]:     </nova:instance>
Aug 09 07:01:04 user nova-compute[72809]:   </metadata>
Aug 09 07:01:04 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 07:01:04 user nova-compute[72809]:     <system>
Aug 09 07:01:04 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 07:01:04 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 07:01:04 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 07:01:04 user nova-compute[72809]:       <entry name="serial">1bde423f-0b73-448f-bdce-8d6af96d8fc6</entry>
Aug 09 07:01:04 user nova-compute[72809]:       <entry name="uuid">1bde423f-0b73-448f-bdce-8d6af96d8fc6</entry>
Aug 09 07:01:04 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 07:01:04 user nova-compute[72809]:     </system>
Aug 09 07:01:04 user nova-compute[72809]:   </sysinfo>
Aug 09 07:01:04 user nova-compute[72809]:   <os>
Aug 09 07:01:04 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 07:01:04 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 07:01:04 user nova-compute[72809]:   </os>
Aug 09 07:01:04 user nova-compute[72809]:   <features>
Aug 09 07:01:04 user nova-compute[72809]:     <acpi/>
Aug 09 07:01:04 user nova-compute[72809]:     <apic/>
Aug 09 07:01:04 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 07:01:04 user nova-compute[72809]:   </features>
Aug 09 07:01:04 user nova-compute[72809]:   <clock offset="utc">
Aug 09 07:01:04 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 07:01:04 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 07:01:04 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 07:01:04 user nova-compute[72809]:   </clock>
Aug 09 07:01:04 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 07:01:04 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 07:01:04 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 07:01:04 user nova-compute[72809]:   </cpu>
Aug 09 07:01:04 user nova-compute[72809]:   <devices>
Aug 09 07:01:04 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 07:01:04 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 07:01:04 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk.rescue"/>
Aug 09 07:01:04 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 07:01:04 user nova-compute[72809]:     </disk>
Aug 09 07:01:04 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 07:01:04 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 07:01:04 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk"/>
Aug 09 07:01:04 user nova-compute[72809]:       <target dev="vdb" bus="virtio"/>
Aug 09 07:01:04 user nova-compute[72809]:     </disk>
Aug 09 07:01:04 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 07:01:04 user nova-compute[72809]:       <mac address="fa:16:3e:3b:e0:d8"/>
Aug 09 07:01:04 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:01:04 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 07:01:04 user nova-compute[72809]:       <target dev="tap81017ed8-c8"/>
Aug 09 07:01:04 user nova-compute[72809]:     </interface>
Aug 09 07:01:04 user nova-compute[72809]:     <serial type="pty">
Aug 09 07:01:04 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/console.log" append="off"/>
Aug 09 07:01:04 user nova-compute[72809]:     </serial>
Aug 09 07:01:04 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 07:01:04 user nova-compute[72809]:     <video>
Aug 09 07:01:04 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:01:04 user nova-compute[72809]:     </video>
Aug 09 07:01:04 user nova-compute[72809]:     <rng model="virtio">
Aug 09 07:01:04 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 07:01:04 user nova-compute[72809]:     </rng>
Aug 09 07:01:04 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 07:01:04 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 07:01:04 user nova-compute[72809]:       <stats period="10"/>
Aug 09 07:01:04 user nova-compute[72809]:     </memballoon>
Aug 09 07:01:04 user nova-compute[72809]:   </devices>
Aug 09 07:01:04 user nova-compute[72809]: </domain>
Aug 09 07:01:04 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 07:01:04 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Instance destroyed successfully.
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] No VIF found with MAC fa:16:3e:3b:e0:d8, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.network.neutron [req-d697cbc4-3bd8-4c18-8b91-c86d43102a85 req-727ae7a2-23d9-4838-854e-ec6a778a7fd1 service nova] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Updated VIF entry in instance network info cache for port a3360ec8-df18-4a48-8005-d42ce8fac8a9. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG nova.network.neutron [req-d697cbc4-3bd8-4c18-8b91-c86d43102a85 req-727ae7a2-23d9-4838-854e-ec6a778a7fd1 service nova] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Updating instance_info_cache with network_info: [{"id": "a3360ec8-df18-4a48-8005-d42ce8fac8a9", "address": "fa:16:3e:ed:86:d9", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3360ec8-df", "ovs_interfaceid": "a3360ec8-df18-4a48-8005-d42ce8fac8a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:01:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d697cbc4-3bd8-4c18-8b91-c86d43102a85 req-727ae7a2-23d9-4838-854e-ec6a778a7fd1 service nova] Releasing lock "refresh_cache-07a5297e-4f60-4213-bcdb-cf6b4d987681" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:01:05 user nova-compute[72809]: DEBUG nova.compute.manager [req-0abb78bf-8d3d-482d-b154-9563d754dd03 req-d38a940f-e20d-4719-b514-af47e1c63a91 service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Received event network-vif-plugged-81017ed8-c816-4a5d-aa4f-eb16d863571f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:01:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0abb78bf-8d3d-482d-b154-9563d754dd03 req-d38a940f-e20d-4719-b514-af47e1c63a91 service nova] Acquiring lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0abb78bf-8d3d-482d-b154-9563d754dd03 req-d38a940f-e20d-4719-b514-af47e1c63a91 service nova] Lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0abb78bf-8d3d-482d-b154-9563d754dd03 req-d38a940f-e20d-4719-b514-af47e1c63a91 service nova] Lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:05 user nova-compute[72809]: DEBUG nova.compute.manager [req-0abb78bf-8d3d-482d-b154-9563d754dd03 req-d38a940f-e20d-4719-b514-af47e1c63a91 service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] No waiting events found dispatching network-vif-plugged-81017ed8-c816-4a5d-aa4f-eb16d863571f {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:01:05 user nova-compute[72809]: WARNING nova.compute.manager [req-0abb78bf-8d3d-482d-b154-9563d754dd03 req-d38a940f-e20d-4719-b514-af47e1c63a91 service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Received unexpected event network-vif-plugged-81017ed8-c816-4a5d-aa4f-eb16d863571f for instance with vm_state active and task_state rescuing.
Aug 09 07:01:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:06 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:06 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-523eb67d-41ac-4e15-805a-2814956a601a req-f00db5c3-16ba-470e-9b42-6e26fa72762a service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Received event network-vif-plugged-81017ed8-c816-4a5d-aa4f-eb16d863571f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:01:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-523eb67d-41ac-4e15-805a-2814956a601a req-f00db5c3-16ba-470e-9b42-6e26fa72762a service nova] Acquiring lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-523eb67d-41ac-4e15-805a-2814956a601a req-f00db5c3-16ba-470e-9b42-6e26fa72762a service nova] Lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-523eb67d-41ac-4e15-805a-2814956a601a req-f00db5c3-16ba-470e-9b42-6e26fa72762a service nova] Lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-523eb67d-41ac-4e15-805a-2814956a601a req-f00db5c3-16ba-470e-9b42-6e26fa72762a service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] No waiting events found dispatching network-vif-plugged-81017ed8-c816-4a5d-aa4f-eb16d863571f {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:01:07 user nova-compute[72809]: WARNING nova.compute.manager [req-523eb67d-41ac-4e15-805a-2814956a601a req-f00db5c3-16ba-470e-9b42-6e26fa72762a service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Received unexpected event network-vif-plugged-81017ed8-c816-4a5d-aa4f-eb16d863571f for instance with vm_state active and task_state rescuing.
Aug 09 07:01:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-523eb67d-41ac-4e15-805a-2814956a601a req-f00db5c3-16ba-470e-9b42-6e26fa72762a service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Received event network-vif-plugged-81017ed8-c816-4a5d-aa4f-eb16d863571f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:01:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-523eb67d-41ac-4e15-805a-2814956a601a req-f00db5c3-16ba-470e-9b42-6e26fa72762a service nova] Acquiring lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-523eb67d-41ac-4e15-805a-2814956a601a req-f00db5c3-16ba-470e-9b42-6e26fa72762a service nova] Lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-523eb67d-41ac-4e15-805a-2814956a601a req-f00db5c3-16ba-470e-9b42-6e26fa72762a service nova] Lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-523eb67d-41ac-4e15-805a-2814956a601a req-f00db5c3-16ba-470e-9b42-6e26fa72762a service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] No waiting events found dispatching network-vif-plugged-81017ed8-c816-4a5d-aa4f-eb16d863571f {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:01:07 user nova-compute[72809]: WARNING nova.compute.manager [req-523eb67d-41ac-4e15-805a-2814956a601a req-f00db5c3-16ba-470e-9b42-6e26fa72762a service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Received unexpected event network-vif-plugged-81017ed8-c816-4a5d-aa4f-eb16d863571f for instance with vm_state active and task_state rescuing.
Aug 09 07:01:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Removed pending event for 1bde423f-0b73-448f-bdce-8d6af96d8fc6 due to event {{(pid=72809) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564468.1940424, 1bde423f-0b73-448f-bdce-8d6af96d8fc6 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:01:08 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] VM Resumed (Lifecycle Event)
Aug 09 07:01:08 user nova-compute[72809]: DEBUG nova.compute.manager [None req-4b692505-3c0d-472a-85c9-10e1c85c4979 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "07a5297e-4f60-4213-bcdb-cf6b4d987681" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "07a5297e-4f60-4213-bcdb-cf6b4d987681" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG nova.objects.instance [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lazy-loading 'flavor' on Instance uuid 07a5297e-4f60-4213-bcdb-cf6b4d987681 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:01:08 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 07:01:08 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564468.196907, 1bde423f-0b73-448f-bdce-8d6af96d8fc6 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:01:08 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] VM Started (Lifecycle Event)
Aug 09 07:01:08 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7231bedb-591f-4018-ba6f-f8c71afa4058 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "5251cef4-9a49-4220-984e-75d1198f95b6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7231bedb-591f-4018-ba6f-f8c71afa4058 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "5251cef4-9a49-4220-984e-75d1198f95b6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7231bedb-591f-4018-ba6f-f8c71afa4058 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "5251cef4-9a49-4220-984e-75d1198f95b6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7231bedb-591f-4018-ba6f-f8c71afa4058 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "5251cef4-9a49-4220-984e-75d1198f95b6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7231bedb-591f-4018-ba6f-f8c71afa4058 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "5251cef4-9a49-4220-984e-75d1198f95b6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:08 user nova-compute[72809]: INFO nova.compute.manager [None req-7231bedb-591f-4018-ba6f-f8c71afa4058 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Terminating instance
Aug 09 07:01:08 user nova-compute[72809]: DEBUG nova.compute.manager [None req-7231bedb-591f-4018-ba6f-f8c71afa4058 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "07a5297e-4f60-4213-bcdb-cf6b4d987681" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "07a5297e-4f60-4213-bcdb-cf6b4d987681" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "07a5297e-4f60-4213-bcdb-cf6b4d987681" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:08 user nova-compute[72809]: INFO nova.compute.manager [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Attaching volume 67e26e02-32ff-4f63-a885-d8dc8c123f59 to /dev/vdb
Aug 09 07:01:08 user nova-compute[72809]: DEBUG os_brick.utils [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e233cdd1-fcb4-4566-8bd7-4b66f80f67ae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG nova.compute.manager [req-85711fee-1de6-4cb1-884e-d50b8048c8d8 req-6336a200-badc-4d8b-bdbd-52c230604f37 service nova] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Received event network-vif-unplugged-0a2076a0-d9a0-4c09-9fcd-68011828f5e0 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-85711fee-1de6-4cb1-884e-d50b8048c8d8 req-6336a200-badc-4d8b-bdbd-52c230604f37 service nova] Acquiring lock "5251cef4-9a49-4220-984e-75d1198f95b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-85711fee-1de6-4cb1-884e-d50b8048c8d8 req-6336a200-badc-4d8b-bdbd-52c230604f37 service nova] Lock "5251cef4-9a49-4220-984e-75d1198f95b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-85711fee-1de6-4cb1-884e-d50b8048c8d8 req-6336a200-badc-4d8b-bdbd-52c230604f37 service nova] Lock "5251cef4-9a49-4220-984e-75d1198f95b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG nova.compute.manager [req-85711fee-1de6-4cb1-884e-d50b8048c8d8 req-6336a200-badc-4d8b-bdbd-52c230604f37 service nova] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] No waiting events found dispatching network-vif-unplugged-0a2076a0-d9a0-4c09-9fcd-68011828f5e0 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG nova.compute.manager [req-85711fee-1de6-4cb1-884e-d50b8048c8d8 req-6336a200-badc-4d8b-bdbd-52c230604f37 service nova] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Received event network-vif-unplugged-0a2076a0-d9a0-4c09-9fcd-68011828f5e0 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f74bf18-b4fc-4476-a305-7c19acb89726]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db9fdc1-a65e-4f0e-a464-a4f74e92ad9d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[12884478-dba8-44ea-9a6f-491e66e2e487]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:01:08 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 07:01:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1896cf9-01a4-4e7a-8cf5-17955445cc47]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG os_brick.utils [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:01:08 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Updating existing volume attachment record: f836524e-e194-4837-9afe-5b52526f3676 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 07:01:09 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Instance destroyed successfully.
Aug 09 07:01:09 user nova-compute[72809]: DEBUG nova.objects.instance [None req-7231bedb-591f-4018-ba6f-f8c71afa4058 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lazy-loading 'resources' on Instance uuid 5251cef4-9a49-4220-984e-75d1198f95b6 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:01:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-7231bedb-591f-4018-ba6f-f8c71afa4058 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:55:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1816948191',display_name='tempest-AttachVolumeNegativeTest-server-1816948191',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1816948191',id=18,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcGNkIj35E7oBNNVLCFShzvinhbD5YvCftAPLGVTgZpmyQVeLrSOektcCwSa0DgZRS2k9lYpf4F71nGWrX14bBJXFI0I+mEUon3aSLWhsX54ct2cJs40V7L+87XSGYvfw==',key_name='tempest-keypair-449720676',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:55:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ce7c486aaca4ef89eb7e392b717e3d7',ramdisk_id='',reservation_id='r-d0fle55b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2066250801',owner_user_name='tempest-AttachVolumeNegativeTest-2066250801-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:55:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f85a1f2a88fd40a48d1c4dba13f0ac09',uuid=5251cef4-9a49-4220-984e-75d1198f95b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a2076a0-d9a0-4c09-9fcd-68011828f5e0", "address": "fa:16:3e:6d:d2:82", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2076a0-d9", "ovs_interfaceid": "0a2076a0-d9a0-4c09-9fcd-68011828f5e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:01:09 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7231bedb-591f-4018-ba6f-f8c71afa4058 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Converting VIF {"id": "0a2076a0-d9a0-4c09-9fcd-68011828f5e0", "address": "fa:16:3e:6d:d2:82", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2076a0-d9", "ovs_interfaceid": "0a2076a0-d9a0-4c09-9fcd-68011828f5e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:01:09 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7231bedb-591f-4018-ba6f-f8c71afa4058 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:d2:82,bridge_name='br-int',has_traffic_filtering=True,id=0a2076a0-d9a0-4c09-9fcd-68011828f5e0,network=Network(1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a2076a0-d9') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:01:09 user nova-compute[72809]: DEBUG os_vif [None req-7231bedb-591f-4018-ba6f-f8c71afa4058 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:d2:82,bridge_name='br-int',has_traffic_filtering=True,id=0a2076a0-d9a0-4c09-9fcd-68011828f5e0,network=Network(1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a2076a0-d9') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:01:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a2076a0-d9, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:01:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:01:09 user nova-compute[72809]: INFO os_vif [None req-7231bedb-591f-4018-ba6f-f8c71afa4058 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:d2:82,bridge_name='br-int',has_traffic_filtering=True,id=0a2076a0-d9a0-4c09-9fcd-68011828f5e0,network=Network(1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a2076a0-d9')
Aug 09 07:01:09 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-7231bedb-591f-4018-ba6f-f8c71afa4058 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Deleting instance files /opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6_del
Aug 09 07:01:09 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-7231bedb-591f-4018-ba6f-f8c71afa4058 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Deletion of /opt/stack/data/nova/instances/5251cef4-9a49-4220-984e-75d1198f95b6_del complete
Aug 09 07:01:09 user nova-compute[72809]: INFO nova.compute.manager [None req-7231bedb-591f-4018-ba6f-f8c71afa4058 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 09 07:01:09 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-7231bedb-591f-4018-ba6f-f8c71afa4058 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:01:09 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:01:09 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:01:10 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:01:10 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Took 1.28 seconds to deallocate network for instance.
Aug 09 07:01:10 user nova-compute[72809]: DEBUG nova.compute.manager [req-1b83df54-1026-49c3-99c2-5d474a92bf61 req-07a90b17-576e-490a-a427-a0b6e45fb690 service nova] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Received event network-vif-deleted-0a2076a0-d9a0-4c09-9fcd-68011828f5e0 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:01:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7231bedb-591f-4018-ba6f-f8c71afa4058 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7231bedb-591f-4018-ba6f-f8c71afa4058 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:10 user nova-compute[72809]: DEBUG nova.compute.manager [req-f3f8f761-44dc-4584-b3b5-f427895d8d24 req-d0913965-b73a-4d29-95f9-170a1229b61c service nova] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Received event network-vif-plugged-0a2076a0-d9a0-4c09-9fcd-68011828f5e0 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:01:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f3f8f761-44dc-4584-b3b5-f427895d8d24 req-d0913965-b73a-4d29-95f9-170a1229b61c service nova] Acquiring lock "5251cef4-9a49-4220-984e-75d1198f95b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f3f8f761-44dc-4584-b3b5-f427895d8d24 req-d0913965-b73a-4d29-95f9-170a1229b61c service nova] Lock "5251cef4-9a49-4220-984e-75d1198f95b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f3f8f761-44dc-4584-b3b5-f427895d8d24 req-d0913965-b73a-4d29-95f9-170a1229b61c service nova] Lock "5251cef4-9a49-4220-984e-75d1198f95b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:10 user nova-compute[72809]: DEBUG nova.compute.manager [req-f3f8f761-44dc-4584-b3b5-f427895d8d24 req-d0913965-b73a-4d29-95f9-170a1229b61c service nova] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] No waiting events found dispatching network-vif-plugged-0a2076a0-d9a0-4c09-9fcd-68011828f5e0 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:01:10 user nova-compute[72809]: WARNING nova.compute.manager [req-f3f8f761-44dc-4584-b3b5-f427895d8d24 req-d0913965-b73a-4d29-95f9-170a1229b61c service nova] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Received unexpected event network-vif-plugged-0a2076a0-d9a0-4c09-9fcd-68011828f5e0 for instance with vm_state deleted and task_state None.
Aug 09 07:01:11 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-7231bedb-591f-4018-ba6f-f8c71afa4058 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:01:11 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-7231bedb-591f-4018-ba6f-f8c71afa4058 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:01:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7231bedb-591f-4018-ba6f-f8c71afa4058 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:11 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-7231bedb-591f-4018-ba6f-f8c71afa4058 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Deleted allocations for instance 5251cef4-9a49-4220-984e-75d1198f95b6
Aug 09 07:01:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7231bedb-591f-4018-ba6f-f8c71afa4058 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "5251cef4-9a49-4220-984e-75d1198f95b6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.909s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:15 user nova-compute[72809]: DEBUG nova.compute.manager [req-efeba257-1bf6-47f8-be42-8b36e6b5d38c req-0436eb57-082c-40d8-b69a-6f6a9002fff3 service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Received event network-changed-e17ef1fb-761f-4b49-803c-b4c55115eb7c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:01:15 user nova-compute[72809]: DEBUG nova.compute.manager [req-efeba257-1bf6-47f8-be42-8b36e6b5d38c req-0436eb57-082c-40d8-b69a-6f6a9002fff3 service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Refreshing instance network info cache due to event network-changed-e17ef1fb-761f-4b49-803c-b4c55115eb7c. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:01:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-efeba257-1bf6-47f8-be42-8b36e6b5d38c req-0436eb57-082c-40d8-b69a-6f6a9002fff3 service nova] Acquiring lock "refresh_cache-40bc627e-28c9-4450-9532-bf6db60845b2" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:01:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-efeba257-1bf6-47f8-be42-8b36e6b5d38c req-0436eb57-082c-40d8-b69a-6f6a9002fff3 service nova] Acquired lock "refresh_cache-40bc627e-28c9-4450-9532-bf6db60845b2" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:01:15 user nova-compute[72809]: DEBUG nova.network.neutron [req-efeba257-1bf6-47f8-be42-8b36e6b5d38c req-0436eb57-082c-40d8-b69a-6f6a9002fff3 service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Refreshing network info cache for port e17ef1fb-761f-4b49-803c-b4c55115eb7c {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:01:16 user nova-compute[72809]: DEBUG nova.network.neutron [req-efeba257-1bf6-47f8-be42-8b36e6b5d38c req-0436eb57-082c-40d8-b69a-6f6a9002fff3 service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Updated VIF entry in instance network info cache for port e17ef1fb-761f-4b49-803c-b4c55115eb7c. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:01:16 user nova-compute[72809]: DEBUG nova.network.neutron [req-efeba257-1bf6-47f8-be42-8b36e6b5d38c req-0436eb57-082c-40d8-b69a-6f6a9002fff3 service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Updating instance_info_cache with network_info: [{"id": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "address": "fa:16:3e:15:53:7d", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape17ef1fb-76", "ovs_interfaceid": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:01:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-efeba257-1bf6-47f8-be42-8b36e6b5d38c req-0436eb57-082c-40d8-b69a-6f6a9002fff3 service nova] Releasing lock "refresh_cache-40bc627e-28c9-4450-9532-bf6db60845b2" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wTQbjWni', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:01:17 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:01:17 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:01:17 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:01:17 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:01:17 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 07:01:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[70103df8-9c17-41d5-a1de-bc5c597b9e6f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 07:01:17 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[416fe948-c501-4a67-86b1-550896f3fe38]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59] added
Aug 09 07:01:17 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f7c973-90b9-4e46-bf05-a249abbf2fa3]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6e66d1-1f34-4ccf-9fba-fe4ca1b3f105]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wTQbjWni {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wTQbjWni" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[15032625-cd9d-4b8f-aca2-034771d0d23b]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wTQbjWni'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6ccce0-a83c-4de7-a488-b8c9e716a94a]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9a9649-a2f7-4d1d-9a01-cb9d8c5ea7fb]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 07:01:17 user nova-compute[72809]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:01:17 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 07:01:17 user nova-compute[72809]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:01:17 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e5d9ba-6a97-4a2b-a54c-bee82b28dd35]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59, portal: 172.16.0.220,3260]
Aug 09 07:01:17 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59, portal: 172.16.0.220,3260] successful.
Aug 09 07:01:17 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c9af10-1f19-4d05-98fa-e89333a076b6]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4e8593-cb0c-47ae-822f-8b5f0f70b552]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 07:01:17 user nova-compute[72809]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:01:17 user nova-compute[72809]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 (non-flash)
Aug 09 07:01:17 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 07:01:17 user nova-compute[72809]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:01:17 user nova-compute[72809]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 (non-flash)
Aug 09 07:01:17 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc4fa1a-1884-4bd6-b7dd-e9d9de958822]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:01:17 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wTQbjWni', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 07:01:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:18 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:01:18 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26539623863613031', 'path': '/dev/sdc'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:01:18 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539623863613031', 'path': '/dev/sdc'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 07:01:18 user nova-compute[72809]: DEBUG nova.objects.instance [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lazy-loading 'flavor' on Instance uuid 07a5297e-4f60-4213-bcdb-cf6b4d987681 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:01:18 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 07:01:18 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:01:18 user nova-compute[72809]:   <source dev="/dev/sdc"/>
Aug 09 07:01:18 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:01:18 user nova-compute[72809]:   <serial>67e26e02-32ff-4f63-a885-d8dc8c123f59</serial>
Aug 09 07:01:18 user nova-compute[72809]: </disk>
Aug 09 07:01:18 user nova-compute[72809]:  {{(pid=72809) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 07:01:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:01:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:01:19 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] No VIF found with MAC fa:16:3e:ed:86:d9, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:01:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c7cbf4c1-366f-4669-9b87-c0a8b3a3845d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "07a5297e-4f60-4213-bcdb-cf6b4d987681" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.809s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d0599968-aa6e-4398-a6aa-33971ef21e97 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "40bc627e-28c9-4450-9532-bf6db60845b2" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d0599968-aa6e-4398-a6aa-33971ef21e97 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "40bc627e-28c9-4450-9532-bf6db60845b2" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:23 user nova-compute[72809]: INFO nova.compute.manager [None req-d0599968-aa6e-4398-a6aa-33971ef21e97 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Shelving
Aug 09 07:01:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "07a5297e-4f60-4213-bcdb-cf6b4d987681" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "07a5297e-4f60-4213-bcdb-cf6b4d987681" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691564469.1491554, 5251cef4-9a49-4220-984e-75d1198f95b6 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:01:24 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] VM Stopped (Lifecycle Event)
Aug 09 07:01:24 user nova-compute[72809]: DEBUG nova.objects.instance [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lazy-loading 'flavor' on Instance uuid 07a5297e-4f60-4213-bcdb-cf6b4d987681 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG nova.compute.manager [None req-a94adbc6-39db-4b54-89c2-ef5a71b4dc63 None None] [instance: 5251cef4-9a49-4220-984e-75d1198f95b6] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "07a5297e-4f60-4213-bcdb-cf6b4d987681" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.097s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG nova.compute.manager [req-a3145205-8fb5-4a59-8db0-ac833df3bc47 req-52d484e9-f066-4c87-b3fc-be60e1538183 service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Received event network-vif-unplugged-e17ef1fb-761f-4b49-803c-b4c55115eb7c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a3145205-8fb5-4a59-8db0-ac833df3bc47 req-52d484e9-f066-4c87-b3fc-be60e1538183 service nova] Acquiring lock "40bc627e-28c9-4450-9532-bf6db60845b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a3145205-8fb5-4a59-8db0-ac833df3bc47 req-52d484e9-f066-4c87-b3fc-be60e1538183 service nova] Lock "40bc627e-28c9-4450-9532-bf6db60845b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a3145205-8fb5-4a59-8db0-ac833df3bc47 req-52d484e9-f066-4c87-b3fc-be60e1538183 service nova] Lock "40bc627e-28c9-4450-9532-bf6db60845b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG nova.compute.manager [req-a3145205-8fb5-4a59-8db0-ac833df3bc47 req-52d484e9-f066-4c87-b3fc-be60e1538183 service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] No waiting events found dispatching network-vif-unplugged-e17ef1fb-761f-4b49-803c-b4c55115eb7c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:01:24 user nova-compute[72809]: WARNING nova.compute.manager [req-a3145205-8fb5-4a59-8db0-ac833df3bc47 req-52d484e9-f066-4c87-b3fc-be60e1538183 service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Received unexpected event network-vif-unplugged-e17ef1fb-761f-4b49-803c-b4c55115eb7c for instance with vm_state active and task_state shelving.
Aug 09 07:01:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "07a5297e-4f60-4213-bcdb-cf6b4d987681" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "07a5297e-4f60-4213-bcdb-cf6b4d987681" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:24 user nova-compute[72809]: INFO nova.compute.manager [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Attaching volume 0764b515-dcf1-4396-a89c-a62782dc76be to /dev/vdc
Aug 09 07:01:24 user nova-compute[72809]: DEBUG os_brick.utils [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcbcd02-208d-4472-a831-4da04e5af068]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2171fb-05a6-4075-a92c-31ed2a1171b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d5a4c6-f00f-48e3-a1e1-abe6c7c09dd6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93dcc6f-85cb-4a98-b73f-368c104b2378]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:01:24 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 07:01:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42fc2c6-b449-42ad-94b9-e87c04533925]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG os_brick.utils [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Updating existing volume attachment record: 0d010c1c-f1b1-483d-ae31-aef6b05cb276 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 07:01:24 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Instance destroyed successfully.
Aug 09 07:01:24 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-d0599968-aa6e-4398-a6aa-33971ef21e97 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Beginning cold snapshot process
Aug 09 07:01:24 user nova-compute[72809]: DEBUG nova.privsep.utils [None req-d0599968-aa6e-4398-a6aa-33971ef21e97 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72809) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 07:01:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-d0599968-aa6e-4398-a6aa-33971ef21e97 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk /opt/stack/data/nova/instances/snapshots/tmpgindk6uv/db0b503d70b1493680896ba229215314 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-d0599968-aa6e-4398-a6aa-33971ef21e97 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk /opt/stack/data/nova/instances/snapshots/tmpgindk6uv/db0b503d70b1493680896ba229215314" returned: 0 in 0.783s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:25 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-d0599968-aa6e-4398-a6aa-33971ef21e97 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Snapshot extracted, beginning image upload
Aug 09 07:01:26 user nova-compute[72809]: DEBUG nova.compute.manager [req-b68b391c-3dc9-4fae-979b-9612c39dcaf6 req-fd5f9f3e-ee76-4056-bbec-06d968ce496d service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Received event network-vif-plugged-e17ef1fb-761f-4b49-803c-b4c55115eb7c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:01:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b68b391c-3dc9-4fae-979b-9612c39dcaf6 req-fd5f9f3e-ee76-4056-bbec-06d968ce496d service nova] Acquiring lock "40bc627e-28c9-4450-9532-bf6db60845b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b68b391c-3dc9-4fae-979b-9612c39dcaf6 req-fd5f9f3e-ee76-4056-bbec-06d968ce496d service nova] Lock "40bc627e-28c9-4450-9532-bf6db60845b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b68b391c-3dc9-4fae-979b-9612c39dcaf6 req-fd5f9f3e-ee76-4056-bbec-06d968ce496d service nova] Lock "40bc627e-28c9-4450-9532-bf6db60845b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:26 user nova-compute[72809]: DEBUG nova.compute.manager [req-b68b391c-3dc9-4fae-979b-9612c39dcaf6 req-fd5f9f3e-ee76-4056-bbec-06d968ce496d service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] No waiting events found dispatching network-vif-plugged-e17ef1fb-761f-4b49-803c-b4c55115eb7c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:01:26 user nova-compute[72809]: WARNING nova.compute.manager [req-b68b391c-3dc9-4fae-979b-9612c39dcaf6 req-fd5f9f3e-ee76-4056-bbec-06d968ce496d service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Received unexpected event network-vif-plugged-e17ef1fb-761f-4b49-803c-b4c55115eb7c for instance with vm_state active and task_state shelving_image_uploading.
Aug 09 07:01:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquiring lock "59d67126-7529-408e-a2ae-39c6bc152769" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "59d67126-7529-408e-a2ae-39c6bc152769" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:27 user nova-compute[72809]: DEBUG nova.compute.manager [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 07:01:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:27 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 07:01:27 user nova-compute[72809]: INFO nova.compute.claims [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Claim successful on node user
Aug 09 07:01:28 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:01:28 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:01:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.585s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:28 user nova-compute[72809]: DEBUG nova.compute.manager [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 07:01:28 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-d0599968-aa6e-4398-a6aa-33971ef21e97 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Snapshot image upload complete
Aug 09 07:01:28 user nova-compute[72809]: DEBUG nova.compute.manager [None req-d0599968-aa6e-4398-a6aa-33971ef21e97 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:01:28 user nova-compute[72809]: DEBUG nova.compute.manager [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 07:01:28 user nova-compute[72809]: DEBUG nova.network.neutron [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 07:01:28 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 07:01:28 user nova-compute[72809]: DEBUG nova.compute.manager [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 07:01:28 user nova-compute[72809]: INFO nova.compute.manager [None req-d0599968-aa6e-4398-a6aa-33971ef21e97 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Shelve offloading
Aug 09 07:01:28 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Instance destroyed successfully.
Aug 09 07:01:28 user nova-compute[72809]: DEBUG nova.compute.manager [None req-d0599968-aa6e-4398-a6aa-33971ef21e97 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:01:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d0599968-aa6e-4398-a6aa-33971ef21e97 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "refresh_cache-40bc627e-28c9-4450-9532-bf6db60845b2" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:01:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d0599968-aa6e-4398-a6aa-33971ef21e97 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquired lock "refresh_cache-40bc627e-28c9-4450-9532-bf6db60845b2" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:01:28 user nova-compute[72809]: DEBUG nova.network.neutron [None req-d0599968-aa6e-4398-a6aa-33971ef21e97 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:01:28 user nova-compute[72809]: DEBUG nova.policy [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b9b206fdca44420984d9c279db01ef1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e442312164689bdd7686973d25eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 07:01:28 user nova-compute[72809]: DEBUG nova.compute.manager [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 07:01:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 07:01:28 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Creating image(s)
Aug 09 07:01:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquiring lock "/opt/stack/data/nova/instances/59d67126-7529-408e-a2ae-39c6bc152769/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "/opt/stack/data/nova/instances/59d67126-7529-408e-a2ae-39c6bc152769/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "/opt/stack/data/nova/instances/59d67126-7529-408e-a2ae-39c6bc152769/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.151s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.160s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/59d67126-7529-408e-a2ae-39c6bc152769/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/59d67126-7529-408e-a2ae-39c6bc152769/disk 1073741824" returned: 0 in 0.050s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:28 user nova-compute[72809]: DEBUG nova.network.neutron [None req-d0599968-aa6e-4398-a6aa-33971ef21e97 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Updating instance_info_cache with network_info: [{"id": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "address": "fa:16:3e:15:53:7d", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape17ef1fb-76", "ovs_interfaceid": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:01:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.132s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:28 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Checking if we can resize image /opt/stack/data/nova/instances/59d67126-7529-408e-a2ae-39c6bc152769/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 07:01:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d67126-7529-408e-a2ae-39c6bc152769/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d0599968-aa6e-4398-a6aa-33971ef21e97 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Releasing lock "refresh_cache-40bc627e-28c9-4450-9532-bf6db60845b2" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:01:29 user nova-compute[72809]: DEBUG nova.network.neutron [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Successfully created port: d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 07:01:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d67126-7529-408e-a2ae-39c6bc152769/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:29 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Cannot resize image /opt/stack/data/nova/instances/59d67126-7529-408e-a2ae-39c6bc152769/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 07:01:29 user nova-compute[72809]: DEBUG nova.objects.instance [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lazy-loading 'migration_context' on Instance uuid 59d67126-7529-408e-a2ae-39c6bc152769 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:01:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 07:01:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Ensure instance console log exists: /opt/stack/data/nova/instances/59d67126-7529-408e-a2ae-39c6bc152769/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 07:01:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:29 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Instance destroyed successfully.
Aug 09 07:01:29 user nova-compute[72809]: DEBUG nova.objects.instance [None req-d0599968-aa6e-4398-a6aa-33971ef21e97 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lazy-loading 'resources' on Instance uuid 40bc627e-28c9-4450-9532-bf6db60845b2 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:01:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-d0599968-aa6e-4398-a6aa-33971ef21e97 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:59:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-301681722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-301681722',id=27,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiPUyyU9HwEFMGL8DnXEkkfedQ6deONPsZPZUAGuNY6FGS6oRpyMZpNJ7zXpxN+k6Z2hKUAdewWqVFpwArkxpr2rp1VkYEweMSI5/AQLY/62y6Lc4WGoK047l4JlSqa1Q==',key_name='tempest-keypair-1856803890',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:59:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0ec36de19d984ff3a150db4fdd8ce327',ramdisk_id='',reservation_id='r-3ai7s74q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1006961404',owner_user_name='tempest-AttachVolumeShelveTestJSON-1006961404-project-member',shelved_at='2023-08-09T07:01:28.233262',shelved_host='user',shelved_image_id='4f2ff998-c537-418f-9f29-b1171b15d07e'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:01:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e51e8a984c724efe966662c14b0dbffc',uuid=40bc627e-28c9-4450-9532-bf6db60845b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "address": "fa:16:3e:15:53:7d", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape17ef1fb-76", "ovs_interfaceid": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:01:29 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-d0599968-aa6e-4398-a6aa-33971ef21e97 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Converting VIF {"id": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "address": "fa:16:3e:15:53:7d", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape17ef1fb-76", "ovs_interfaceid": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:01:29 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-d0599968-aa6e-4398-a6aa-33971ef21e97 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:53:7d,bridge_name='br-int',has_traffic_filtering=True,id=e17ef1fb-761f-4b49-803c-b4c55115eb7c,network=Network(39277410-6754-4b40-b1bc-9777841910ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape17ef1fb-76') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:01:29 user nova-compute[72809]: DEBUG os_vif [None req-d0599968-aa6e-4398-a6aa-33971ef21e97 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:53:7d,bridge_name='br-int',has_traffic_filtering=True,id=e17ef1fb-761f-4b49-803c-b4c55115eb7c,network=Network(39277410-6754-4b40-b1bc-9777841910ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape17ef1fb-76') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:01:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-9b8868cc-41b8-4400-8d90-bec7a0cf32f0 req-fb777cf8-092d-4bd7-9064-77b531e0cdca service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Received event network-changed-e17ef1fb-761f-4b49-803c-b4c55115eb7c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:01:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-9b8868cc-41b8-4400-8d90-bec7a0cf32f0 req-fb777cf8-092d-4bd7-9064-77b531e0cdca service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Refreshing instance network info cache due to event network-changed-e17ef1fb-761f-4b49-803c-b4c55115eb7c. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:01:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9b8868cc-41b8-4400-8d90-bec7a0cf32f0 req-fb777cf8-092d-4bd7-9064-77b531e0cdca service nova] Acquiring lock "refresh_cache-40bc627e-28c9-4450-9532-bf6db60845b2" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:01:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9b8868cc-41b8-4400-8d90-bec7a0cf32f0 req-fb777cf8-092d-4bd7-9064-77b531e0cdca service nova] Acquired lock "refresh_cache-40bc627e-28c9-4450-9532-bf6db60845b2" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:01:29 user nova-compute[72809]: DEBUG nova.network.neutron [req-9b8868cc-41b8-4400-8d90-bec7a0cf32f0 req-fb777cf8-092d-4bd7-9064-77b531e0cdca service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Refreshing network info cache for port e17ef1fb-761f-4b49-803c-b4c55115eb7c {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:01:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape17ef1fb-76, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:01:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:01:29 user nova-compute[72809]: INFO os_vif [None req-d0599968-aa6e-4398-a6aa-33971ef21e97 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:53:7d,bridge_name='br-int',has_traffic_filtering=True,id=e17ef1fb-761f-4b49-803c-b4c55115eb7c,network=Network(39277410-6754-4b40-b1bc-9777841910ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape17ef1fb-76')
Aug 09 07:01:29 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-d0599968-aa6e-4398-a6aa-33971ef21e97 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Deleting instance files /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2_del
Aug 09 07:01:29 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-d0599968-aa6e-4398-a6aa-33971ef21e97 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Deletion of /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2_del complete
Aug 09 07:01:29 user nova-compute[72809]: DEBUG nova.network.neutron [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Successfully updated port: d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 07:01:29 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-d0599968-aa6e-4398-a6aa-33971ef21e97 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Deleted allocations for instance 40bc627e-28c9-4450-9532-bf6db60845b2
Aug 09 07:01:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquiring lock "refresh_cache-59d67126-7529-408e-a2ae-39c6bc152769" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:01:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquired lock "refresh_cache-59d67126-7529-408e-a2ae-39c6bc152769" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:01:29 user nova-compute[72809]: DEBUG nova.network.neutron [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:01:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-53569b44-aa54-4bb8-9436-4380a7049804 req-bea14545-aa1f-4ba0-b373-8096933282e8 service nova] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Received event network-changed-d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:01:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-53569b44-aa54-4bb8-9436-4380a7049804 req-bea14545-aa1f-4ba0-b373-8096933282e8 service nova] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Refreshing instance network info cache due to event network-changed-d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:01:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-53569b44-aa54-4bb8-9436-4380a7049804 req-bea14545-aa1f-4ba0-b373-8096933282e8 service nova] Acquiring lock "refresh_cache-59d67126-7529-408e-a2ae-39c6bc152769" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:01:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d0599968-aa6e-4398-a6aa-33971ef21e97 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d0599968-aa6e-4398-a6aa-33971ef21e97 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:29 user nova-compute[72809]: DEBUG nova.objects.instance [None req-d0599968-aa6e-4398-a6aa-33971ef21e97 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lazy-loading 'numa_topology' on Instance uuid 40bc627e-28c9-4450-9532-bf6db60845b2 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:01:29 user nova-compute[72809]: DEBUG nova.network.neutron [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.network.neutron [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Updating instance_info_cache with network_info: [{"id": "d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7", "address": "fa:16:3e:51:e3:e8", "network": {"id": "ae760578-06b0-479a-9f75-b5e781b1a087", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-541750148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76e442312164689bdd7686973d25eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1962ff5-8d", "ovs_interfaceid": "d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.network.neutron [req-9b8868cc-41b8-4400-8d90-bec7a0cf32f0 req-fb777cf8-092d-4bd7-9064-77b531e0cdca service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Updated VIF entry in instance network info cache for port e17ef1fb-761f-4b49-803c-b4c55115eb7c. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.network.neutron [req-9b8868cc-41b8-4400-8d90-bec7a0cf32f0 req-fb777cf8-092d-4bd7-9064-77b531e0cdca service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Updating instance_info_cache with network_info: [{"id": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "address": "fa:16:3e:15:53:7d", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tape17ef1fb-76", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Releasing lock "refresh_cache-59d67126-7529-408e-a2ae-39c6bc152769" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.compute.manager [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Instance network_info: |[{"id": "d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7", "address": "fa:16:3e:51:e3:e8", "network": {"id": "ae760578-06b0-479a-9f75-b5e781b1a087", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-541750148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76e442312164689bdd7686973d25eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1962ff5-8d", "ovs_interfaceid": "d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-53569b44-aa54-4bb8-9436-4380a7049804 req-bea14545-aa1f-4ba0-b373-8096933282e8 service nova] Acquired lock "refresh_cache-59d67126-7529-408e-a2ae-39c6bc152769" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.network.neutron [req-53569b44-aa54-4bb8-9436-4380a7049804 req-bea14545-aa1f-4ba0-b373-8096933282e8 service nova] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Refreshing network info cache for port d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Start _get_guest_xml network_info=[{"id": "d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7", "address": "fa:16:3e:51:e3:e8", "network": {"id": "ae760578-06b0-479a-9f75-b5e781b1a087", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-541750148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76e442312164689bdd7686973d25eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1962ff5-8d", "ovs_interfaceid": "d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9b8868cc-41b8-4400-8d90-bec7a0cf32f0 req-fb777cf8-092d-4bd7-9064-77b531e0cdca service nova] Releasing lock "refresh_cache-40bc627e-28c9-4450-9532-bf6db60845b2" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:01:30 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:01:30 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:01:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-89747799',display_name='tempest-VolumesSnapshotTestJSON-instance-89747799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-89747799',id=31,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZH2CwceOe6rWWo2O1xhwSuA65LMVN81uz4lh/eV5yfcPZqrgGPT1+gGjIwXPaSeQaxCRd85HmCphgLwVquH8tNSFMgbnYW9VDJ7VLOi7yJ3nnAKH9Kd9Vc4vDnbVs6CA==',key_name='tempest-keypair-733064279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f76e442312164689bdd7686973d25eda',ramdisk_id='',reservation_id='r-k13a0vz6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1130129930',owner_user_name='tempest-VolumesSnapshotTestJSON-1130129930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:01:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9b206fdca44420984d9c279db01ef1b',uuid=59d67126-7529-408e-a2ae-39c6bc152769,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7", "address": "fa:16:3e:51:e3:e8", "network": {"id": "ae760578-06b0-479a-9f75-b5e781b1a087", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-541750148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76e442312164689bdd7686973d25eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1962ff5-8d", "ovs_interfaceid": "d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Converting VIF {"id": "d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7", "address": "fa:16:3e:51:e3:e8", "network": {"id": "ae760578-06b0-479a-9f75-b5e781b1a087", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-541750148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76e442312164689bdd7686973d25eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1962ff5-8d", "ovs_interfaceid": "d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:e3:e8,bridge_name='br-int',has_traffic_filtering=True,id=d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7,network=Network(ae760578-06b0-479a-9f75-b5e781b1a087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1962ff5-8d') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.objects.instance [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lazy-loading 'pci_devices' on Instance uuid 59d67126-7529-408e-a2ae-39c6bc152769 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-d0599968-aa6e-4398-a6aa-33971ef21e97 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] End _get_guest_xml xml=<domain type="kvm">
Aug 09 07:01:30 user nova-compute[72809]:   <uuid>59d67126-7529-408e-a2ae-39c6bc152769</uuid>
Aug 09 07:01:30 user nova-compute[72809]:   <name>instance-0000001f</name>
Aug 09 07:01:30 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 07:01:30 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 07:01:30 user nova-compute[72809]:   <metadata>
Aug 09 07:01:30 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 07:01:30 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 07:01:30 user nova-compute[72809]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-89747799</nova:name>
Aug 09 07:01:30 user nova-compute[72809]:       <nova:creationTime>2023-08-09 07:01:30</nova:creationTime>
Aug 09 07:01:30 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 07:01:30 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 07:01:30 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 07:01:30 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 07:01:30 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 07:01:30 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 07:01:30 user nova-compute[72809]:       </nova:flavor>
Aug 09 07:01:30 user nova-compute[72809]:       <nova:owner>
Aug 09 07:01:30 user nova-compute[72809]:         <nova:user uuid="b9b206fdca44420984d9c279db01ef1b">tempest-VolumesSnapshotTestJSON-1130129930-project-member</nova:user>
Aug 09 07:01:30 user nova-compute[72809]:         <nova:project uuid="f76e442312164689bdd7686973d25eda">tempest-VolumesSnapshotTestJSON-1130129930</nova:project>
Aug 09 07:01:30 user nova-compute[72809]:       </nova:owner>
Aug 09 07:01:30 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 07:01:30 user nova-compute[72809]:       <nova:ports>
Aug 09 07:01:30 user nova-compute[72809]:         <nova:port uuid="d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7">
Aug 09 07:01:30 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 07:01:30 user nova-compute[72809]:         </nova:port>
Aug 09 07:01:30 user nova-compute[72809]:       </nova:ports>
Aug 09 07:01:30 user nova-compute[72809]:     </nova:instance>
Aug 09 07:01:30 user nova-compute[72809]:   </metadata>
Aug 09 07:01:30 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 07:01:30 user nova-compute[72809]:     <system>
Aug 09 07:01:30 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 07:01:30 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 07:01:30 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 07:01:30 user nova-compute[72809]:       <entry name="serial">59d67126-7529-408e-a2ae-39c6bc152769</entry>
Aug 09 07:01:30 user nova-compute[72809]:       <entry name="uuid">59d67126-7529-408e-a2ae-39c6bc152769</entry>
Aug 09 07:01:30 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 07:01:30 user nova-compute[72809]:     </system>
Aug 09 07:01:30 user nova-compute[72809]:   </sysinfo>
Aug 09 07:01:30 user nova-compute[72809]:   <os>
Aug 09 07:01:30 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 07:01:30 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 07:01:30 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 07:01:30 user nova-compute[72809]:   </os>
Aug 09 07:01:30 user nova-compute[72809]:   <features>
Aug 09 07:01:30 user nova-compute[72809]:     <acpi/>
Aug 09 07:01:30 user nova-compute[72809]:     <apic/>
Aug 09 07:01:30 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 07:01:30 user nova-compute[72809]:   </features>
Aug 09 07:01:30 user nova-compute[72809]:   <clock offset="utc">
Aug 09 07:01:30 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 07:01:30 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 07:01:30 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 07:01:30 user nova-compute[72809]:   </clock>
Aug 09 07:01:30 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 07:01:30 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 07:01:30 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 07:01:30 user nova-compute[72809]:   </cpu>
Aug 09 07:01:30 user nova-compute[72809]:   <devices>
Aug 09 07:01:30 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 07:01:30 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 07:01:30 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/59d67126-7529-408e-a2ae-39c6bc152769/disk"/>
Aug 09 07:01:30 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 07:01:30 user nova-compute[72809]:     </disk>
Aug 09 07:01:30 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 07:01:30 user nova-compute[72809]:       <mac address="fa:16:3e:51:e3:e8"/>
Aug 09 07:01:30 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:01:30 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 07:01:30 user nova-compute[72809]:       <target dev="tapd1962ff5-8d"/>
Aug 09 07:01:30 user nova-compute[72809]:     </interface>
Aug 09 07:01:30 user nova-compute[72809]:     <serial type="pty">
Aug 09 07:01:30 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/59d67126-7529-408e-a2ae-39c6bc152769/console.log" append="off"/>
Aug 09 07:01:30 user nova-compute[72809]:     </serial>
Aug 09 07:01:30 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 07:01:30 user nova-compute[72809]:     <video>
Aug 09 07:01:30 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:01:30 user nova-compute[72809]:     </video>
Aug 09 07:01:30 user nova-compute[72809]:     <rng model="virtio">
Aug 09 07:01:30 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 07:01:30 user nova-compute[72809]:     </rng>
Aug 09 07:01:30 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 07:01:30 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 07:01:30 user nova-compute[72809]:       <stats period="10"/>
Aug 09 07:01:30 user nova-compute[72809]:     </memballoon>
Aug 09 07:01:30 user nova-compute[72809]:   </devices>
Aug 09 07:01:30 user nova-compute[72809]: </domain>
Aug 09 07:01:30 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:01:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-89747799',display_name='tempest-VolumesSnapshotTestJSON-instance-89747799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-89747799',id=31,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZH2CwceOe6rWWo2O1xhwSuA65LMVN81uz4lh/eV5yfcPZqrgGPT1+gGjIwXPaSeQaxCRd85HmCphgLwVquH8tNSFMgbnYW9VDJ7VLOi7yJ3nnAKH9Kd9Vc4vDnbVs6CA==',key_name='tempest-keypair-733064279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f76e442312164689bdd7686973d25eda',ramdisk_id='',reservation_id='r-k13a0vz6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1130129930',owner_user_name='tempest-VolumesSnapshotTestJSON-1130129930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:01:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9b206fdca44420984d9c279db01ef1b',uuid=59d67126-7529-408e-a2ae-39c6bc152769,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7", "address": "fa:16:3e:51:e3:e8", "network": {"id": "ae760578-06b0-479a-9f75-b5e781b1a087", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-541750148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76e442312164689bdd7686973d25eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1962ff5-8d", "ovs_interfaceid": "d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Converting VIF {"id": "d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7", "address": "fa:16:3e:51:e3:e8", "network": {"id": "ae760578-06b0-479a-9f75-b5e781b1a087", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-541750148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76e442312164689bdd7686973d25eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1962ff5-8d", "ovs_interfaceid": "d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:e3:e8,bridge_name='br-int',has_traffic_filtering=True,id=d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7,network=Network(ae760578-06b0-479a-9f75-b5e781b1a087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1962ff5-8d') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG os_vif [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:e3:e8,bridge_name='br-int',has_traffic_filtering=True,id=d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7,network=Network(ae760578-06b0-479a-9f75-b5e781b1a087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1962ff5-8d') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-d0599968-aa6e-4398-a6aa-33971ef21e97 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1962ff5-8d, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd1962ff5-8d, col_values=(('external_ids', {'iface-id': 'd1962ff5-8d61-49d1-94d4-f3e3f1b33bd7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:e3:e8', 'vm-uuid': '59d67126-7529-408e-a2ae-39c6bc152769'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:30 user nova-compute[72809]: INFO os_vif [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:e3:e8,bridge_name='br-int',has_traffic_filtering=True,id=d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7,network=Network(ae760578-06b0-479a-9f75-b5e781b1a087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1962ff5-8d')
Aug 09 07:01:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d0599968-aa6e-4398-a6aa-33971ef21e97 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d0599968-aa6e-4398-a6aa-33971ef21e97 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "40bc627e-28c9-4450-9532-bf6db60845b2" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.403s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] No VIF found with MAC fa:16:3e:51:e3:e8, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.network.neutron [req-53569b44-aa54-4bb8-9436-4380a7049804 req-bea14545-aa1f-4ba0-b373-8096933282e8 service nova] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Updated VIF entry in instance network info cache for port d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG nova.network.neutron [req-53569b44-aa54-4bb8-9436-4380a7049804 req-bea14545-aa1f-4ba0-b373-8096933282e8 service nova] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Updating instance_info_cache with network_info: [{"id": "d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7", "address": "fa:16:3e:51:e3:e8", "network": {"id": "ae760578-06b0-479a-9f75-b5e781b1a087", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-541750148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76e442312164689bdd7686973d25eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1962ff5-8d", "ovs_interfaceid": "d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:01:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-53569b44-aa54-4bb8-9436-4380a7049804 req-bea14545-aa1f-4ba0-b373-8096933282e8 service nova] Releasing lock "refresh_cache-59d67126-7529-408e-a2ae-39c6bc152769" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:01:31 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:31 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:31 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:31 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:31 user nova-compute[72809]: DEBUG nova.compute.manager [req-eb7f6c95-670d-461a-a591-4ef04bd95593 req-3c4f3379-fb49-4821-9949-05e68a8cfce0 service nova] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Received event network-vif-plugged-d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:01:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-eb7f6c95-670d-461a-a591-4ef04bd95593 req-3c4f3379-fb49-4821-9949-05e68a8cfce0 service nova] Acquiring lock "59d67126-7529-408e-a2ae-39c6bc152769-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-eb7f6c95-670d-461a-a591-4ef04bd95593 req-3c4f3379-fb49-4821-9949-05e68a8cfce0 service nova] Lock "59d67126-7529-408e-a2ae-39c6bc152769-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-eb7f6c95-670d-461a-a591-4ef04bd95593 req-3c4f3379-fb49-4821-9949-05e68a8cfce0 service nova] Lock "59d67126-7529-408e-a2ae-39c6bc152769-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:31 user nova-compute[72809]: DEBUG nova.compute.manager [req-eb7f6c95-670d-461a-a591-4ef04bd95593 req-3c4f3379-fb49-4821-9949-05e68a8cfce0 service nova] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] No waiting events found dispatching network-vif-plugged-d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:01:31 user nova-compute[72809]: WARNING nova.compute.manager [req-eb7f6c95-670d-461a-a591-4ef04bd95593 req-3c4f3379-fb49-4821-9949-05e68a8cfce0 service nova] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Received unexpected event network-vif-plugged-d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7 for instance with vm_state building and task_state spawning.
Aug 09 07:01:32 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:32 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:32 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:32 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:32 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:01:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 07:01:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Didn't find any instances for network info cache update. {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 07:01:32 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TkKmfxZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:01:33 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:01:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:01:33 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:01:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:01:33 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[84adffdd-893c-4e44-a76b-ed7d3ad014ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 07:01:33 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc2cffe-5ccf-472d-a152-9cddf80a9304]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be] added
Aug 09 07:01:33 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[badd128a-1668-4279-999c-4a0df6341348]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcf41ee-7e99-4018-a32c-3f5cf4504278]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TkKmfxZD {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TkKmfxZD" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc7136f-a7d4-4ef9-b66f-f24b888c2da5]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TkKmfxZD'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[55626060-949d-416d-b597-5e06737aa7c9]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d2dea4-49dd-4bc9-be7e-35b4b44d702d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 07:01:33 user nova-compute[72809]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:01:33 user nova-compute[72809]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 (non-flash)
Aug 09 07:01:33 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 07:01:33 user nova-compute[72809]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:01:33 user nova-compute[72809]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 (non-flash)
Aug 09 07:01:33 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbe28db-f84f-45d6-b1cc-46ec464de738]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be, portal: 172.16.0.220,3260]
Aug 09 07:01:33 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be, portal: 172.16.0.220,3260] successful.
Aug 09 07:01:33 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e88f4c-db7e-46d9-aeca-408ca83f622c]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08ce7e9-00c2-4a40-adc9-42bf9c50d622]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 07:01:33 user nova-compute[72809]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:01:33 user nova-compute[72809]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 (non-flash)
Aug 09 07:01:33 user nova-compute[72809]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be (non-flash)
Aug 09 07:01:33 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 07:01:33 user nova-compute[72809]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:01:33 user nova-compute[72809]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 (non-flash)
Aug 09 07:01:33 user nova-compute[72809]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be (non-flash)
Aug 09 07:01:33 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bebc36-17d8-48b3-8ba6-0bc0ef03d949]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: None {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG nova.compute.manager [req-563bc27c-4bcb-4839-9709-8604c860bf58 req-5de35393-022b-4eac-a2be-d2db5701ee77 service nova] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Received event network-vif-plugged-d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-563bc27c-4bcb-4839-9709-8604c860bf58 req-5de35393-022b-4eac-a2be-d2db5701ee77 service nova] Acquiring lock "59d67126-7529-408e-a2ae-39c6bc152769-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-563bc27c-4bcb-4839-9709-8604c860bf58 req-5de35393-022b-4eac-a2be-d2db5701ee77 service nova] Lock "59d67126-7529-408e-a2ae-39c6bc152769-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-563bc27c-4bcb-4839-9709-8604c860bf58 req-5de35393-022b-4eac-a2be-d2db5701ee77 service nova] Lock "59d67126-7529-408e-a2ae-39c6bc152769-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:33 user nova-compute[72809]: DEBUG nova.compute.manager [req-563bc27c-4bcb-4839-9709-8604c860bf58 req-5de35393-022b-4eac-a2be-d2db5701ee77 service nova] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] No waiting events found dispatching network-vif-plugged-d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:01:33 user nova-compute[72809]: WARNING nova.compute.manager [req-563bc27c-4bcb-4839-9709-8604c860bf58 req-5de35393-022b-4eac-a2be-d2db5701ee77 service nova] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Received unexpected event network-vif-plugged-d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7 for instance with vm_state building and task_state spawning.
Aug 09 07:01:34 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564494.1210115, 59d67126-7529-408e-a2ae-39c6bc152769 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:01:34 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] VM Resumed (Lifecycle Event)
Aug 09 07:01:34 user nova-compute[72809]: DEBUG nova.compute.manager [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 07:01:34 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 07:01:34 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Instance spawned successfully.
Aug 09 07:01:34 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 07:01:34 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:01:34 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:01:34 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:01:34 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:01:34 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:01:34 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:01:34 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:01:34 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:01:34 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:01:34 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564494.1252322, 59d67126-7529-408e-a2ae-39c6bc152769 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:01:34 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] VM Started (Lifecycle Event)
Aug 09 07:01:34 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:01:34 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:01:34 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:01:34 user nova-compute[72809]: INFO nova.compute.manager [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Took 5.82 seconds to spawn the instance on the hypervisor.
Aug 09 07:01:34 user nova-compute[72809]: DEBUG nova.compute.manager [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:01:34 user nova-compute[72809]: INFO nova.compute.manager [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Took 6.77 seconds to build instance.
Aug 09 07:01:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-593d40ee-4478-4f97-aa53-5b76737b532e tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "59d67126-7529-408e-a2ae-39c6bc152769" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.886s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:34 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:01:34 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TkKmfxZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 07:01:34 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:01:34 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23564306331616461', 'path': '/dev/sde'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:01:34 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564306331616461', 'path': '/dev/sde'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 07:01:34 user nova-compute[72809]: DEBUG nova.objects.instance [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lazy-loading 'flavor' on Instance uuid 07a5297e-4f60-4213-bcdb-cf6b4d987681 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:01:34 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 07:01:34 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:01:34 user nova-compute[72809]:   <source dev="/dev/sde"/>
Aug 09 07:01:34 user nova-compute[72809]:   <target dev="vdc" bus="virtio"/>
Aug 09 07:01:34 user nova-compute[72809]:   <serial>0764b515-dcf1-4396-a89c-a62782dc76be</serial>
Aug 09 07:01:34 user nova-compute[72809]: </disk>
Aug 09 07:01:34 user nova-compute[72809]:  {{(pid=72809) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 07:01:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:01:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:01:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:01:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] No VIF found with MAC fa:16:3e:ed:86:d9, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:01:35 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c21b072b-147a-4579-a115-3ba58ed64337 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "07a5297e-4f60-4213-bcdb-cf6b4d987681" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.971s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:35 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:01:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:35 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 07:01:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:01:35 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07a5297e-4f60-4213-bcdb-cf6b4d987681/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07a5297e-4f60-4213-bcdb-cf6b4d987681/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07a5297e-4f60-4213-bcdb-cf6b4d987681/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07a5297e-4f60-4213-bcdb-cf6b4d987681/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:01:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:01:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json" returned: 0 in 0.164s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "07a5297e-4f60-4213-bcdb-cf6b4d987681" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "07a5297e-4f60-4213-bcdb-cf6b4d987681" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:36 user nova-compute[72809]: INFO nova.compute.manager [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Detaching volume 67e26e02-32ff-4f63-a885-d8dc8c123f59
Aug 09 07:01:36 user nova-compute[72809]: INFO nova.virt.block_device [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Attempting to driver detach volume 67e26e02-32ff-4f63-a885-d8dc8c123f59 from mountpoint /dev/vdb
Aug 09 07:01:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Attempting to detach device vdb from instance 07a5297e-4f60-4213-bcdb-cf6b4d987681 from the persistent domain config. {{(pid=72809) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 07:01:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:01:36 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:01:36 user nova-compute[72809]:   <source dev="/dev/sdc"/>
Aug 09 07:01:36 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:01:36 user nova-compute[72809]:   <serial>67e26e02-32ff-4f63-a885-d8dc8c123f59</serial>
Aug 09 07:01:36 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 07:01:36 user nova-compute[72809]: </disk>
Aug 09 07:01:36 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:01:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:36 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Successfully detached device vdb from instance 07a5297e-4f60-4213-bcdb-cf6b4d987681 from the persistent domain config.
Aug 09 07:01:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 07a5297e-4f60-4213-bcdb-cf6b4d987681 from the live domain config. {{(pid=72809) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 07:01:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:01:36 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:01:36 user nova-compute[72809]:   <source dev="/dev/sdc"/>
Aug 09 07:01:36 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:01:36 user nova-compute[72809]:   <serial>67e26e02-32ff-4f63-a885-d8dc8c123f59</serial>
Aug 09 07:01:36 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 07:01:36 user nova-compute[72809]: </disk>
Aug 09 07:01:36 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:01:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Received event <DeviceRemovedEvent: 1691564497.3329608, 07a5297e-4f60-4213-bcdb-cf6b4d987681 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72809) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 07a5297e-4f60-4213-bcdb-cf6b4d987681 {{(pid=72809) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 07:01:37 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Successfully detached device vdb from instance 07a5297e-4f60-4213-bcdb-cf6b4d987681 from the live domain config.
Aug 09 07:01:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wTQbjWni', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:01:37 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:01:37 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff567b0-2c06-4382-b1a3-72e18aad74e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a00ad78-b92c-4194-9fd8-1ec47ce34aa1]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 07:01:37 user nova-compute[72809]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:01:37 user nova-compute[72809]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 (non-flash)
Aug 09 07:01:37 user nova-compute[72809]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be (non-flash)
Aug 09 07:01:37 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 07:01:37 user nova-compute[72809]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:01:37 user nova-compute[72809]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 (non-flash)
Aug 09 07:01:37 user nova-compute[72809]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be (non-flash)
Aug 09 07:01:37 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc13851ecb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59'): ({'sdc'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Removing single pathed devices sdc {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a605fb4-56e7-4b72-96e4-42a689ec3669]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5674fb-016e-49da-9c5d-cf7266479d02]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Flushing IO for device /dev/sdc {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca10c58d-015c-4a1d-8d26-4be29d55c075]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c22eea1-23b3-479f-aeb7-46a5a0acaa07]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] SCSI volumes sdc have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[64efb1ed-8df9-4ba6-b38f-6bb57d5bf7c7]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c565741d-91dc-4fb7-ab53-fcfcfa7c3069]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59, portal: 172.16.0.220,3260]
Aug 09 07:01:37 user nova-compute[72809]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59, portal: 172.16.0.220,3260] successful.
Aug 09 07:01:37 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67e26e02-32ff-4f63-a885-d8dc8c123f59 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6368d6d-e172-48ba-be24-3b6fbdeb0909]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.413s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] <== disconnect_volume: return (416ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/736f31cf-d864-4eeb-a612-12af39cd0d2d/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/736f31cf-d864-4eeb-a612-12af39cd0d2d/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/736f31cf-d864-4eeb-a612-12af39cd0d2d/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/736f31cf-d864-4eeb-a612-12af39cd0d2d/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:38 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:01:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:38 user nova-compute[72809]: DEBUG nova.objects.instance [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lazy-loading 'flavor' on Instance uuid 07a5297e-4f60-4213-bcdb-cf6b4d987681 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:01:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-482b54f7-e1d3-4198-afd2-daeb5122c09d tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "07a5297e-4f60-4213-bcdb-cf6b4d987681" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.128s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d67126-7529-408e-a2ae-39c6bc152769/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "07a5297e-4f60-4213-bcdb-cf6b4d987681" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "07a5297e-4f60-4213-bcdb-cf6b4d987681" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:39 user nova-compute[72809]: INFO nova.compute.manager [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Detaching volume 0764b515-dcf1-4396-a89c-a62782dc76be
Aug 09 07:01:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d67126-7529-408e-a2ae-39c6bc152769/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d67126-7529-408e-a2ae-39c6bc152769/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:39 user nova-compute[72809]: INFO nova.virt.block_device [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Attempting to driver detach volume 0764b515-dcf1-4396-a89c-a62782dc76be from mountpoint /dev/vdc
Aug 09 07:01:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Attempting to detach device vdc from instance 07a5297e-4f60-4213-bcdb-cf6b4d987681 from the persistent domain config. {{(pid=72809) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 07:01:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:01:39 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:01:39 user nova-compute[72809]:   <source dev="/dev/sde"/>
Aug 09 07:01:39 user nova-compute[72809]:   <target dev="vdc" bus="virtio"/>
Aug 09 07:01:39 user nova-compute[72809]:   <serial>0764b515-dcf1-4396-a89c-a62782dc76be</serial>
Aug 09 07:01:39 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 07:01:39 user nova-compute[72809]: </disk>
Aug 09 07:01:39 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:01:39 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Successfully detached device vdc from instance 07a5297e-4f60-4213-bcdb-cf6b4d987681 from the persistent domain config.
Aug 09 07:01:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 07a5297e-4f60-4213-bcdb-cf6b4d987681 from the live domain config. {{(pid=72809) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 07:01:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:01:39 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:01:39 user nova-compute[72809]:   <source dev="/dev/sde"/>
Aug 09 07:01:39 user nova-compute[72809]:   <target dev="vdc" bus="virtio"/>
Aug 09 07:01:39 user nova-compute[72809]:   <serial>0764b515-dcf1-4396-a89c-a62782dc76be</serial>
Aug 09 07:01:39 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 07:01:39 user nova-compute[72809]: </disk>
Aug 09 07:01:39 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:01:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d67126-7529-408e-a2ae-39c6bc152769/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Received event <DeviceRemovedEvent: 1691564499.8468106, 07a5297e-4f60-4213-bcdb-cf6b4d987681 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72809) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691564484.6196814, 40bc627e-28c9-4450-9532-bf6db60845b2 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:01:40 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] VM Stopped (Lifecycle Event)
Aug 09 07:01:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 07a5297e-4f60-4213-bcdb-cf6b4d987681 {{(pid=72809) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 07:01:40 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Successfully detached device vdc from instance 07a5297e-4f60-4213-bcdb-cf6b4d987681 from the live domain config.
Aug 09 07:01:40 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:01:40 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:01:40 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=7207MB free_disk=25.301883697509766GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TkKmfxZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:01:40 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:01:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG nova.compute.manager [None req-6b932278-1cde-445c-bebd-9afe3b9bee5d None None] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[61251b63-8e9e-44bb-9b86-c10a5b1a481e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73fd796-7f1d-4338-a89a-2591a6b74e44]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 07:01:40 user nova-compute[72809]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:01:40 user nova-compute[72809]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be (non-flash)
Aug 09 07:01:40 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 07:01:40 user nova-compute[72809]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:01:40 user nova-compute[72809]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be (non-flash)
Aug 09 07:01:40 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc13851f250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be'): ({'sde'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Removing single pathed devices sde {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcd9be0-0f47-4e7a-a419-0b42c82d4757]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7f2c82-a09c-49a6-98c3-7e50d949d80a]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Flushing IO for device /dev/sde {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f131ca-9b96-4458-b107-5f5033710248]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 336770eb-4f09-4134-92ef-f96039bf4fa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 1bde423f-0b73-448f-bdce-8d6af96d8fc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance bebd5a14-6272-4de1-a1a1-4fb45b867c7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 339372ed-140d-4226-ba00-2cc682214d5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 25943f41-2d28-4ffe-b38b-ae34a99426e1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 38319c37-9cc0-4e84-8415-ddcf37451daf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 07a5297e-4f60-4213-bcdb-cf6b4d987681 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 51432417-89cc-4cee-855d-c4b148e4bd37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 466a8e58-5f88-4ffe-a7fd-a346003f3508 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 736f31cf-d864-4eeb-a612-12af39cd0d2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 59d67126-7529-408e-a2ae-39c6bc152769 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9fb487-3d17-4c94-b516-c06b0692211a]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] SCSI volumes sde have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4fcc60-d7a2-4fdf-8673-81807a9baded]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5693a34c-7e8c-487d-9ad0-8178d515d9f8]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be, portal: 172.16.0.220,3260]
Aug 09 07:01:40 user nova-compute[72809]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be, portal: 172.16.0.220,3260] successful.
Aug 09 07:01:40 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0764b515-dcf1-4396-a89c-a62782dc76be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[229c72db-5b4f-44aa-bd95-751315376497]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] <== disconnect_volume: return (295ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 07:01:40 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.527s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:41 user nova-compute[72809]: DEBUG nova.objects.instance [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lazy-loading 'flavor' on Instance uuid 07a5297e-4f60-4213-bcdb-cf6b4d987681 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:01:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f4db0962-c524-4708-b6ce-e49d13bafda5 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "07a5297e-4f60-4213-bcdb-cf6b4d987681" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.999s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-734a0d6b-5c4b-49c4-8338-744f34c57c65 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "07a5297e-4f60-4213-bcdb-cf6b4d987681" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-734a0d6b-5c4b-49c4-8338-744f34c57c65 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "07a5297e-4f60-4213-bcdb-cf6b4d987681" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-734a0d6b-5c4b-49c4-8338-744f34c57c65 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "07a5297e-4f60-4213-bcdb-cf6b4d987681-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-734a0d6b-5c4b-49c4-8338-744f34c57c65 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "07a5297e-4f60-4213-bcdb-cf6b4d987681-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-734a0d6b-5c4b-49c4-8338-744f34c57c65 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "07a5297e-4f60-4213-bcdb-cf6b4d987681-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:41 user nova-compute[72809]: INFO nova.compute.manager [None req-734a0d6b-5c4b-49c4-8338-744f34c57c65 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Terminating instance
Aug 09 07:01:41 user nova-compute[72809]: DEBUG nova.compute.manager [None req-734a0d6b-5c4b-49c4-8338-744f34c57c65 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:01:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:42 user nova-compute[72809]: DEBUG nova.compute.manager [req-bf27676a-25fc-4b33-a8b8-3d5e3351ac4b req-74d8681f-f9b8-4db5-bcf1-a9f2ac3f6bcd service nova] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Received event network-vif-unplugged-a3360ec8-df18-4a48-8005-d42ce8fac8a9 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:01:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-bf27676a-25fc-4b33-a8b8-3d5e3351ac4b req-74d8681f-f9b8-4db5-bcf1-a9f2ac3f6bcd service nova] Acquiring lock "07a5297e-4f60-4213-bcdb-cf6b4d987681-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-bf27676a-25fc-4b33-a8b8-3d5e3351ac4b req-74d8681f-f9b8-4db5-bcf1-a9f2ac3f6bcd service nova] Lock "07a5297e-4f60-4213-bcdb-cf6b4d987681-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-bf27676a-25fc-4b33-a8b8-3d5e3351ac4b req-74d8681f-f9b8-4db5-bcf1-a9f2ac3f6bcd service nova] Lock "07a5297e-4f60-4213-bcdb-cf6b4d987681-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:42 user nova-compute[72809]: DEBUG nova.compute.manager [req-bf27676a-25fc-4b33-a8b8-3d5e3351ac4b req-74d8681f-f9b8-4db5-bcf1-a9f2ac3f6bcd service nova] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] No waiting events found dispatching network-vif-unplugged-a3360ec8-df18-4a48-8005-d42ce8fac8a9 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:01:42 user nova-compute[72809]: DEBUG nova.compute.manager [req-bf27676a-25fc-4b33-a8b8-3d5e3351ac4b req-74d8681f-f9b8-4db5-bcf1-a9f2ac3f6bcd service nova] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Received event network-vif-unplugged-a3360ec8-df18-4a48-8005-d42ce8fac8a9 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:01:42 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Instance destroyed successfully.
Aug 09 07:01:42 user nova-compute[72809]: DEBUG nova.objects.instance [None req-734a0d6b-5c4b-49c4-8338-744f34c57c65 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lazy-loading 'resources' on Instance uuid 07a5297e-4f60-4213-bcdb-cf6b4d987681 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:01:42 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-734a0d6b-5c4b-49c4-8338-744f34c57c65 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:59:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1698664803',display_name='tempest-AttachVolumeTestJSON-server-1698664803',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1698664803',id=26,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4Qnq4ZYjYob73RZHDyRo4kM9HomnMqkXct1YNNdHcSI84n1UTjiauRomfT+nGKNoyU3pg/ue1/JFjwdppMPUU3VgAHs/AyPVL7RSmPsqe35+QGzDeOL4CyHWQtNAHZWw==',key_name='tempest-keypair-1787873700',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:59:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='55a7945f87914776a3f58bda58b7c90c',ramdisk_id='',reservation_id='r-p6w0u5wf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1328011883',owner_user_name='tempest-AttachVolumeTestJSON-1328011883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:59:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87785e8362a14385a951638f4d7cf817',uuid=07a5297e-4f60-4213-bcdb-cf6b4d987681,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3360ec8-df18-4a48-8005-d42ce8fac8a9", "address": "fa:16:3e:ed:86:d9", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3360ec8-df", "ovs_interfaceid": "a3360ec8-df18-4a48-8005-d42ce8fac8a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:01:42 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-734a0d6b-5c4b-49c4-8338-744f34c57c65 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Converting VIF {"id": "a3360ec8-df18-4a48-8005-d42ce8fac8a9", "address": "fa:16:3e:ed:86:d9", "network": {"id": "3430cb1f-9729-4613-bc8b-0fcdafd88198", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-253684433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55a7945f87914776a3f58bda58b7c90c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3360ec8-df", "ovs_interfaceid": "a3360ec8-df18-4a48-8005-d42ce8fac8a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:01:42 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-734a0d6b-5c4b-49c4-8338-744f34c57c65 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:86:d9,bridge_name='br-int',has_traffic_filtering=True,id=a3360ec8-df18-4a48-8005-d42ce8fac8a9,network=Network(3430cb1f-9729-4613-bc8b-0fcdafd88198),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3360ec8-df') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:01:42 user nova-compute[72809]: DEBUG os_vif [None req-734a0d6b-5c4b-49c4-8338-744f34c57c65 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:86:d9,bridge_name='br-int',has_traffic_filtering=True,id=a3360ec8-df18-4a48-8005-d42ce8fac8a9,network=Network(3430cb1f-9729-4613-bc8b-0fcdafd88198),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3360ec8-df') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:01:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3360ec8-df, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:01:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:01:42 user nova-compute[72809]: INFO os_vif [None req-734a0d6b-5c4b-49c4-8338-744f34c57c65 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:86:d9,bridge_name='br-int',has_traffic_filtering=True,id=a3360ec8-df18-4a48-8005-d42ce8fac8a9,network=Network(3430cb1f-9729-4613-bc8b-0fcdafd88198),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3360ec8-df')
Aug 09 07:01:42 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-734a0d6b-5c4b-49c4-8338-744f34c57c65 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Deleting instance files /opt/stack/data/nova/instances/07a5297e-4f60-4213-bcdb-cf6b4d987681_del
Aug 09 07:01:42 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-734a0d6b-5c4b-49c4-8338-744f34c57c65 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Deletion of /opt/stack/data/nova/instances/07a5297e-4f60-4213-bcdb-cf6b4d987681_del complete
Aug 09 07:01:42 user nova-compute[72809]: INFO nova.compute.manager [None req-734a0d6b-5c4b-49c4-8338-744f34c57c65 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 09 07:01:42 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-734a0d6b-5c4b-49c4-8338-744f34c57c65 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:01:42 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:01:42 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:01:42 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:01:42 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:01:42 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:01:42 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:01:42 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:01:42 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:01:42 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 07:01:43 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:01:43 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Took 0.88 seconds to deallocate network for instance.
Aug 09 07:01:43 user nova-compute[72809]: DEBUG nova.compute.manager [req-a69b8097-d95d-49b7-83bd-d72ce493bd3b req-6a05b518-c7fb-45c0-844d-b53834ad8d43 service nova] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Received event network-vif-deleted-a3360ec8-df18-4a48-8005-d42ce8fac8a9 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:01:43 user nova-compute[72809]: INFO nova.compute.manager [req-a69b8097-d95d-49b7-83bd-d72ce493bd3b req-6a05b518-c7fb-45c0-844d-b53834ad8d43 service nova] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Neutron deleted interface a3360ec8-df18-4a48-8005-d42ce8fac8a9; detaching it from the instance and deleting it from the info cache
Aug 09 07:01:43 user nova-compute[72809]: DEBUG nova.network.neutron [req-a69b8097-d95d-49b7-83bd-d72ce493bd3b req-6a05b518-c7fb-45c0-844d-b53834ad8d43 service nova] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:01:43 user nova-compute[72809]: DEBUG nova.compute.manager [req-a69b8097-d95d-49b7-83bd-d72ce493bd3b req-6a05b518-c7fb-45c0-844d-b53834ad8d43 service nova] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Detach interface failed, port_id=a3360ec8-df18-4a48-8005-d42ce8fac8a9, reason: Instance 07a5297e-4f60-4213-bcdb-cf6b4d987681 could not be found. {{(pid=72809) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 07:01:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-734a0d6b-5c4b-49c4-8338-744f34c57c65 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-734a0d6b-5c4b-49c4-8338-744f34c57c65 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:43 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-734a0d6b-5c4b-49c4-8338-744f34c57c65 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:01:43 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-734a0d6b-5c4b-49c4-8338-744f34c57c65 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:01:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-734a0d6b-5c4b-49c4-8338-744f34c57c65 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:43 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-734a0d6b-5c4b-49c4-8338-744f34c57c65 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Deleted allocations for instance 07a5297e-4f60-4213-bcdb-cf6b4d987681
Aug 09 07:01:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-734a0d6b-5c4b-49c4-8338-744f34c57c65 tempest-AttachVolumeTestJSON-1328011883 tempest-AttachVolumeTestJSON-1328011883-project-member] Lock "07a5297e-4f60-4213-bcdb-cf6b4d987681" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.279s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:44 user nova-compute[72809]: DEBUG nova.compute.manager [req-f6f0019f-494d-456b-9a2b-95ece6a10b4c req-e3d7657c-b27e-426a-9087-2ec4d4103874 service nova] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Received event network-vif-plugged-a3360ec8-df18-4a48-8005-d42ce8fac8a9 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:01:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f6f0019f-494d-456b-9a2b-95ece6a10b4c req-e3d7657c-b27e-426a-9087-2ec4d4103874 service nova] Acquiring lock "07a5297e-4f60-4213-bcdb-cf6b4d987681-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:01:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f6f0019f-494d-456b-9a2b-95ece6a10b4c req-e3d7657c-b27e-426a-9087-2ec4d4103874 service nova] Lock "07a5297e-4f60-4213-bcdb-cf6b4d987681-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:01:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f6f0019f-494d-456b-9a2b-95ece6a10b4c req-e3d7657c-b27e-426a-9087-2ec4d4103874 service nova] Lock "07a5297e-4f60-4213-bcdb-cf6b4d987681-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:01:44 user nova-compute[72809]: DEBUG nova.compute.manager [req-f6f0019f-494d-456b-9a2b-95ece6a10b4c req-e3d7657c-b27e-426a-9087-2ec4d4103874 service nova] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] No waiting events found dispatching network-vif-plugged-a3360ec8-df18-4a48-8005-d42ce8fac8a9 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:01:44 user nova-compute[72809]: WARNING nova.compute.manager [req-f6f0019f-494d-456b-9a2b-95ece6a10b4c req-e3d7657c-b27e-426a-9087-2ec4d4103874 service nova] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Received unexpected event network-vif-plugged-a3360ec8-df18-4a48-8005-d42ce8fac8a9 for instance with vm_state deleted and task_state None.
Aug 09 07:01:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:57 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691564502.4919357, 07a5297e-4f60-4213-bcdb-cf6b4d987681 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:01:57 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] VM Stopped (Lifecycle Event)
Aug 09 07:01:57 user nova-compute[72809]: DEBUG nova.compute.manager [None req-af21ee0a-7a82-4b91-871f-3e3c856f710e None None] [instance: 07a5297e-4f60-4213-bcdb-cf6b4d987681] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:01:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:01:59 user nova-compute[72809]: DEBUG nova.compute.manager [req-03551029-ee99-4bc0-998e-51dd6459df95 req-e6d4b678-312c-4ae7-b612-330d25b36911 service nova] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Received event network-changed-f11de67a-407a-46d8-853e-267e19d82001 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:01:59 user nova-compute[72809]: DEBUG nova.compute.manager [req-03551029-ee99-4bc0-998e-51dd6459df95 req-e6d4b678-312c-4ae7-b612-330d25b36911 service nova] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Refreshing instance network info cache due to event network-changed-f11de67a-407a-46d8-853e-267e19d82001. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:01:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-03551029-ee99-4bc0-998e-51dd6459df95 req-e6d4b678-312c-4ae7-b612-330d25b36911 service nova] Acquiring lock "refresh_cache-51432417-89cc-4cee-855d-c4b148e4bd37" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:01:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-03551029-ee99-4bc0-998e-51dd6459df95 req-e6d4b678-312c-4ae7-b612-330d25b36911 service nova] Acquired lock "refresh_cache-51432417-89cc-4cee-855d-c4b148e4bd37" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:01:59 user nova-compute[72809]: DEBUG nova.network.neutron [req-03551029-ee99-4bc0-998e-51dd6459df95 req-e6d4b678-312c-4ae7-b612-330d25b36911 service nova] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Refreshing network info cache for port f11de67a-407a-46d8-853e-267e19d82001 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Acquiring lock "25943f41-2d28-4ffe-b38b-ae34a99426e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lock "25943f41-2d28-4ffe-b38b-ae34a99426e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Acquiring lock "25943f41-2d28-4ffe-b38b-ae34a99426e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lock "25943f41-2d28-4ffe-b38b-ae34a99426e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lock "25943f41-2d28-4ffe-b38b-ae34a99426e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:00 user nova-compute[72809]: INFO nova.compute.manager [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Terminating instance
Aug 09 07:02:00 user nova-compute[72809]: DEBUG nova.compute.manager [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Acquiring lock "51432417-89cc-4cee-855d-c4b148e4bd37" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "51432417-89cc-4cee-855d-c4b148e4bd37" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG nova.objects.instance [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lazy-loading 'flavor' on Instance uuid 51432417-89cc-4cee-855d-c4b148e4bd37 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "51432417-89cc-4cee-855d-c4b148e4bd37" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Acquiring lock "51432417-89cc-4cee-855d-c4b148e4bd37" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "51432417-89cc-4cee-855d-c4b148e4bd37" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:00 user nova-compute[72809]: INFO nova.compute.manager [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Attaching volume 7ef6cf26-1d67-4739-9ed9-f8493a1759fa to /dev/vdb
Aug 09 07:02:00 user nova-compute[72809]: DEBUG os_brick.utils [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b92eac-8812-4249-ab98-be3117a3f692]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c579289d-5bf0-4c1a-8283-fff19038efa4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[481ccc2b-cebf-4f5a-b8f5-f35ca2170a51]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02f71c9-fa26-4503-8939-5ae5f06df6fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:02:00 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f214e724-5a91-43d7-a19b-46705d516cb4]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG os_brick.utils [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Updating existing volume attachment record: 433b6bc8-e35c-4016-95ac-0acc387522d9 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 07:02:00 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Instance destroyed successfully.
Aug 09 07:02:00 user nova-compute[72809]: DEBUG nova.objects.instance [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lazy-loading 'resources' on Instance uuid 25943f41-2d28-4ffe-b38b-ae34a99426e1 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T06:57:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1510155707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-746793904',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaQ4scRY1Gs40gnfMXMH9+94YnOoay8Xk4x1JUX9Bi5t92OrKSGMiljWmXUj+GTELgNUptiW7m1t9tJjH9WklkC4tVBDCva2tyGVNhU3VtR7ORGer1lOM2KxVeRyFujXA==',key_name='tempest-keypair-1187965605',keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:00:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b76be74ac2b46049686e6fdcef82dbb',ramdisk_id='',reservation_id='r-y0g6fmqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1383955831',owner_user_name='tempest-ServerActionsV293TestJSON-1383955831-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:00:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66208d0453c0457ea5402ee892558f33',uuid=25943f41-2d28-4ffe-b38b-ae34a99426e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eaaf2699-4583-4421-872a-117e799570e5", "address": "fa:16:3e:47:32:ed", "network": {"id": "514e9a73-337b-46a7-b516-df614914735a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-23845660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b76be74ac2b46049686e6fdcef82dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf2699-45", "ovs_interfaceid": "eaaf2699-4583-4421-872a-117e799570e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Converting VIF {"id": "eaaf2699-4583-4421-872a-117e799570e5", "address": "fa:16:3e:47:32:ed", "network": {"id": "514e9a73-337b-46a7-b516-df614914735a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-23845660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b76be74ac2b46049686e6fdcef82dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf2699-45", "ovs_interfaceid": "eaaf2699-4583-4421-872a-117e799570e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:32:ed,bridge_name='br-int',has_traffic_filtering=True,id=eaaf2699-4583-4421-872a-117e799570e5,network=Network(514e9a73-337b-46a7-b516-df614914735a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaaf2699-45') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG os_vif [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:32:ed,bridge_name='br-int',has_traffic_filtering=True,id=eaaf2699-4583-4421-872a-117e799570e5,network=Network(514e9a73-337b-46a7-b516-df614914735a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaaf2699-45') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeaaf2699-45, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:00 user nova-compute[72809]: INFO os_vif [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:32:ed,bridge_name='br-int',has_traffic_filtering=True,id=eaaf2699-4583-4421-872a-117e799570e5,network=Network(514e9a73-337b-46a7-b516-df614914735a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaaf2699-45')
Aug 09 07:02:00 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXAPdNUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:02:00 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:02:00 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9207afe-8641-47fd-9cbd-eb8aa351f33c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f97ea5a-6740-4009-8144-e1d91379ba3d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 07:02:00 user nova-compute[72809]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:02:00 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 (non-flash)
Aug 09 07:02:00 user nova-compute[72809]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:02:00 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc1386c4160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521'): ({'sdd'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Removing single pathed devices sdd {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2ca2a0-bacf-4897-b7a2-68dfabefb89d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9976fb-31f9-4862-978a-cb2b50170057]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Flushing IO for device /dev/sdd {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG nova.compute.manager [req-cb09e75d-810c-4773-8933-2e1636490242 req-7be7213a-2c5f-46e1-a41c-5f5ae9aa2dfe service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Received event network-vif-unplugged-eaaf2699-4583-4421-872a-117e799570e5 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-cb09e75d-810c-4773-8933-2e1636490242 req-7be7213a-2c5f-46e1-a41c-5f5ae9aa2dfe service nova] Acquiring lock "25943f41-2d28-4ffe-b38b-ae34a99426e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-cb09e75d-810c-4773-8933-2e1636490242 req-7be7213a-2c5f-46e1-a41c-5f5ae9aa2dfe service nova] Lock "25943f41-2d28-4ffe-b38b-ae34a99426e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-cb09e75d-810c-4773-8933-2e1636490242 req-7be7213a-2c5f-46e1-a41c-5f5ae9aa2dfe service nova] Lock "25943f41-2d28-4ffe-b38b-ae34a99426e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG nova.compute.manager [req-cb09e75d-810c-4773-8933-2e1636490242 req-7be7213a-2c5f-46e1-a41c-5f5ae9aa2dfe service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] No waiting events found dispatching network-vif-unplugged-eaaf2699-4583-4421-872a-117e799570e5 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG nova.compute.manager [req-cb09e75d-810c-4773-8933-2e1636490242 req-7be7213a-2c5f-46e1-a41c-5f5ae9aa2dfe service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Received event network-vif-unplugged-eaaf2699-4583-4421-872a-117e799570e5 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[35590f8b-5d2f-4c50-983f-5e072d79efae]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:02:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:01 user nova-compute[72809]: DEBUG nova.network.neutron [req-03551029-ee99-4bc0-998e-51dd6459df95 req-e6d4b678-312c-4ae7-b612-330d25b36911 service nova] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Updated VIF entry in instance network info cache for port f11de67a-407a-46d8-853e-267e19d82001. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:02:01 user nova-compute[72809]: DEBUG nova.network.neutron [req-03551029-ee99-4bc0-998e-51dd6459df95 req-e6d4b678-312c-4ae7-b612-330d25b36911 service nova] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Updating instance_info_cache with network_info: [{"id": "f11de67a-407a-46d8-853e-267e19d82001", "address": "fa:16:3e:a6:83:61", "network": {"id": "aaea335c-52d5-402b-b53c-b53cc3d7385d", "bridge": "br-int", "label": "tempest-TestStampPattern-1348939935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77be39d2ba434d42bd6b08194503031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11de67a-40", "ovs_interfaceid": "f11de67a-407a-46d8-853e-267e19d82001", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:02:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:01 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a416b55-2a78-40be-ad9a-81a5e86ef3af]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:01 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:02:01 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] SCSI volumes sdd have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:02:01 user nova-compute[72809]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_6ec73fdf', '/dev/disk/by-id/scsi-26464653164376464', '/dev/disk/by-id/scsi-1SCST_BIO6ec73fdf-dde1d7dde559dc9b') {{(pid=83900) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 07:02:01 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c285b8-2e52-407b-bbc6-b189a82dad1f]: (4, None) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:02:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-03551029-ee99-4bc0-998e-51dd6459df95 req-e6d4b678-312c-4ae7-b612-330d25b36911 service nova] Releasing lock "refresh_cache-51432417-89cc-4cee-855d-c4b148e4bd37" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:02:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:01 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[049b2829-ee80-4feb-8582-1ff8bad137ee]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:02:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:01 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[85442fab-1be2-4ac3-b931-e962af2dc2f4]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521, portal: 172.16.0.220,3260]
Aug 09 07:02:01 user nova-compute[72809]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521, portal: 172.16.0.220,3260] successful.
Aug 09 07:02:01 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:02:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63dec66c-f14e-46ac-becb-481479048521 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:01 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfde7583-d8c1-4278-a137-342d6b8ad0f4]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:02:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:02:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] <== disconnect_volume: return (302ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:02:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:02:01 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Deleting instance files /opt/stack/data/nova/instances/25943f41-2d28-4ffe-b38b-ae34a99426e1_del
Aug 09 07:02:01 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Deletion of /opt/stack/data/nova/instances/25943f41-2d28-4ffe-b38b-ae34a99426e1_del complete
Aug 09 07:02:01 user nova-compute[72809]: INFO nova.compute.manager [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 09 07:02:01 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:02:01 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:02:01 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:02:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:02 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:02:02 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Took 0.96 seconds to deallocate network for instance.
Aug 09 07:02:03 user nova-compute[72809]: DEBUG nova.compute.manager [req-0079240b-4cd6-4961-b500-da11aa61d54a req-c34c197e-872c-4360-92b0-048f98e3c786 service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Received event network-vif-plugged-eaaf2699-4583-4421-872a-117e799570e5 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:02:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0079240b-4cd6-4961-b500-da11aa61d54a req-c34c197e-872c-4360-92b0-048f98e3c786 service nova] Acquiring lock "25943f41-2d28-4ffe-b38b-ae34a99426e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0079240b-4cd6-4961-b500-da11aa61d54a req-c34c197e-872c-4360-92b0-048f98e3c786 service nova] Lock "25943f41-2d28-4ffe-b38b-ae34a99426e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0079240b-4cd6-4961-b500-da11aa61d54a req-c34c197e-872c-4360-92b0-048f98e3c786 service nova] Lock "25943f41-2d28-4ffe-b38b-ae34a99426e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:03 user nova-compute[72809]: DEBUG nova.compute.manager [req-0079240b-4cd6-4961-b500-da11aa61d54a req-c34c197e-872c-4360-92b0-048f98e3c786 service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] No waiting events found dispatching network-vif-plugged-eaaf2699-4583-4421-872a-117e799570e5 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:02:03 user nova-compute[72809]: WARNING nova.compute.manager [req-0079240b-4cd6-4961-b500-da11aa61d54a req-c34c197e-872c-4360-92b0-048f98e3c786 service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Received unexpected event network-vif-plugged-eaaf2699-4583-4421-872a-117e799570e5 for instance with vm_state active and task_state deleting.
Aug 09 07:02:03 user nova-compute[72809]: DEBUG nova.compute.manager [req-0079240b-4cd6-4961-b500-da11aa61d54a req-c34c197e-872c-4360-92b0-048f98e3c786 service nova] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Received event network-vif-deleted-eaaf2699-4583-4421-872a-117e799570e5 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:02:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "b5cab676-b3c0-4f05-9e44-42e5a6677857" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "b5cab676-b3c0-4f05-9e44-42e5a6677857" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:03 user nova-compute[72809]: DEBUG nova.compute.manager [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 07:02:03 user nova-compute[72809]: INFO nova.compute.manager [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Took 0.88 seconds to detach 1 volumes for instance.
Aug 09 07:02:03 user nova-compute[72809]: DEBUG nova.compute.manager [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Deleting volume: 63dec66c-f14e-46ac-becb-481479048521 {{(pid=72809) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 07:02:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:03 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 07:02:03 user nova-compute[72809]: INFO nova.compute.claims [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Claim successful on node user
Aug 09 07:02:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:03 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:02:03 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:02:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:03 user nova-compute[72809]: DEBUG nova.compute.manager [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 07:02:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.345s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:03 user nova-compute[72809]: DEBUG nova.compute.manager [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 07:02:03 user nova-compute[72809]: DEBUG nova.network.neutron [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 07:02:03 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 07:02:03 user nova-compute[72809]: DEBUG nova.compute.manager [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 07:02:03 user nova-compute[72809]: DEBUG nova.policy [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f85a1f2a88fd40a48d1c4dba13f0ac09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce7c486aaca4ef89eb7e392b717e3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 07:02:03 user nova-compute[72809]: DEBUG nova.compute.manager [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 07:02:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 07:02:03 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Creating image(s)
Aug 09 07:02:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5cab676-b3c0-4f05-9e44-42e5a6677857/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "/opt/stack/data/nova/instances/b5cab676-b3c0-4f05-9e44-42e5a6677857/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "/opt/stack/data/nova/instances/b5cab676-b3c0-4f05-9e44-42e5a6677857/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:03 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:02:04 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.147s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:04 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:04 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:02:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.506s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:04 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Deleted allocations for instance 25943f41-2d28-4ffe-b38b-ae34a99426e1
Aug 09 07:02:04 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.155s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:04 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/b5cab676-b3c0-4f05-9e44-42e5a6677857/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-020751b0-62b5-4262-8356-58032f2121b1 tempest-ServerActionsV293TestJSON-1383955831 tempest-ServerActionsV293TestJSON-1383955831-project-member] Lock "25943f41-2d28-4ffe-b38b-ae34a99426e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.206s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:04 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/b5cab676-b3c0-4f05-9e44-42e5a6677857/disk 1073741824" returned: 0 in 0.077s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:04 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:04 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.170s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:04 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5cab676-b3c0-4f05-9e44-42e5a6677857/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 07:02:04 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cab676-b3c0-4f05-9e44-42e5a6677857/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:04 user nova-compute[72809]: DEBUG nova.network.neutron [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Successfully created port: df6b4846-8c11-4271-9184-f9f93aec39d5 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 07:02:04 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cab676-b3c0-4f05-9e44-42e5a6677857/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:04 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Cannot resize image /opt/stack/data/nova/instances/b5cab676-b3c0-4f05-9e44-42e5a6677857/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 07:02:04 user nova-compute[72809]: DEBUG nova.objects.instance [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lazy-loading 'migration_context' on Instance uuid b5cab676-b3c0-4f05-9e44-42e5a6677857 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:02:04 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 07:02:04 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Ensure instance console log exists: /opt/stack/data/nova/instances/b5cab676-b3c0-4f05-9e44-42e5a6677857/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 07:02:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.network.neutron [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Successfully updated port: df6b4846-8c11-4271-9184-f9f93aec39d5 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "refresh_cache-b5cab676-b3c0-4f05-9e44-42e5a6677857" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquired lock "refresh_cache-b5cab676-b3c0-4f05-9e44-42e5a6677857" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.network.neutron [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.compute.manager [req-73df36aa-e1df-40f5-9b48-7a742112d4ed req-851252eb-39ea-4225-ade9-700ba61147b8 service nova] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Received event network-changed-df6b4846-8c11-4271-9184-f9f93aec39d5 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.compute.manager [req-73df36aa-e1df-40f5-9b48-7a742112d4ed req-851252eb-39ea-4225-ade9-700ba61147b8 service nova] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Refreshing instance network info cache due to event network-changed-df6b4846-8c11-4271-9184-f9f93aec39d5. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-73df36aa-e1df-40f5-9b48-7a742112d4ed req-851252eb-39ea-4225-ade9-700ba61147b8 service nova] Acquiring lock "refresh_cache-b5cab676-b3c0-4f05-9e44-42e5a6677857" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.network.neutron [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.network.neutron [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Updating instance_info_cache with network_info: [{"id": "df6b4846-8c11-4271-9184-f9f93aec39d5", "address": "fa:16:3e:5f:ac:5e", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6b4846-8c", "ovs_interfaceid": "df6b4846-8c11-4271-9184-f9f93aec39d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Releasing lock "refresh_cache-b5cab676-b3c0-4f05-9e44-42e5a6677857" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.compute.manager [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Instance network_info: |[{"id": "df6b4846-8c11-4271-9184-f9f93aec39d5", "address": "fa:16:3e:5f:ac:5e", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6b4846-8c", "ovs_interfaceid": "df6b4846-8c11-4271-9184-f9f93aec39d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-73df36aa-e1df-40f5-9b48-7a742112d4ed req-851252eb-39ea-4225-ade9-700ba61147b8 service nova] Acquired lock "refresh_cache-b5cab676-b3c0-4f05-9e44-42e5a6677857" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.network.neutron [req-73df36aa-e1df-40f5-9b48-7a742112d4ed req-851252eb-39ea-4225-ade9-700ba61147b8 service nova] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Refreshing network info cache for port df6b4846-8c11-4271-9184-f9f93aec39d5 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Start _get_guest_xml network_info=[{"id": "df6b4846-8c11-4271-9184-f9f93aec39d5", "address": "fa:16:3e:5f:ac:5e", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6b4846-8c", "ovs_interfaceid": "df6b4846-8c11-4271-9184-f9f93aec39d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 07:02:05 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:02:05 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:02:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-688250549',display_name='tempest-AttachVolumeNegativeTest-server-688250549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-688250549',id=32,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGfSo4DnR6adPalFM6PjjdebJ8nE+BaVjdwiVPJ4Sns/2C3/6sEc3T8MEg6RpF3p+Y0KBHIfVAsD+J7PEnpcwdPscKXuCnaI4B0WnJuGRxMfljx685GCBljf3J3+JOKcA==',key_name='tempest-keypair-462626796',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ce7c486aaca4ef89eb7e392b717e3d7',ramdisk_id='',reservation_id='r-ctqz6wra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2066250801',owner_user_name='tempest-AttachVolumeNegativeTest-2066250801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:02:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f85a1f2a88fd40a48d1c4dba13f0ac09',uuid=b5cab676-b3c0-4f05-9e44-42e5a6677857,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df6b4846-8c11-4271-9184-f9f93aec39d5", "address": "fa:16:3e:5f:ac:5e", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6b4846-8c", "ovs_interfaceid": "df6b4846-8c11-4271-9184-f9f93aec39d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Converting VIF {"id": "df6b4846-8c11-4271-9184-f9f93aec39d5", "address": "fa:16:3e:5f:ac:5e", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6b4846-8c", "ovs_interfaceid": "df6b4846-8c11-4271-9184-f9f93aec39d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ac:5e,bridge_name='br-int',has_traffic_filtering=True,id=df6b4846-8c11-4271-9184-f9f93aec39d5,network=Network(1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf6b4846-8c') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.objects.instance [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lazy-loading 'pci_devices' on Instance uuid b5cab676-b3c0-4f05-9e44-42e5a6677857 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] End _get_guest_xml xml=<domain type="kvm">
Aug 09 07:02:05 user nova-compute[72809]:   <uuid>b5cab676-b3c0-4f05-9e44-42e5a6677857</uuid>
Aug 09 07:02:05 user nova-compute[72809]:   <name>instance-00000020</name>
Aug 09 07:02:05 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 07:02:05 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 07:02:05 user nova-compute[72809]:   <metadata>
Aug 09 07:02:05 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 07:02:05 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 07:02:05 user nova-compute[72809]:       <nova:name>tempest-AttachVolumeNegativeTest-server-688250549</nova:name>
Aug 09 07:02:05 user nova-compute[72809]:       <nova:creationTime>2023-08-09 07:02:05</nova:creationTime>
Aug 09 07:02:05 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 07:02:05 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 07:02:05 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 07:02:05 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 07:02:05 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 07:02:05 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 07:02:05 user nova-compute[72809]:       </nova:flavor>
Aug 09 07:02:05 user nova-compute[72809]:       <nova:owner>
Aug 09 07:02:05 user nova-compute[72809]:         <nova:user uuid="f85a1f2a88fd40a48d1c4dba13f0ac09">tempest-AttachVolumeNegativeTest-2066250801-project-member</nova:user>
Aug 09 07:02:05 user nova-compute[72809]:         <nova:project uuid="8ce7c486aaca4ef89eb7e392b717e3d7">tempest-AttachVolumeNegativeTest-2066250801</nova:project>
Aug 09 07:02:05 user nova-compute[72809]:       </nova:owner>
Aug 09 07:02:05 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 07:02:05 user nova-compute[72809]:       <nova:ports>
Aug 09 07:02:05 user nova-compute[72809]:         <nova:port uuid="df6b4846-8c11-4271-9184-f9f93aec39d5">
Aug 09 07:02:05 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 07:02:05 user nova-compute[72809]:         </nova:port>
Aug 09 07:02:05 user nova-compute[72809]:       </nova:ports>
Aug 09 07:02:05 user nova-compute[72809]:     </nova:instance>
Aug 09 07:02:05 user nova-compute[72809]:   </metadata>
Aug 09 07:02:05 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 07:02:05 user nova-compute[72809]:     <system>
Aug 09 07:02:05 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 07:02:05 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 07:02:05 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 07:02:05 user nova-compute[72809]:       <entry name="serial">b5cab676-b3c0-4f05-9e44-42e5a6677857</entry>
Aug 09 07:02:05 user nova-compute[72809]:       <entry name="uuid">b5cab676-b3c0-4f05-9e44-42e5a6677857</entry>
Aug 09 07:02:05 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 07:02:05 user nova-compute[72809]:     </system>
Aug 09 07:02:05 user nova-compute[72809]:   </sysinfo>
Aug 09 07:02:05 user nova-compute[72809]:   <os>
Aug 09 07:02:05 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 07:02:05 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 07:02:05 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 07:02:05 user nova-compute[72809]:   </os>
Aug 09 07:02:05 user nova-compute[72809]:   <features>
Aug 09 07:02:05 user nova-compute[72809]:     <acpi/>
Aug 09 07:02:05 user nova-compute[72809]:     <apic/>
Aug 09 07:02:05 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 07:02:05 user nova-compute[72809]:   </features>
Aug 09 07:02:05 user nova-compute[72809]:   <clock offset="utc">
Aug 09 07:02:05 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 07:02:05 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 07:02:05 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 07:02:05 user nova-compute[72809]:   </clock>
Aug 09 07:02:05 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 07:02:05 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 07:02:05 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 07:02:05 user nova-compute[72809]:   </cpu>
Aug 09 07:02:05 user nova-compute[72809]:   <devices>
Aug 09 07:02:05 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 07:02:05 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 07:02:05 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/b5cab676-b3c0-4f05-9e44-42e5a6677857/disk"/>
Aug 09 07:02:05 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 07:02:05 user nova-compute[72809]:     </disk>
Aug 09 07:02:05 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 07:02:05 user nova-compute[72809]:       <mac address="fa:16:3e:5f:ac:5e"/>
Aug 09 07:02:05 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:02:05 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 07:02:05 user nova-compute[72809]:       <target dev="tapdf6b4846-8c"/>
Aug 09 07:02:05 user nova-compute[72809]:     </interface>
Aug 09 07:02:05 user nova-compute[72809]:     <serial type="pty">
Aug 09 07:02:05 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/b5cab676-b3c0-4f05-9e44-42e5a6677857/console.log" append="off"/>
Aug 09 07:02:05 user nova-compute[72809]:     </serial>
Aug 09 07:02:05 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 07:02:05 user nova-compute[72809]:     <video>
Aug 09 07:02:05 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:02:05 user nova-compute[72809]:     </video>
Aug 09 07:02:05 user nova-compute[72809]:     <rng model="virtio">
Aug 09 07:02:05 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 07:02:05 user nova-compute[72809]:     </rng>
Aug 09 07:02:05 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 07:02:05 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 07:02:05 user nova-compute[72809]:       <stats period="10"/>
Aug 09 07:02:05 user nova-compute[72809]:     </memballoon>
Aug 09 07:02:05 user nova-compute[72809]:   </devices>
Aug 09 07:02:05 user nova-compute[72809]: </domain>
Aug 09 07:02:05 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:02:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-688250549',display_name='tempest-AttachVolumeNegativeTest-server-688250549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-688250549',id=32,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGfSo4DnR6adPalFM6PjjdebJ8nE+BaVjdwiVPJ4Sns/2C3/6sEc3T8MEg6RpF3p+Y0KBHIfVAsD+J7PEnpcwdPscKXuCnaI4B0WnJuGRxMfljx685GCBljf3J3+JOKcA==',key_name='tempest-keypair-462626796',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ce7c486aaca4ef89eb7e392b717e3d7',ramdisk_id='',reservation_id='r-ctqz6wra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2066250801',owner_user_name='tempest-AttachVolumeNegativeTest-2066250801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:02:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f85a1f2a88fd40a48d1c4dba13f0ac09',uuid=b5cab676-b3c0-4f05-9e44-42e5a6677857,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df6b4846-8c11-4271-9184-f9f93aec39d5", "address": "fa:16:3e:5f:ac:5e", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6b4846-8c", "ovs_interfaceid": "df6b4846-8c11-4271-9184-f9f93aec39d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Converting VIF {"id": "df6b4846-8c11-4271-9184-f9f93aec39d5", "address": "fa:16:3e:5f:ac:5e", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6b4846-8c", "ovs_interfaceid": "df6b4846-8c11-4271-9184-f9f93aec39d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ac:5e,bridge_name='br-int',has_traffic_filtering=True,id=df6b4846-8c11-4271-9184-f9f93aec39d5,network=Network(1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf6b4846-8c') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG os_vif [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ac:5e,bridge_name='br-int',has_traffic_filtering=True,id=df6b4846-8c11-4271-9184-f9f93aec39d5,network=Network(1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf6b4846-8c') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf6b4846-8c, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdf6b4846-8c, col_values=(('external_ids', {'iface-id': 'df6b4846-8c11-4271-9184-f9f93aec39d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:ac:5e', 'vm-uuid': 'b5cab676-b3c0-4f05-9e44-42e5a6677857'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:05 user nova-compute[72809]: INFO os_vif [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ac:5e,bridge_name='br-int',has_traffic_filtering=True,id=df6b4846-8c11-4271-9184-f9f93aec39d5,network=Network(1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf6b4846-8c')
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:02:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] No VIF found with MAC fa:16:3e:5f:ac:5e, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:02:06 user nova-compute[72809]: DEBUG nova.network.neutron [req-73df36aa-e1df-40f5-9b48-7a742112d4ed req-851252eb-39ea-4225-ade9-700ba61147b8 service nova] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Updated VIF entry in instance network info cache for port df6b4846-8c11-4271-9184-f9f93aec39d5. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:02:06 user nova-compute[72809]: DEBUG nova.network.neutron [req-73df36aa-e1df-40f5-9b48-7a742112d4ed req-851252eb-39ea-4225-ade9-700ba61147b8 service nova] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Updating instance_info_cache with network_info: [{"id": "df6b4846-8c11-4271-9184-f9f93aec39d5", "address": "fa:16:3e:5f:ac:5e", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6b4846-8c", "ovs_interfaceid": "df6b4846-8c11-4271-9184-f9f93aec39d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:02:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-73df36aa-e1df-40f5-9b48-7a742112d4ed req-851252eb-39ea-4225-ade9-700ba61147b8 service nova] Releasing lock "refresh_cache-b5cab676-b3c0-4f05-9e44-42e5a6677857" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:02:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-05d7c6a4-2222-4ec7-a772-879554caf596 req-ae2eb643-c2d6-4682-b88a-51304004447b service nova] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Received event network-vif-plugged-df6b4846-8c11-4271-9184-f9f93aec39d5 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:02:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-05d7c6a4-2222-4ec7-a772-879554caf596 req-ae2eb643-c2d6-4682-b88a-51304004447b service nova] Acquiring lock "b5cab676-b3c0-4f05-9e44-42e5a6677857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-05d7c6a4-2222-4ec7-a772-879554caf596 req-ae2eb643-c2d6-4682-b88a-51304004447b service nova] Lock "b5cab676-b3c0-4f05-9e44-42e5a6677857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-05d7c6a4-2222-4ec7-a772-879554caf596 req-ae2eb643-c2d6-4682-b88a-51304004447b service nova] Lock "b5cab676-b3c0-4f05-9e44-42e5a6677857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-05d7c6a4-2222-4ec7-a772-879554caf596 req-ae2eb643-c2d6-4682-b88a-51304004447b service nova] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] No waiting events found dispatching network-vif-plugged-df6b4846-8c11-4271-9184-f9f93aec39d5 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:02:07 user nova-compute[72809]: WARNING nova.compute.manager [req-05d7c6a4-2222-4ec7-a772-879554caf596 req-ae2eb643-c2d6-4682-b88a-51304004447b service nova] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Received unexpected event network-vif-plugged-df6b4846-8c11-4271-9184-f9f93aec39d5 for instance with vm_state building and task_state spawning.
Aug 09 07:02:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564529.1785383, b5cab676-b3c0-4f05-9e44-42e5a6677857 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:02:09 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] VM Resumed (Lifecycle Event)
Aug 09 07:02:09 user nova-compute[72809]: DEBUG nova.compute.manager [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 07:02:09 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Instance spawned successfully.
Aug 09 07:02:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HEOblMZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:02:09 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:02:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:02:09 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:02:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:02:09 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 07:02:09 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cbea72-c512-41a4-8326-c6e9e94cf822]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 07:02:09 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:09 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:02:09 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564529.18068, b5cab676-b3c0-4f05-9e44-42e5a6677857 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:02:09 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] VM Started (Lifecycle Event)
Aug 09 07:02:09 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d4efe0-80a3-4c5b-b485-3c737c94b24d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa] added
Aug 09 07:02:09 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:02:09 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d45a54-e8ae-46f6-9141-0c7b6c04dbde]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:09 user nova-compute[72809]: INFO nova.compute.manager [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Took 5.46 seconds to spawn the instance on the hypervisor.
Aug 09 07:02:09 user nova-compute[72809]: DEBUG nova.compute.manager [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ad03ed-7a9b-4511-bb87-11d2cb1500e4]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG nova.compute.manager [req-a7e2ca05-5cdc-47a5-975e-bde2c0983a13 req-1b6125a0-084f-41a9-8150-2d4aab6128b4 service nova] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Received event network-vif-plugged-df6b4846-8c11-4271-9184-f9f93aec39d5 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a7e2ca05-5cdc-47a5-975e-bde2c0983a13 req-1b6125a0-084f-41a9-8150-2d4aab6128b4 service nova] Acquiring lock "b5cab676-b3c0-4f05-9e44-42e5a6677857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a7e2ca05-5cdc-47a5-975e-bde2c0983a13 req-1b6125a0-084f-41a9-8150-2d4aab6128b4 service nova] Lock "b5cab676-b3c0-4f05-9e44-42e5a6677857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a7e2ca05-5cdc-47a5-975e-bde2c0983a13 req-1b6125a0-084f-41a9-8150-2d4aab6128b4 service nova] Lock "b5cab676-b3c0-4f05-9e44-42e5a6677857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG nova.compute.manager [req-a7e2ca05-5cdc-47a5-975e-bde2c0983a13 req-1b6125a0-084f-41a9-8150-2d4aab6128b4 service nova] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] No waiting events found dispatching network-vif-plugged-df6b4846-8c11-4271-9184-f9f93aec39d5 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:02:09 user nova-compute[72809]: WARNING nova.compute.manager [req-a7e2ca05-5cdc-47a5-975e-bde2c0983a13 req-1b6125a0-084f-41a9-8150-2d4aab6128b4 service nova] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Received unexpected event network-vif-plugged-df6b4846-8c11-4271-9184-f9f93aec39d5 for instance with vm_state building and task_state spawning.
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HEOblMZf {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HEOblMZf" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf04aa5f-b05a-4085-a8b4-0af6cab49154]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HEOblMZf'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3e9480-a720-4215-bb1b-985fa02fef17]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80eec35-a4cc-4042-a98c-b5378cb8dc45]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:02:09 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:02:09 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:09 user nova-compute[72809]: INFO nova.compute.manager [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Took 6.29 seconds to build instance.
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-41ee2b0e-ab21-4d30-826f-ddb344053693 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "b5cab676-b3c0-4f05-9e44-42e5a6677857" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.383s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1e0bd4-eade-4613-9382-9def7353b3af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa, portal: 172.16.0.220,3260]
Aug 09 07:02:09 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa, portal: 172.16.0.220,3260] successful.
Aug 09 07:02:09 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d644db19-50e7-4fb5-b78a-c3d6f8607a8a]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ab4c18-6682-4266-8132-f70656622550]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:02:09 user nova-compute[72809]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa (non-flash)
Aug 09 07:02:09 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:02:09 user nova-compute[72809]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa (non-flash)
Aug 09 07:02:09 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fd43bb-e032-4cd3-9e21-e440490eb8d8]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:02:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HEOblMZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 07:02:10 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:02:10 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26163343331396137', 'path': '/dev/sdc'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:02:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163343331396137', 'path': '/dev/sdc'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 07:02:10 user nova-compute[72809]: DEBUG nova.objects.instance [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lazy-loading 'flavor' on Instance uuid 51432417-89cc-4cee-855d-c4b148e4bd37 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:02:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 07:02:10 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:02:10 user nova-compute[72809]:   <source dev="/dev/sdc"/>
Aug 09 07:02:10 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:02:10 user nova-compute[72809]:   <serial>7ef6cf26-1d67-4739-9ed9-f8493a1759fa</serial>
Aug 09 07:02:10 user nova-compute[72809]: </disk>
Aug 09 07:02:10 user nova-compute[72809]:  {{(pid=72809) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 07:02:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:02:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:02:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] No VIF found with MAC fa:16:3e:a6:83:61, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:02:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8af63d3e-7360-453e-a32e-d0d0d63f409b tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "51432417-89cc-4cee-855d-c4b148e4bd37" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.631s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:11 user nova-compute[72809]: INFO nova.compute.manager [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Rescuing
Aug 09 07:02:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "refresh_cache-466a8e58-5f88-4ffe-a7fd-a346003f3508" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:02:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquired lock "refresh_cache-466a8e58-5f88-4ffe-a7fd-a346003f3508" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:02:11 user nova-compute[72809]: DEBUG nova.network.neutron [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:02:11 user nova-compute[72809]: DEBUG nova.network.neutron [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Updating instance_info_cache with network_info: [{"id": "8a95ff1b-0686-455d-977c-cedac8be3930", "address": "fa:16:3e:42:8d:bd", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a95ff1b-06", "ovs_interfaceid": "8a95ff1b-0686-455d-977c-cedac8be3930", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:02:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Releasing lock "refresh_cache-466a8e58-5f88-4ffe-a7fd-a346003f3508" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:02:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:12 user nova-compute[72809]: DEBUG nova.compute.manager [req-ad190076-800a-4cdd-8fd1-e2f19fdd39f2 req-50bcd36c-2f61-4696-b279-f605b8f2dc4c service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Received event network-vif-unplugged-8a95ff1b-0686-455d-977c-cedac8be3930 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:02:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ad190076-800a-4cdd-8fd1-e2f19fdd39f2 req-50bcd36c-2f61-4696-b279-f605b8f2dc4c service nova] Acquiring lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ad190076-800a-4cdd-8fd1-e2f19fdd39f2 req-50bcd36c-2f61-4696-b279-f605b8f2dc4c service nova] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ad190076-800a-4cdd-8fd1-e2f19fdd39f2 req-50bcd36c-2f61-4696-b279-f605b8f2dc4c service nova] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:12 user nova-compute[72809]: DEBUG nova.compute.manager [req-ad190076-800a-4cdd-8fd1-e2f19fdd39f2 req-50bcd36c-2f61-4696-b279-f605b8f2dc4c service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] No waiting events found dispatching network-vif-unplugged-8a95ff1b-0686-455d-977c-cedac8be3930 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:02:12 user nova-compute[72809]: WARNING nova.compute.manager [req-ad190076-800a-4cdd-8fd1-e2f19fdd39f2 req-50bcd36c-2f61-4696-b279-f605b8f2dc4c service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Received unexpected event network-vif-unplugged-8a95ff1b-0686-455d-977c-cedac8be3930 for instance with vm_state active and task_state rescuing.
Aug 09 07:02:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:12 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Instance destroyed successfully.
Aug 09 07:02:12 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Attempting a stable device rescue
Aug 09 07:02:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72809) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 07:02:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Instance directory exists: not creating {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 07:02:12 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Creating image(s)
Aug 09 07:02:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "/opt/stack/data/nova/instances/466a8e58-5f88-4ffe-a7fd-a346003f3508/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "/opt/stack/data/nova/instances/466a8e58-5f88-4ffe-a7fd-a346003f3508/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "/opt/stack/data/nova/instances/466a8e58-5f88-4ffe-a7fd-a346003f3508/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:12 user nova-compute[72809]: DEBUG nova.objects.instance [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lazy-loading 'trusted_certs' on Instance uuid 466a8e58-5f88-4ffe-a7fd-a346003f3508 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:02:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "8ca6a1259042b6dfc58a4abad7a2714ae1f1040e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "8ca6a1259042b6dfc58a4abad7a2714ae1f1040e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ca6a1259042b6dfc58a4abad7a2714ae1f1040e.part --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ca6a1259042b6dfc58a4abad7a2714ae1f1040e.part --force-share --output=json" returned: 0 in 0.146s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:13 user nova-compute[72809]: DEBUG nova.virt.images [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] 0baacff5-a617-438b-989a-8f4fd34430ba was qcow2, converting to raw {{(pid=72809) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 07:02:13 user nova-compute[72809]: DEBUG nova.privsep.utils [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72809) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 07:02:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8ca6a1259042b6dfc58a4abad7a2714ae1f1040e.part /opt/stack/data/nova/instances/_base/8ca6a1259042b6dfc58a4abad7a2714ae1f1040e.converted {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Acquiring lock "51432417-89cc-4cee-855d-c4b148e4bd37" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "51432417-89cc-4cee-855d-c4b148e4bd37" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:14 user nova-compute[72809]: INFO nova.compute.manager [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Detaching volume 7ef6cf26-1d67-4739-9ed9-f8493a1759fa
Aug 09 07:02:14 user nova-compute[72809]: INFO nova.virt.block_device [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Attempting to driver detach volume 7ef6cf26-1d67-4739-9ed9-f8493a1759fa from mountpoint /dev/vdb
Aug 09 07:02:14 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Attempting to detach device vdb from instance 51432417-89cc-4cee-855d-c4b148e4bd37 from the persistent domain config. {{(pid=72809) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:02:14 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:02:14 user nova-compute[72809]:   <source dev="/dev/sdc"/>
Aug 09 07:02:14 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:02:14 user nova-compute[72809]:   <serial>7ef6cf26-1d67-4739-9ed9-f8493a1759fa</serial>
Aug 09 07:02:14 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 07:02:14 user nova-compute[72809]: </disk>
Aug 09 07:02:14 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:02:14 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Successfully detached device vdb from instance 51432417-89cc-4cee-855d-c4b148e4bd37 from the persistent domain config.
Aug 09 07:02:14 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 51432417-89cc-4cee-855d-c4b148e4bd37 from the live domain config. {{(pid=72809) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:02:14 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:02:14 user nova-compute[72809]:   <source dev="/dev/sdc"/>
Aug 09 07:02:14 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:02:14 user nova-compute[72809]:   <serial>7ef6cf26-1d67-4739-9ed9-f8493a1759fa</serial>
Aug 09 07:02:14 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 07:02:14 user nova-compute[72809]: </disk>
Aug 09 07:02:14 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8ca6a1259042b6dfc58a4abad7a2714ae1f1040e.part /opt/stack/data/nova/instances/_base/8ca6a1259042b6dfc58a4abad7a2714ae1f1040e.converted" returned: 0 in 0.287s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ca6a1259042b6dfc58a4abad7a2714ae1f1040e.converted --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ca6a1259042b6dfc58a4abad7a2714ae1f1040e.converted --force-share --output=json" returned: 0 in 0.134s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "8ca6a1259042b6dfc58a4abad7a2714ae1f1040e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.436s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "8ca6a1259042b6dfc58a4abad7a2714ae1f1040e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "8ca6a1259042b6dfc58a4abad7a2714ae1f1040e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ca6a1259042b6dfc58a4abad7a2714ae1f1040e --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG nova.compute.manager [req-79c31c47-c3df-4422-8af6-185c2450bceb req-22a11c7f-eb9e-403f-8448-4216a8e3c0bd service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Received event network-vif-plugged-8a95ff1b-0686-455d-977c-cedac8be3930 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-79c31c47-c3df-4422-8af6-185c2450bceb req-22a11c7f-eb9e-403f-8448-4216a8e3c0bd service nova] Acquiring lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-79c31c47-c3df-4422-8af6-185c2450bceb req-22a11c7f-eb9e-403f-8448-4216a8e3c0bd service nova] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-79c31c47-c3df-4422-8af6-185c2450bceb req-22a11c7f-eb9e-403f-8448-4216a8e3c0bd service nova] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG nova.compute.manager [req-79c31c47-c3df-4422-8af6-185c2450bceb req-22a11c7f-eb9e-403f-8448-4216a8e3c0bd service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] No waiting events found dispatching network-vif-plugged-8a95ff1b-0686-455d-977c-cedac8be3930 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:02:14 user nova-compute[72809]: WARNING nova.compute.manager [req-79c31c47-c3df-4422-8af6-185c2450bceb req-22a11c7f-eb9e-403f-8448-4216a8e3c0bd service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Received unexpected event network-vif-plugged-8a95ff1b-0686-455d-977c-cedac8be3930 for instance with vm_state active and task_state rescuing.
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ca6a1259042b6dfc58a4abad7a2714ae1f1040e --force-share --output=json" returned: 0 in 0.138s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8ca6a1259042b6dfc58a4abad7a2714ae1f1040e,backing_fmt=raw /opt/stack/data/nova/instances/466a8e58-5f88-4ffe-a7fd-a346003f3508/disk.rescue {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8ca6a1259042b6dfc58a4abad7a2714ae1f1040e,backing_fmt=raw /opt/stack/data/nova/instances/466a8e58-5f88-4ffe-a7fd-a346003f3508/disk.rescue" returned: 0 in 0.049s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "8ca6a1259042b6dfc58a4abad7a2714ae1f1040e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG nova.objects.instance [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lazy-loading 'migration_context' on Instance uuid 466a8e58-5f88-4ffe-a7fd-a346003f3508 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Start _get_guest_xml network_info=[{"id": "8a95ff1b-0686-455d-977c-cedac8be3930", "address": "fa:16:3e:42:8d:bd", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "vif_mac": "fa:16:3e:42:8d:bd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a95ff1b-06", "ovs_interfaceid": "8a95ff1b-0686-455d-977c-cedac8be3930", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0baacff5-a617-438b-989a-8f4fd34430ba', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eqKCHkSV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '466a8e58-5f88-4ffe-a7fd-a346003f3508', 'attached_at': '', 'detached_at': '', 'volume_id': 'e2b861e9-396c-49cb-92d7-a7efb0adbf64', 'serial': 'e2b861e9-396c-49cb-92d7-a7efb0adbf64'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': 0, 'attachment_id': '4545ab56-5af6-41cd-8be6-05f233751c42', 'volume_type': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG nova.objects.instance [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lazy-loading 'resources' on Instance uuid 466a8e58-5f88-4ffe-a7fd-a346003f3508 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG nova.objects.instance [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lazy-loading 'numa_topology' on Instance uuid 466a8e58-5f88-4ffe-a7fd-a346003f3508 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:02:14 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:02:14 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:02:14 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Received event <DeviceRemovedEvent: 1691564534.7052736, 51432417-89cc-4cee-855d-c4b148e4bd37 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72809) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 51432417-89cc-4cee-855d-c4b148e4bd37 {{(pid=72809) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 07:02:14 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Successfully detached device vdb from instance 51432417-89cc-4cee-855d-c4b148e4bd37 from the live domain config.
Aug 09 07:02:14 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG nova.objects.instance [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lazy-loading 'vcpu_model' on Instance uuid 466a8e58-5f88-4ffe-a7fd-a346003f3508 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HEOblMZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:02:14 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:02:14 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eqKCHkSV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:02:14 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:02:14 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[878d0a78-3efb-48fb-8442-32cfadb28329]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d557a898-1b9e-44ae-9ff8-e0f3a29bcfcb]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:02:14 user nova-compute[72809]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa (non-flash)
Aug 09 07:02:14 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:02:14 user nova-compute[72809]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa (non-flash)
Aug 09 07:02:14 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc1584cbf40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa'): ({'sdc'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Removing single pathed devices sdc {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b80e74-5622-4c9f-a6b8-634b54db7f7c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de739f1-28ff-4b7b-a9f2-a57dd89fca19]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Flushing IO for device /dev/sdc {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[815d08c0-676c-462a-9730-234b720b63ce]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8d64c2-07d1-45ba-acf4-b2d50969fb87]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] SCSI volumes sdc have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5854420-8356-4941-9e6b-c2a9366f8bde]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:02:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b598991f-4de6-4a7f-bd72-4050e20c256b]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa, portal: 172.16.0.220,3260]
Aug 09 07:02:15 user nova-compute[72809]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa, portal: 172.16.0.220,3260] successful.
Aug 09 07:02:15 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef6cf26-1d67-4739-9ed9-f8493a1759fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac39cf5f-26e6-4145-88ad-327ebba898fc]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] <== disconnect_volume: return (298ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.269s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:02:15 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:02:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:02:15 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 07:02:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf72c5a8-e375-4382-b928-eee823807735]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = eqKCHkSV\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 09 07:02:15 user nova-compute[72809]: node.name = iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64
Aug 09 07:02:15 user nova-compute[72809]: node.tpgt = -1
Aug 09 07:02:15 user nova-compute[72809]: node.startup = automatic
Aug 09 07:02:15 user nova-compute[72809]: node.leading_login = No
Aug 09 07:02:15 user nova-compute[72809]: iface.iscsi_ifacename = default
Aug 09 07:02:15 user nova-compute[72809]: iface.net_ifacename = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.ipaddress = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.prefix_len = 0
Aug 09 07:02:15 user nova-compute[72809]: iface.hwaddress = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.transport_name = tcp
Aug 09 07:02:15 user nova-compute[72809]: iface.initiatorname = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.state = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.vlan_id = 0
Aug 09 07:02:15 user nova-compute[72809]: iface.vlan_priority = 0
Aug 09 07:02:15 user nova-compute[72809]: iface.vlan_state = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.iface_num = 0
Aug 09 07:02:15 user nova-compute[72809]: iface.mtu = 0
Aug 09 07:02:15 user nova-compute[72809]: iface.port = 0
Aug 09 07:02:15 user nova-compute[72809]: iface.bootproto = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.subnet_mask = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.gateway = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.dhcp_alt_client_id_state = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.dhcp_alt_client_id = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.dhcp_dns = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.dhcp_learn_iqn = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.dhcp_req_vendor_id_state = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.dhcp_vendor_id_state = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.dhcp_vendor_id = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.dhcp_slp_da = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.fragmentation = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.gratuitous_arp = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.incoming_forwarding = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.tos_state = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.tos = 0
Aug 09 07:02:15 user nova-compute[72809]: iface.ttl = 0
Aug 09 07:02:15 user nova-compute[72809]: iface.delayed_ack = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.tcp_nagle = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.tcp_wsf_state = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.tcp_wsf = 0
Aug 09 07:02:15 user nova-compute[72809]: iface.tcp_timer_scale = 0
Aug 09 07:02:15 user nova-compute[72809]: iface.tcp_timestamp = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.redirect = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.def_task_mgmt_timeout = 0
Aug 09 07:02:15 user nova-compute[72809]: iface.header_digest = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.data_digest = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.immediate_data = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.initial_r2t = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.data_seq_inorder = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.data_pdu_inorder = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.erl = 0
Aug 09 07:02:15 user nova-compute[72809]: iface.max_receive_data_len = 0
Aug 09 07:02:15 user nova-compute[72809]: iface.first_burst_len = 0
Aug 09 07:02:15 user nova-compute[72809]: iface.max_outstanding_r2t = 0
Aug 09 07:02:15 user nova-compute[72809]: iface.max_burst_len = 0
Aug 09 07:02:15 user nova-compute[72809]: iface.chap_auth = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.bidi_chap = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.strict_login_compliance = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.discovery_auth = <empty>
Aug 09 07:02:15 user nova-compute[72809]: iface.discovery_logout = <empty>
Aug 09 07:02:15 user nova-compute[72809]: node.discovery_address = <empty>
Aug 09 07:02:15 user nova-compute[72809]: node.discovery_port = 0
Aug 09 07:02:15 user nova-compute[72809]: node.discovery_type = static
Aug 09 07:02:15 user nova-compute[72809]: node.session.initial_cmdsn = 0
Aug 09 07:02:15 user nova-compute[72809]: node.session.initial_login_retry_max = 8
Aug 09 07:02:15 user nova-compute[72809]: node.session.xmit_thread_priority = -20
Aug 09 07:02:15 user nova-compute[72809]: node.session.cmds_max = 128
Aug 09 07:02:15 user nova-compute[72809]: node.session.queue_depth = 32
Aug 09 07:02:15 user nova-compute[72809]: node.session.nr_sessions = 1
Aug 09 07:02:15 user nova-compute[72809]: node.session.auth.authmethod = CHAP
Aug 09 07:02:15 user nova-compute[72809]: node.session.auth.username = eqKCHkSV
Aug 09 07:02:15 user nova-compute[72809]: node.session.auth.password = ***
Aug 09 07:02:15 user nova-compute[72809]: node.session.auth.username_in = <empty>
Aug 09 07:02:15 user nova-compute[72809]: node.session.auth.password_in = <empty>
Aug 09 07:02:15 user nova-compute[72809]: node.session.auth.chap_algs = MD5
Aug 09 07:02:15 user nova-compute[72809]: node.session.timeo.replacement_timeout = 120
Aug 09 07:02:15 user nova-compute[72809]: node.session.err_timeo.abort_timeout = 15
Aug 09 07:02:15 user nova-compute[72809]: node.session.err_timeo.lu_reset_timeout = 30
Aug 09 07:02:15 user nova-compute[72809]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 09 07:02:15 user nova-compute[72809]: node.session.err_timeo.host_reset_timeout = 60
Aug 09 07:02:15 user nova-compute[72809]: node.session.iscsi.FastAbort = Yes
Aug 09 07:02:15 user nova-compute[72809]: node.session.iscsi.InitialR2T = No
Aug 09 07:02:15 user nova-compute[72809]: node.session.iscsi.ImmediateData = Yes
Aug 09 07:02:15 user nova-compute[72809]: node.session.iscsi.FirstBurstLength = 262144
Aug 09 07:02:15 user nova-compute[72809]: node.session.iscsi.MaxBurstLength = 16776192
Aug 09 07:02:15 user nova-compute[72809]: node.session.iscsi.DefaultTime2Retain = 0
Aug 09 07:02:15 user nova-compute[72809]: node.session.iscsi.DefaultTime2Wait = 2
Aug 09 07:02:15 user nova-compute[72809]: node.session.iscsi.MaxConnections = 1
Aug 09 07:02:15 user nova-compute[72809]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 09 07:02:15 user nova-compute[72809]: node.session.iscsi.ERL = 0
Aug 09 07:02:15 user nova-compute[72809]: node.session.scan = manual
Aug 09 07:02:15 user nova-compute[72809]: node.session.reopen_max = 0
Aug 09 07:02:15 user nova-compute[72809]: node.conn[0].address = 172.16.0.220
Aug 09 07:02:15 user nova-compute[72809]: node.conn[0].port = 3260
Aug 09 07:02:15 user nova-compute[72809]: node.conn[0].startup = manual
Aug 09 07:02:15 user nova-compute[72809]: node.conn[0].tcp.window_size = 524288
Aug 09 07:02:15 user nova-compute[72809]: node.conn[0].tcp.type_of_service = 0
Aug 09 07:02:15 user nova-compute[72809]: node.conn[0].timeo.logout_timeout = 15
Aug 09 07:02:15 user nova-compute[72809]: node.conn[0].timeo.login_timeout = 15
Aug 09 07:02:15 user nova-compute[72809]: node.conn[0].timeo.auth_timeout = 45
Aug 09 07:02:15 user nova-compute[72809]: node.conn[0].timeo.noop_out_interval = 5
Aug 09 07:02:15 user nova-compute[72809]: node.conn[0].timeo.noop_out_timeout = 5
Aug 09 07:02:15 user nova-compute[72809]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 09 07:02:15 user nova-compute[72809]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 09 07:02:15 user nova-compute[72809]: node.conn[0].iscsi.HeaderDigest = None
Aug 09 07:02:15 user nova-compute[72809]: node.conn[0].iscsi.DataDigest = None
Aug 09 07:02:15 user nova-compute[72809]: node.conn[0].iscsi.IFMarker = No
Aug 09 07:02:15 user nova-compute[72809]: node.conn[0].iscsi.OFMarker = No
Aug 09 07:02:15 user nova-compute[72809]: # END RECORD
Aug 09 07:02:15 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[374b7f54-3c3a-4a03-b4dd-6881b5d7a218]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7027df3c-eed3-4c42-9975-07a381b4b409]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eqKCHkSV {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eqKCHkSV" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbec27c9-e22e-4c42-b1e4-a7768a787f73]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eqKCHkSV'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[314c453f-3c62-4876-91ca-07c8e03a5cbe]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ad380c-237a-4870-bd4d-8632cc938e29]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:02:15 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:02:15 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.126s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] HCTL ('33', '0', '0', 0) found on session 28 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.012s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5808705-ce40-49ad-8a51-afcdaa2fa85d]: (4, ('0 0 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Searching for a device in session 28 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eqKCHkSV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.147s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] <== connect_volume: return (416ms) {'type': 'block', 'scsi_wwn': '23862626137633833', 'path': '/dev/sdb'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862626137633833', 'path': '/dev/sdb'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:00:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1511604475',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1511604475',id=29,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:00:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1903437f7ed4c14a0660f64a2e0c647',ramdisk_id='',reservation_id='r-n0o0w0e3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-917311946',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:00:42Z,user_data=None,user_id='6c4c5942852b412885a5b4698552058d',uuid=466a8e58-5f88-4ffe-a7fd-a346003f3508,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a95ff1b-0686-455d-977c-cedac8be3930", "address": "fa:16:3e:42:8d:bd", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "vif_mac": "fa:16:3e:42:8d:bd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a95ff1b-06", "ovs_interfaceid": "8a95ff1b-0686-455d-977c-cedac8be3930", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Converting VIF {"id": "8a95ff1b-0686-455d-977c-cedac8be3930", "address": "fa:16:3e:42:8d:bd", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "vif_mac": "fa:16:3e:42:8d:bd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a95ff1b-06", "ovs_interfaceid": "8a95ff1b-0686-455d-977c-cedac8be3930", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:8d:bd,bridge_name='br-int',has_traffic_filtering=True,id=8a95ff1b-0686-455d-977c-cedac8be3930,network=Network(5f03b0f9-e80d-428f-b0a6-57158568e620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a95ff1b-06') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG nova.objects.instance [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lazy-loading 'pci_devices' on Instance uuid 466a8e58-5f88-4ffe-a7fd-a346003f3508 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] End _get_guest_xml xml=<domain type="kvm">
Aug 09 07:02:15 user nova-compute[72809]:   <uuid>466a8e58-5f88-4ffe-a7fd-a346003f3508</uuid>
Aug 09 07:02:15 user nova-compute[72809]:   <name>instance-0000001d</name>
Aug 09 07:02:15 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 07:02:15 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 07:02:15 user nova-compute[72809]:   <metadata>
Aug 09 07:02:15 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 07:02:15 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 07:02:15 user nova-compute[72809]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1511604475</nova:name>
Aug 09 07:02:15 user nova-compute[72809]:       <nova:creationTime>2023-08-09 07:02:14</nova:creationTime>
Aug 09 07:02:15 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 07:02:15 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 07:02:15 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 07:02:15 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 07:02:15 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 07:02:15 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 07:02:15 user nova-compute[72809]:       </nova:flavor>
Aug 09 07:02:15 user nova-compute[72809]:       <nova:owner>
Aug 09 07:02:15 user nova-compute[72809]:         <nova:user uuid="6c4c5942852b412885a5b4698552058d">tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member</nova:user>
Aug 09 07:02:15 user nova-compute[72809]:         <nova:project uuid="b1903437f7ed4c14a0660f64a2e0c647">tempest-ServerBootFromVolumeStableRescueTest-917311946</nova:project>
Aug 09 07:02:15 user nova-compute[72809]:       </nova:owner>
Aug 09 07:02:15 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 07:02:15 user nova-compute[72809]:       <nova:ports>
Aug 09 07:02:15 user nova-compute[72809]:         <nova:port uuid="8a95ff1b-0686-455d-977c-cedac8be3930">
Aug 09 07:02:15 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 07:02:15 user nova-compute[72809]:         </nova:port>
Aug 09 07:02:15 user nova-compute[72809]:       </nova:ports>
Aug 09 07:02:15 user nova-compute[72809]:     </nova:instance>
Aug 09 07:02:15 user nova-compute[72809]:   </metadata>
Aug 09 07:02:15 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 07:02:15 user nova-compute[72809]:     <system>
Aug 09 07:02:15 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 07:02:15 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 07:02:15 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 07:02:15 user nova-compute[72809]:       <entry name="serial">466a8e58-5f88-4ffe-a7fd-a346003f3508</entry>
Aug 09 07:02:15 user nova-compute[72809]:       <entry name="uuid">466a8e58-5f88-4ffe-a7fd-a346003f3508</entry>
Aug 09 07:02:15 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 07:02:15 user nova-compute[72809]:     </system>
Aug 09 07:02:15 user nova-compute[72809]:   </sysinfo>
Aug 09 07:02:15 user nova-compute[72809]:   <os>
Aug 09 07:02:15 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 07:02:15 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 07:02:15 user nova-compute[72809]:   </os>
Aug 09 07:02:15 user nova-compute[72809]:   <features>
Aug 09 07:02:15 user nova-compute[72809]:     <acpi/>
Aug 09 07:02:15 user nova-compute[72809]:     <apic/>
Aug 09 07:02:15 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 07:02:15 user nova-compute[72809]:   </features>
Aug 09 07:02:15 user nova-compute[72809]:   <clock offset="utc">
Aug 09 07:02:15 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 07:02:15 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 07:02:15 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 07:02:15 user nova-compute[72809]:   </clock>
Aug 09 07:02:15 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 07:02:15 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 07:02:15 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 07:02:15 user nova-compute[72809]:   </cpu>
Aug 09 07:02:15 user nova-compute[72809]:   <devices>
Aug 09 07:02:15 user nova-compute[72809]:     <disk type="block" device="disk">
Aug 09 07:02:15 user nova-compute[72809]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:02:15 user nova-compute[72809]:       <source dev="/dev/sdb"/>
Aug 09 07:02:15 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 07:02:15 user nova-compute[72809]:       <serial>e2b861e9-396c-49cb-92d7-a7efb0adbf64</serial>
Aug 09 07:02:15 user nova-compute[72809]:     </disk>
Aug 09 07:02:15 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 07:02:15 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 07:02:15 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/466a8e58-5f88-4ffe-a7fd-a346003f3508/disk.rescue"/>
Aug 09 07:02:15 user nova-compute[72809]:       <target dev="vdb" bus="virtio"/>
Aug 09 07:02:15 user nova-compute[72809]:       <boot order="1"/>
Aug 09 07:02:15 user nova-compute[72809]:     </disk>
Aug 09 07:02:15 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 07:02:15 user nova-compute[72809]:       <mac address="fa:16:3e:42:8d:bd"/>
Aug 09 07:02:15 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:02:15 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 07:02:15 user nova-compute[72809]:       <target dev="tap8a95ff1b-06"/>
Aug 09 07:02:15 user nova-compute[72809]:     </interface>
Aug 09 07:02:15 user nova-compute[72809]:     <serial type="pty">
Aug 09 07:02:15 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/466a8e58-5f88-4ffe-a7fd-a346003f3508/console.log" append="off"/>
Aug 09 07:02:15 user nova-compute[72809]:     </serial>
Aug 09 07:02:15 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 07:02:15 user nova-compute[72809]:     <video>
Aug 09 07:02:15 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:02:15 user nova-compute[72809]:     </video>
Aug 09 07:02:15 user nova-compute[72809]:     <rng model="virtio">
Aug 09 07:02:15 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 07:02:15 user nova-compute[72809]:     </rng>
Aug 09 07:02:15 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 07:02:15 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 07:02:15 user nova-compute[72809]:       <stats period="10"/>
Aug 09 07:02:15 user nova-compute[72809]:     </memballoon>
Aug 09 07:02:15 user nova-compute[72809]:   </devices>
Aug 09 07:02:15 user nova-compute[72809]: </domain>
Aug 09 07:02:15 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 07:02:15 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Instance destroyed successfully.
Aug 09 07:02:15 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] No VIF found with MAC fa:16:3e:42:8d:bd, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG nova.objects.instance [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lazy-loading 'flavor' on Instance uuid 51432417-89cc-4cee-855d-c4b148e4bd37 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691564520.7941046, 25943f41-2d28-4ffe-b38b-ae34a99426e1 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:02:15 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] VM Stopped (Lifecycle Event)
Aug 09 07:02:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-826b3ef5-c0c6-494f-b83e-3a84cd6f9aab tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "51432417-89cc-4cee-855d-c4b148e4bd37" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.766s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:15 user nova-compute[72809]: DEBUG nova.compute.manager [None req-5302568a-9b17-4754-9906-0a91f56b206a None None] [instance: 25943f41-2d28-4ffe-b38b-ae34a99426e1] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:02:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b3862297-26a1-4323-a61f-82c086f8ff1e tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Acquiring lock "736f31cf-d864-4eeb-a612-12af39cd0d2d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b3862297-26a1-4323-a61f-82c086f8ff1e tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lock "736f31cf-d864-4eeb-a612-12af39cd0d2d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b3862297-26a1-4323-a61f-82c086f8ff1e tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Acquiring lock "736f31cf-d864-4eeb-a612-12af39cd0d2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b3862297-26a1-4323-a61f-82c086f8ff1e tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lock "736f31cf-d864-4eeb-a612-12af39cd0d2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b3862297-26a1-4323-a61f-82c086f8ff1e tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lock "736f31cf-d864-4eeb-a612-12af39cd0d2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:16 user nova-compute[72809]: INFO nova.compute.manager [None req-b3862297-26a1-4323-a61f-82c086f8ff1e tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Terminating instance
Aug 09 07:02:16 user nova-compute[72809]: DEBUG nova.compute.manager [None req-b3862297-26a1-4323-a61f-82c086f8ff1e tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:02:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:16 user nova-compute[72809]: DEBUG nova.compute.manager [req-711d313b-ef09-49ab-9e88-da0b4614508f req-002c763a-dc59-47cd-8d79-c248da92454c service nova] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Received event network-vif-unplugged-13ba3520-c10b-4938-b76a-c0861b5aad4b {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:02:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-711d313b-ef09-49ab-9e88-da0b4614508f req-002c763a-dc59-47cd-8d79-c248da92454c service nova] Acquiring lock "736f31cf-d864-4eeb-a612-12af39cd0d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-711d313b-ef09-49ab-9e88-da0b4614508f req-002c763a-dc59-47cd-8d79-c248da92454c service nova] Lock "736f31cf-d864-4eeb-a612-12af39cd0d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-711d313b-ef09-49ab-9e88-da0b4614508f req-002c763a-dc59-47cd-8d79-c248da92454c service nova] Lock "736f31cf-d864-4eeb-a612-12af39cd0d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:16 user nova-compute[72809]: DEBUG nova.compute.manager [req-711d313b-ef09-49ab-9e88-da0b4614508f req-002c763a-dc59-47cd-8d79-c248da92454c service nova] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] No waiting events found dispatching network-vif-unplugged-13ba3520-c10b-4938-b76a-c0861b5aad4b {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:02:16 user nova-compute[72809]: DEBUG nova.compute.manager [req-711d313b-ef09-49ab-9e88-da0b4614508f req-002c763a-dc59-47cd-8d79-c248da92454c service nova] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Received event network-vif-unplugged-13ba3520-c10b-4938-b76a-c0861b5aad4b for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:02:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:17 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Instance destroyed successfully.
Aug 09 07:02:17 user nova-compute[72809]: DEBUG nova.objects.instance [None req-b3862297-26a1-4323-a61f-82c086f8ff1e tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lazy-loading 'resources' on Instance uuid 736f31cf-d864-4eeb-a612-12af39cd0d2d {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:02:17 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-b3862297-26a1-4323-a61f-82c086f8ff1e tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:00:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1461203006',display_name='tempest-ServersNegativeTestJSON-server-1461203006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1461203006',id=30,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:00:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='adb54b76021d41c3b047dcad448441d0',ramdisk_id='',reservation_id='r-m0j2hmu5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-169525689',owner_user_name='tempest-ServersNegativeTestJSON-169525689-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:00:33Z,user_data=None,user_id='9dc41dc12f02418eba58bfce4128b26d',uuid=736f31cf-d864-4eeb-a612-12af39cd0d2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13ba3520-c10b-4938-b76a-c0861b5aad4b", "address": "fa:16:3e:2e:31:8e", "network": {"id": "957d253a-5f0b-4a0d-89e0-5a4ee590929b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1432478722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb54b76021d41c3b047dcad448441d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ba3520-c1", "ovs_interfaceid": "13ba3520-c10b-4938-b76a-c0861b5aad4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:02:17 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-b3862297-26a1-4323-a61f-82c086f8ff1e tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Converting VIF {"id": "13ba3520-c10b-4938-b76a-c0861b5aad4b", "address": "fa:16:3e:2e:31:8e", "network": {"id": "957d253a-5f0b-4a0d-89e0-5a4ee590929b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1432478722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb54b76021d41c3b047dcad448441d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13ba3520-c1", "ovs_interfaceid": "13ba3520-c10b-4938-b76a-c0861b5aad4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:02:17 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-b3862297-26a1-4323-a61f-82c086f8ff1e tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:31:8e,bridge_name='br-int',has_traffic_filtering=True,id=13ba3520-c10b-4938-b76a-c0861b5aad4b,network=Network(957d253a-5f0b-4a0d-89e0-5a4ee590929b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13ba3520-c1') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:02:17 user nova-compute[72809]: DEBUG os_vif [None req-b3862297-26a1-4323-a61f-82c086f8ff1e tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:31:8e,bridge_name='br-int',has_traffic_filtering=True,id=13ba3520-c10b-4938-b76a-c0861b5aad4b,network=Network(957d253a-5f0b-4a0d-89e0-5a4ee590929b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13ba3520-c1') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:02:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13ba3520-c1, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:02:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:02:17 user nova-compute[72809]: INFO os_vif [None req-b3862297-26a1-4323-a61f-82c086f8ff1e tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:31:8e,bridge_name='br-int',has_traffic_filtering=True,id=13ba3520-c10b-4938-b76a-c0861b5aad4b,network=Network(957d253a-5f0b-4a0d-89e0-5a4ee590929b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13ba3520-c1')
Aug 09 07:02:17 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-b3862297-26a1-4323-a61f-82c086f8ff1e tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Deleting instance files /opt/stack/data/nova/instances/736f31cf-d864-4eeb-a612-12af39cd0d2d_del
Aug 09 07:02:17 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-b3862297-26a1-4323-a61f-82c086f8ff1e tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Deletion of /opt/stack/data/nova/instances/736f31cf-d864-4eeb-a612-12af39cd0d2d_del complete
Aug 09 07:02:17 user nova-compute[72809]: INFO nova.compute.manager [None req-b3862297-26a1-4323-a61f-82c086f8ff1e tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 09 07:02:17 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-b3862297-26a1-4323-a61f-82c086f8ff1e tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:02:17 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:02:17 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:02:17 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:02:17 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Took 0.63 seconds to deallocate network for instance.
Aug 09 07:02:17 user nova-compute[72809]: DEBUG nova.compute.manager [req-fef44a21-6dcb-4430-802c-444c65ddca76 req-2c7df2e9-79da-4737-a8ad-7ec32ef4a7da service nova] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Received event network-vif-deleted-13ba3520-c10b-4938-b76a-c0861b5aad4b {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:02:17 user nova-compute[72809]: INFO nova.compute.manager [req-fef44a21-6dcb-4430-802c-444c65ddca76 req-2c7df2e9-79da-4737-a8ad-7ec32ef4a7da service nova] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Neutron deleted interface 13ba3520-c10b-4938-b76a-c0861b5aad4b; detaching it from the instance and deleting it from the info cache
Aug 09 07:02:17 user nova-compute[72809]: DEBUG nova.network.neutron [req-fef44a21-6dcb-4430-802c-444c65ddca76 req-2c7df2e9-79da-4737-a8ad-7ec32ef4a7da service nova] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:02:17 user nova-compute[72809]: DEBUG nova.compute.manager [req-fef44a21-6dcb-4430-802c-444c65ddca76 req-2c7df2e9-79da-4737-a8ad-7ec32ef4a7da service nova] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Detach interface failed, port_id=13ba3520-c10b-4938-b76a-c0861b5aad4b, reason: Instance 736f31cf-d864-4eeb-a612-12af39cd0d2d could not be found. {{(pid=72809) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 07:02:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b3862297-26a1-4323-a61f-82c086f8ff1e tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b3862297-26a1-4323-a61f-82c086f8ff1e tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:18 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-b3862297-26a1-4323-a61f-82c086f8ff1e tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:02:18 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-b3862297-26a1-4323-a61f-82c086f8ff1e tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:02:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b3862297-26a1-4323-a61f-82c086f8ff1e tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:18 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-b3862297-26a1-4323-a61f-82c086f8ff1e tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Deleted allocations for instance 736f31cf-d864-4eeb-a612-12af39cd0d2d
Aug 09 07:02:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b3862297-26a1-4323-a61f-82c086f8ff1e tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lock "736f31cf-d864-4eeb-a612-12af39cd0d2d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.417s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:18 user nova-compute[72809]: DEBUG nova.compute.manager [req-2fe2e0a8-730c-48c1-be4a-15660e62754c req-8e2d3b23-aa1c-4ab3-bc8d-e6b725f15f54 service nova] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Received event network-vif-plugged-13ba3520-c10b-4938-b76a-c0861b5aad4b {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:02:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2fe2e0a8-730c-48c1-be4a-15660e62754c req-8e2d3b23-aa1c-4ab3-bc8d-e6b725f15f54 service nova] Acquiring lock "736f31cf-d864-4eeb-a612-12af39cd0d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2fe2e0a8-730c-48c1-be4a-15660e62754c req-8e2d3b23-aa1c-4ab3-bc8d-e6b725f15f54 service nova] Lock "736f31cf-d864-4eeb-a612-12af39cd0d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2fe2e0a8-730c-48c1-be4a-15660e62754c req-8e2d3b23-aa1c-4ab3-bc8d-e6b725f15f54 service nova] Lock "736f31cf-d864-4eeb-a612-12af39cd0d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:18 user nova-compute[72809]: DEBUG nova.compute.manager [req-2fe2e0a8-730c-48c1-be4a-15660e62754c req-8e2d3b23-aa1c-4ab3-bc8d-e6b725f15f54 service nova] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] No waiting events found dispatching network-vif-plugged-13ba3520-c10b-4938-b76a-c0861b5aad4b {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:02:18 user nova-compute[72809]: WARNING nova.compute.manager [req-2fe2e0a8-730c-48c1-be4a-15660e62754c req-8e2d3b23-aa1c-4ab3-bc8d-e6b725f15f54 service nova] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Received unexpected event network-vif-plugged-13ba3520-c10b-4938-b76a-c0861b5aad4b for instance with vm_state deleted and task_state None.
Aug 09 07:02:18 user nova-compute[72809]: DEBUG nova.compute.manager [req-2fe2e0a8-730c-48c1-be4a-15660e62754c req-8e2d3b23-aa1c-4ab3-bc8d-e6b725f15f54 service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Received event network-vif-plugged-8a95ff1b-0686-455d-977c-cedac8be3930 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:02:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2fe2e0a8-730c-48c1-be4a-15660e62754c req-8e2d3b23-aa1c-4ab3-bc8d-e6b725f15f54 service nova] Acquiring lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2fe2e0a8-730c-48c1-be4a-15660e62754c req-8e2d3b23-aa1c-4ab3-bc8d-e6b725f15f54 service nova] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2fe2e0a8-730c-48c1-be4a-15660e62754c req-8e2d3b23-aa1c-4ab3-bc8d-e6b725f15f54 service nova] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:18 user nova-compute[72809]: DEBUG nova.compute.manager [req-2fe2e0a8-730c-48c1-be4a-15660e62754c req-8e2d3b23-aa1c-4ab3-bc8d-e6b725f15f54 service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] No waiting events found dispatching network-vif-plugged-8a95ff1b-0686-455d-977c-cedac8be3930 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:02:18 user nova-compute[72809]: WARNING nova.compute.manager [req-2fe2e0a8-730c-48c1-be4a-15660e62754c req-8e2d3b23-aa1c-4ab3-bc8d-e6b725f15f54 service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Received unexpected event network-vif-plugged-8a95ff1b-0686-455d-977c-cedac8be3930 for instance with vm_state active and task_state rescuing.
Aug 09 07:02:18 user nova-compute[72809]: DEBUG nova.compute.manager [req-2fe2e0a8-730c-48c1-be4a-15660e62754c req-8e2d3b23-aa1c-4ab3-bc8d-e6b725f15f54 service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Received event network-vif-plugged-8a95ff1b-0686-455d-977c-cedac8be3930 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:02:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2fe2e0a8-730c-48c1-be4a-15660e62754c req-8e2d3b23-aa1c-4ab3-bc8d-e6b725f15f54 service nova] Acquiring lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2fe2e0a8-730c-48c1-be4a-15660e62754c req-8e2d3b23-aa1c-4ab3-bc8d-e6b725f15f54 service nova] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2fe2e0a8-730c-48c1-be4a-15660e62754c req-8e2d3b23-aa1c-4ab3-bc8d-e6b725f15f54 service nova] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:18 user nova-compute[72809]: DEBUG nova.compute.manager [req-2fe2e0a8-730c-48c1-be4a-15660e62754c req-8e2d3b23-aa1c-4ab3-bc8d-e6b725f15f54 service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] No waiting events found dispatching network-vif-plugged-8a95ff1b-0686-455d-977c-cedac8be3930 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:02:18 user nova-compute[72809]: WARNING nova.compute.manager [req-2fe2e0a8-730c-48c1-be4a-15660e62754c req-8e2d3b23-aa1c-4ab3-bc8d-e6b725f15f54 service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Received unexpected event network-vif-plugged-8a95ff1b-0686-455d-977c-cedac8be3930 for instance with vm_state active and task_state rescuing.
Aug 09 07:02:18 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Removed pending event for 466a8e58-5f88-4ffe-a7fd-a346003f3508 due to event {{(pid=72809) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 07:02:18 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564538.9345434, 466a8e58-5f88-4ffe-a7fd-a346003f3508 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:02:18 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] VM Resumed (Lifecycle Event)
Aug 09 07:02:18 user nova-compute[72809]: DEBUG nova.compute.manager [None req-be558078-a18d-435b-9bcb-df99085dd048 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:02:18 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:02:18 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:02:18 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 07:02:18 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564538.9372377, 466a8e58-5f88-4ffe-a7fd-a346003f3508 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:02:18 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] VM Started (Lifecycle Event)
Aug 09 07:02:19 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:02:19 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:02:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "a754327a-9985-4430-af66-1d8bc82fb868" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "a754327a-9985-4430-af66-1d8bc82fb868" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:29 user nova-compute[72809]: DEBUG nova.compute.manager [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 07:02:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:29 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 07:02:29 user nova-compute[72809]: INFO nova.compute.claims [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Claim successful on node user
Aug 09 07:02:30 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:02:30 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:02:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:30 user nova-compute[72809]: DEBUG nova.compute.manager [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 07:02:30 user nova-compute[72809]: DEBUG nova.compute.manager [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 07:02:30 user nova-compute[72809]: DEBUG nova.network.neutron [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 07:02:30 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 07:02:30 user nova-compute[72809]: DEBUG nova.compute.manager [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 07:02:30 user nova-compute[72809]: INFO nova.virt.block_device [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Booting with volume f1cadbe9-56c6-4639-a5d6-898730c79059 at /dev/vda
Aug 09 07:02:30 user nova-compute[72809]: DEBUG nova.policy [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10e067d2b5b7459cadf50b1ed89a8864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da97330281c4d0eba99e485db051973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 07:02:30 user nova-compute[72809]: DEBUG os_brick.utils [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:02:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:30 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7301f7-74b5-49ba-8999-35a5ab474fc1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:30 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c95fed-85a6-4984-90ea-36ed46234130]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:30 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8ecd00-272c-497e-91b5-9a6e23cb4ad3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:30 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e650b7-5266-49d7-bc06-5ae8a9bfa545]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:02:30 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 07:02:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:02:30 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 07:02:30 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bef24b-303f-4c12-b23c-a99c5fabfccf]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:30 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 07:02:30 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 07:02:30 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 07:02:30 user nova-compute[72809]: DEBUG os_brick.utils [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:02:30 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Updating existing volume attachment record: ab8a3227-df88-4dd6-988a-03cad58b970e {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 07:02:31 user nova-compute[72809]: DEBUG nova.network.neutron [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Successfully created port: 79d0335e-d56b-4916-9b58-c198843ed750 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 07:02:32 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691564537.1393816, 736f31cf-d864-4eeb-a612-12af39cd0d2d => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:02:32 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] VM Stopped (Lifecycle Event)
Aug 09 07:02:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-dce3ccf9-1d34-426c-8c74-ffeb04cee44b None None] [instance: 736f31cf-d864-4eeb-a612-12af39cd0d2d] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:02:32 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:32 user nova-compute[72809]: DEBUG nova.network.neutron [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Successfully updated port: 79d0335e-d56b-4916-9b58-c198843ed750 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 07:02:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "refresh_cache-a754327a-9985-4430-af66-1d8bc82fb868" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:02:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquired lock "refresh_cache-a754327a-9985-4430-af66-1d8bc82fb868" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:02:32 user nova-compute[72809]: DEBUG nova.network.neutron [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:02:32 user nova-compute[72809]: DEBUG nova.compute.manager [req-2486c766-fce2-4a4b-b724-b493db78563a req-da62d6cd-914a-4ade-805d-015ba2656b38 service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Received event network-changed-79d0335e-d56b-4916-9b58-c198843ed750 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:02:32 user nova-compute[72809]: DEBUG nova.compute.manager [req-2486c766-fce2-4a4b-b724-b493db78563a req-da62d6cd-914a-4ade-805d-015ba2656b38 service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Refreshing instance network info cache due to event network-changed-79d0335e-d56b-4916-9b58-c198843ed750. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:02:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2486c766-fce2-4a4b-b724-b493db78563a req-da62d6cd-914a-4ade-805d-015ba2656b38 service nova] Acquiring lock "refresh_cache-a754327a-9985-4430-af66-1d8bc82fb868" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:02:32 user nova-compute[72809]: DEBUG nova.network.neutron [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 07:02:32 user nova-compute[72809]: DEBUG nova.network.neutron [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Updating instance_info_cache with network_info: [{"id": "79d0335e-d56b-4916-9b58-c198843ed750", "address": "fa:16:3e:d4:01:03", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d0335e-d5", "ovs_interfaceid": "79d0335e-d56b-4916-9b58-c198843ed750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:02:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Releasing lock "refresh_cache-a754327a-9985-4430-af66-1d8bc82fb868" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:02:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Instance network_info: |[{"id": "79d0335e-d56b-4916-9b58-c198843ed750", "address": "fa:16:3e:d4:01:03", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d0335e-d5", "ovs_interfaceid": "79d0335e-d56b-4916-9b58-c198843ed750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 07:02:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2486c766-fce2-4a4b-b724-b493db78563a req-da62d6cd-914a-4ade-805d-015ba2656b38 service nova] Acquired lock "refresh_cache-a754327a-9985-4430-af66-1d8bc82fb868" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:02:32 user nova-compute[72809]: DEBUG nova.network.neutron [req-2486c766-fce2-4a4b-b724-b493db78563a req-da62d6cd-914a-4ade-805d-015ba2656b38 service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Refreshing network info cache for port 79d0335e-d56b-4916-9b58-c198843ed750 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:02:32 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:02:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 07:02:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Rebuilding the list of instances to heal {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 07:02:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Skipping network cache update for instance because it is Building. {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 09 07:02:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-1bde423f-0b73-448f-bdce-8d6af96d8fc6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:02:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-1bde423f-0b73-448f-bdce-8d6af96d8fc6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:02:32 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 07:02:32 user nova-compute[72809]: DEBUG nova.objects.instance [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lazy-loading 'info_cache' on Instance uuid 1bde423f-0b73-448f-bdce-8d6af96d8fc6 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:02:33 user nova-compute[72809]: DEBUG nova.network.neutron [req-2486c766-fce2-4a4b-b724-b493db78563a req-da62d6cd-914a-4ade-805d-015ba2656b38 service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Updated VIF entry in instance network info cache for port 79d0335e-d56b-4916-9b58-c198843ed750. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:02:33 user nova-compute[72809]: DEBUG nova.network.neutron [req-2486c766-fce2-4a4b-b724-b493db78563a req-da62d6cd-914a-4ade-805d-015ba2656b38 service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Updating instance_info_cache with network_info: [{"id": "79d0335e-d56b-4916-9b58-c198843ed750", "address": "fa:16:3e:d4:01:03", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d0335e-d5", "ovs_interfaceid": "79d0335e-d56b-4916-9b58-c198843ed750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:02:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2486c766-fce2-4a4b-b724-b493db78563a req-da62d6cd-914a-4ade-805d-015ba2656b38 service nova] Releasing lock "refresh_cache-a754327a-9985-4430-af66-1d8bc82fb868" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:02:33 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Updating instance_info_cache with network_info: [{"id": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "address": "fa:16:3e:3b:e0:d8", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81017ed8-c8", "ovs_interfaceid": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:02:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-1bde423f-0b73-448f-bdce-8d6af96d8fc6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:02:33 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 07:02:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:34 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:02:36 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:02:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:36 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 07:02:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:38 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:02:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/466a8e58-5f88-4ffe-a7fd-a346003f3508/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/466a8e58-5f88-4ffe-a7fd-a346003f3508/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/466a8e58-5f88-4ffe-a7fd-a346003f3508/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/466a8e58-5f88-4ffe-a7fd-a346003f3508/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG nova.compute.manager [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 07:02:39 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Creating image(s)
Aug 09 07:02:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Did not create local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Ensure instance console log exists: /opt/stack/data/nova/instances/a754327a-9985-4430-af66-1d8bc82fb868/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Start _get_guest_xml network_info=[{"id": "79d0335e-d56b-4916-9b58-c198843ed750", "address": "fa:16:3e:d4:01:03", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d0335e-d5", "ovs_interfaceid": "79d0335e-d56b-4916-9b58-c198843ed750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YNXuUTFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a754327a-9985-4430-af66-1d8bc82fb868', 'attached_at': '', 'detached_at': '', 'volume_id': 'f1cadbe9-56c6-4639-a5d6-898730c79059', 'serial': 'f1cadbe9-56c6-4639-a5d6-898730c79059'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'boot_index': 0, 'attachment_id': 'ab8a3227-df88-4dd6-988a-03cad58b970e', 'volume_type': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 07:02:39 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:02:39 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YNXuUTFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:02:39 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:02:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:02:39 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:02:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:02:39 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f878c791-1be2-46e8-b382-c0b0d08b56b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 07:02:39 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfc43dc-3f85-4638-b21c-07e39706803e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059] added
Aug 09 07:02:39 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbcbb52-4497-4715-88c0-8a13560782ca]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2159c9-7617-4112-883d-f7aae22f008f]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YNXuUTFt {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YNXuUTFt" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d8aad2-2c91-46c2-b6cd-0ff3796e9913]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YNXuUTFt'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ce72b2-5c3f-4669-97dc-a0f9bca26bdc]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fab24ff-d6b3-4b2b-bb6a-00bfabca1db3]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:02:39 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:02:39 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f5ef65-b102-4ace-99e3-f2e5d61eceb3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059, portal: 172.16.0.220,3260]
Aug 09 07:02:39 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059, portal: 172.16.0.220,3260] successful.
Aug 09 07:02:39 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a67683-d4a1-4513-b636-e3a25adb36ec]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d67126-7529-408e-a2ae-39c6bc152769/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[411cf13c-d7df-46db-8bc2-1b4f8ec846d7]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:02:39 user nova-compute[72809]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:02:39 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:02:39 user nova-compute[72809]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:02:39 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.415s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 07:02:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[917782f2-2036-4dc4-b714-60a56d5eed60]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:02:40 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:02:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YNXuUTFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 07:02:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d67126-7529-408e-a2ae-39c6bc152769/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d67126-7529-408e-a2ae-39c6bc152769/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d67126-7529-408e-a2ae-39c6bc152769/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cab676-b3c0-4f05-9e44-42e5a6677857/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cab676-b3c0-4f05-9e44-42e5a6677857/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cab676-b3c0-4f05-9e44-42e5a6677857/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:02:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cab676-b3c0-4f05-9e44-42e5a6677857/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.484s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] <== connect_volume: return (1487ms) {'type': 'block', 'scsi_wwn': '23130313138663865', 'path': '/dev/sdc'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130313138663865', 'path': '/dev/sdc'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 07:02:41 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:02:41 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:02:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=7307MB free_disk=25.202327728271484GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:02:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1201311549',display_name='tempest-ServerActionsTestOtherA-server-1201311549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1201311549',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCouL5r1ONNNh4MEm1cE7q85fOqyiHXG74zUMePb7Qx7FM94grlflWjrtC3jQ2LeCgVBOqUmmFTQqcvNJ0pbLdMAdhZ4dM0vJEiMtEgevMXZ2oGhFPDEpbVyaR20DJopHw==',key_name='tempest-keypair-888098152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6da97330281c4d0eba99e485db051973',ramdisk_id='',reservation_id='r-jua86bod',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-118844208',owner_user_name='tempest-ServerActionsTestOtherA-118844208-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:02:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10e067d2b5b7459cadf50b1ed89a8864',uuid=a754327a-9985-4430-af66-1d8bc82fb868,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79d0335e-d56b-4916-9b58-c198843ed750", "address": "fa:16:3e:d4:01:03", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d0335e-d5", "ovs_interfaceid": "79d0335e-d56b-4916-9b58-c198843ed750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Converting VIF {"id": "79d0335e-d56b-4916-9b58-c198843ed750", "address": "fa:16:3e:d4:01:03", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d0335e-d5", "ovs_interfaceid": "79d0335e-d56b-4916-9b58-c198843ed750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:01:03,bridge_name='br-int',has_traffic_filtering=True,id=79d0335e-d56b-4916-9b58-c198843ed750,network=Network(0e68e18b-480a-4b6c-b194-39ba1099a4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d0335e-d5') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG nova.objects.instance [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lazy-loading 'pci_devices' on Instance uuid a754327a-9985-4430-af66-1d8bc82fb868 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] End _get_guest_xml xml=<domain type="kvm">
Aug 09 07:02:41 user nova-compute[72809]:   <uuid>a754327a-9985-4430-af66-1d8bc82fb868</uuid>
Aug 09 07:02:41 user nova-compute[72809]:   <name>instance-00000021</name>
Aug 09 07:02:41 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 07:02:41 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 07:02:41 user nova-compute[72809]:   <metadata>
Aug 09 07:02:41 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 07:02:41 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 07:02:41 user nova-compute[72809]:       <nova:name>tempest-ServerActionsTestOtherA-server-1201311549</nova:name>
Aug 09 07:02:41 user nova-compute[72809]:       <nova:creationTime>2023-08-09 07:02:39</nova:creationTime>
Aug 09 07:02:41 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 07:02:41 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 07:02:41 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 07:02:41 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 07:02:41 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 07:02:41 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 07:02:41 user nova-compute[72809]:       </nova:flavor>
Aug 09 07:02:41 user nova-compute[72809]:       <nova:owner>
Aug 09 07:02:41 user nova-compute[72809]:         <nova:user uuid="10e067d2b5b7459cadf50b1ed89a8864">tempest-ServerActionsTestOtherA-118844208-project-member</nova:user>
Aug 09 07:02:41 user nova-compute[72809]:         <nova:project uuid="6da97330281c4d0eba99e485db051973">tempest-ServerActionsTestOtherA-118844208</nova:project>
Aug 09 07:02:41 user nova-compute[72809]:       </nova:owner>
Aug 09 07:02:41 user nova-compute[72809]:       <nova:ports>
Aug 09 07:02:41 user nova-compute[72809]:         <nova:port uuid="79d0335e-d56b-4916-9b58-c198843ed750">
Aug 09 07:02:41 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 07:02:41 user nova-compute[72809]:         </nova:port>
Aug 09 07:02:41 user nova-compute[72809]:       </nova:ports>
Aug 09 07:02:41 user nova-compute[72809]:     </nova:instance>
Aug 09 07:02:41 user nova-compute[72809]:   </metadata>
Aug 09 07:02:41 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 07:02:41 user nova-compute[72809]:     <system>
Aug 09 07:02:41 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 07:02:41 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 07:02:41 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 07:02:41 user nova-compute[72809]:       <entry name="serial">a754327a-9985-4430-af66-1d8bc82fb868</entry>
Aug 09 07:02:41 user nova-compute[72809]:       <entry name="uuid">a754327a-9985-4430-af66-1d8bc82fb868</entry>
Aug 09 07:02:41 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 07:02:41 user nova-compute[72809]:     </system>
Aug 09 07:02:41 user nova-compute[72809]:   </sysinfo>
Aug 09 07:02:41 user nova-compute[72809]:   <os>
Aug 09 07:02:41 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 07:02:41 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 07:02:41 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 07:02:41 user nova-compute[72809]:   </os>
Aug 09 07:02:41 user nova-compute[72809]:   <features>
Aug 09 07:02:41 user nova-compute[72809]:     <acpi/>
Aug 09 07:02:41 user nova-compute[72809]:     <apic/>
Aug 09 07:02:41 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 07:02:41 user nova-compute[72809]:   </features>
Aug 09 07:02:41 user nova-compute[72809]:   <clock offset="utc">
Aug 09 07:02:41 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 07:02:41 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 07:02:41 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 07:02:41 user nova-compute[72809]:   </clock>
Aug 09 07:02:41 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 07:02:41 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 07:02:41 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 07:02:41 user nova-compute[72809]:   </cpu>
Aug 09 07:02:41 user nova-compute[72809]:   <devices>
Aug 09 07:02:41 user nova-compute[72809]:     <disk type="block" device="disk">
Aug 09 07:02:41 user nova-compute[72809]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:02:41 user nova-compute[72809]:       <source dev="/dev/sdc"/>
Aug 09 07:02:41 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 07:02:41 user nova-compute[72809]:       <serial>f1cadbe9-56c6-4639-a5d6-898730c79059</serial>
Aug 09 07:02:41 user nova-compute[72809]:     </disk>
Aug 09 07:02:41 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 07:02:41 user nova-compute[72809]:       <mac address="fa:16:3e:d4:01:03"/>
Aug 09 07:02:41 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:02:41 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 07:02:41 user nova-compute[72809]:       <target dev="tap79d0335e-d5"/>
Aug 09 07:02:41 user nova-compute[72809]:     </interface>
Aug 09 07:02:41 user nova-compute[72809]:     <serial type="pty">
Aug 09 07:02:41 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/a754327a-9985-4430-af66-1d8bc82fb868/console.log" append="off"/>
Aug 09 07:02:41 user nova-compute[72809]:     </serial>
Aug 09 07:02:41 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 07:02:41 user nova-compute[72809]:     <video>
Aug 09 07:02:41 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:02:41 user nova-compute[72809]:     </video>
Aug 09 07:02:41 user nova-compute[72809]:     <rng model="virtio">
Aug 09 07:02:41 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 07:02:41 user nova-compute[72809]:     </rng>
Aug 09 07:02:41 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 07:02:41 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 07:02:41 user nova-compute[72809]:       <stats period="10"/>
Aug 09 07:02:41 user nova-compute[72809]:     </memballoon>
Aug 09 07:02:41 user nova-compute[72809]:   </devices>
Aug 09 07:02:41 user nova-compute[72809]: </domain>
Aug 09 07:02:41 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:02:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1201311549',display_name='tempest-ServerActionsTestOtherA-server-1201311549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1201311549',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCouL5r1ONNNh4MEm1cE7q85fOqyiHXG74zUMePb7Qx7FM94grlflWjrtC3jQ2LeCgVBOqUmmFTQqcvNJ0pbLdMAdhZ4dM0vJEiMtEgevMXZ2oGhFPDEpbVyaR20DJopHw==',key_name='tempest-keypair-888098152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6da97330281c4d0eba99e485db051973',ramdisk_id='',reservation_id='r-jua86bod',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-118844208',owner_user_name='tempest-ServerActionsTestOtherA-118844208-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:02:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10e067d2b5b7459cadf50b1ed89a8864',uuid=a754327a-9985-4430-af66-1d8bc82fb868,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79d0335e-d56b-4916-9b58-c198843ed750", "address": "fa:16:3e:d4:01:03", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d0335e-d5", "ovs_interfaceid": "79d0335e-d56b-4916-9b58-c198843ed750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Converting VIF {"id": "79d0335e-d56b-4916-9b58-c198843ed750", "address": "fa:16:3e:d4:01:03", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d0335e-d5", "ovs_interfaceid": "79d0335e-d56b-4916-9b58-c198843ed750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:01:03,bridge_name='br-int',has_traffic_filtering=True,id=79d0335e-d56b-4916-9b58-c198843ed750,network=Network(0e68e18b-480a-4b6c-b194-39ba1099a4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d0335e-d5') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG os_vif [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:01:03,bridge_name='br-int',has_traffic_filtering=True,id=79d0335e-d56b-4916-9b58-c198843ed750,network=Network(0e68e18b-480a-4b6c-b194-39ba1099a4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d0335e-d5') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79d0335e-d5, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap79d0335e-d5, col_values=(('external_ids', {'iface-id': '79d0335e-d56b-4916-9b58-c198843ed750', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:01:03', 'vm-uuid': 'a754327a-9985-4430-af66-1d8bc82fb868'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:41 user nova-compute[72809]: INFO os_vif [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:01:03,bridge_name='br-int',has_traffic_filtering=True,id=79d0335e-d56b-4916-9b58-c198843ed750,network=Network(0e68e18b-480a-4b6c-b194-39ba1099a4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d0335e-d5')
Aug 09 07:02:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 336770eb-4f09-4134-92ef-f96039bf4fa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 1bde423f-0b73-448f-bdce-8d6af96d8fc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance bebd5a14-6272-4de1-a1a1-4fb45b867c7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 339372ed-140d-4226-ba00-2cc682214d5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 38319c37-9cc0-4e84-8415-ddcf37451daf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 51432417-89cc-4cee-855d-c4b148e4bd37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 466a8e58-5f88-4ffe-a7fd-a346003f3508 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 59d67126-7529-408e-a2ae-39c6bc152769 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance b5cab676-b3c0-4f05-9e44-42e5a6677857 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance a754327a-9985-4430-af66-1d8bc82fb868 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] No VIF found with MAC fa:16:3e:d4:01:03, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 07:02:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.521s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:42 user nova-compute[72809]: DEBUG nova.compute.manager [req-ecfafba1-83d0-49fb-944d-94ba28fd37fe req-99463239-0a50-4bd9-ba30-2f46e42a7603 service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Received event network-vif-plugged-79d0335e-d56b-4916-9b58-c198843ed750 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:02:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ecfafba1-83d0-49fb-944d-94ba28fd37fe req-99463239-0a50-4bd9-ba30-2f46e42a7603 service nova] Acquiring lock "a754327a-9985-4430-af66-1d8bc82fb868-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ecfafba1-83d0-49fb-944d-94ba28fd37fe req-99463239-0a50-4bd9-ba30-2f46e42a7603 service nova] Lock "a754327a-9985-4430-af66-1d8bc82fb868-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ecfafba1-83d0-49fb-944d-94ba28fd37fe req-99463239-0a50-4bd9-ba30-2f46e42a7603 service nova] Lock "a754327a-9985-4430-af66-1d8bc82fb868-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:42 user nova-compute[72809]: DEBUG nova.compute.manager [req-ecfafba1-83d0-49fb-944d-94ba28fd37fe req-99463239-0a50-4bd9-ba30-2f46e42a7603 service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] No waiting events found dispatching network-vif-plugged-79d0335e-d56b-4916-9b58-c198843ed750 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:02:42 user nova-compute[72809]: WARNING nova.compute.manager [req-ecfafba1-83d0-49fb-944d-94ba28fd37fe req-99463239-0a50-4bd9-ba30-2f46e42a7603 service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Received unexpected event network-vif-plugged-79d0335e-d56b-4916-9b58-c198843ed750 for instance with vm_state building and task_state spawning.
Aug 09 07:02:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:43 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:43 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:02:43 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:02:43 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:02:43 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:02:43 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:02:43 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:02:43 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 07:02:44 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564564.693493, a754327a-9985-4430-af66-1d8bc82fb868 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:02:44 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: a754327a-9985-4430-af66-1d8bc82fb868] VM Resumed (Lifecycle Event)
Aug 09 07:02:44 user nova-compute[72809]: DEBUG nova.compute.manager [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 07:02:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 07:02:44 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Instance spawned successfully.
Aug 09 07:02:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 07:02:44 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:02:44 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:02:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:02:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:02:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:02:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:02:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:02:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:02:44 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: a754327a-9985-4430-af66-1d8bc82fb868] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:02:44 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564564.6978836, a754327a-9985-4430-af66-1d8bc82fb868 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:02:44 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: a754327a-9985-4430-af66-1d8bc82fb868] VM Started (Lifecycle Event)
Aug 09 07:02:44 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:02:44 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:02:44 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: a754327a-9985-4430-af66-1d8bc82fb868] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:02:44 user nova-compute[72809]: INFO nova.compute.manager [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Took 5.41 seconds to spawn the instance on the hypervisor.
Aug 09 07:02:44 user nova-compute[72809]: DEBUG nova.compute.manager [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:02:44 user nova-compute[72809]: DEBUG nova.compute.manager [req-92766ab0-ea5d-4244-95c4-83158500ff8a req-f668cede-d56f-4157-a538-0b3cd58c9ee9 service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Received event network-vif-plugged-79d0335e-d56b-4916-9b58-c198843ed750 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:02:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-92766ab0-ea5d-4244-95c4-83158500ff8a req-f668cede-d56f-4157-a538-0b3cd58c9ee9 service nova] Acquiring lock "a754327a-9985-4430-af66-1d8bc82fb868-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-92766ab0-ea5d-4244-95c4-83158500ff8a req-f668cede-d56f-4157-a538-0b3cd58c9ee9 service nova] Lock "a754327a-9985-4430-af66-1d8bc82fb868-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-92766ab0-ea5d-4244-95c4-83158500ff8a req-f668cede-d56f-4157-a538-0b3cd58c9ee9 service nova] Lock "a754327a-9985-4430-af66-1d8bc82fb868-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:44 user nova-compute[72809]: DEBUG nova.compute.manager [req-92766ab0-ea5d-4244-95c4-83158500ff8a req-f668cede-d56f-4157-a538-0b3cd58c9ee9 service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] No waiting events found dispatching network-vif-plugged-79d0335e-d56b-4916-9b58-c198843ed750 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:02:44 user nova-compute[72809]: WARNING nova.compute.manager [req-92766ab0-ea5d-4244-95c4-83158500ff8a req-f668cede-d56f-4157-a538-0b3cd58c9ee9 service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Received unexpected event network-vif-plugged-79d0335e-d56b-4916-9b58-c198843ed750 for instance with vm_state building and task_state spawning.
Aug 09 07:02:44 user nova-compute[72809]: INFO nova.compute.manager [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Took 15.11 seconds to build instance.
Aug 09 07:02:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0923c820-a846-4fae-8faf-efc4dc1f4c3c tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "a754327a-9985-4430-af66-1d8bc82fb868" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.201s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:47 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:02:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:53 user nova-compute[72809]: INFO nova.compute.manager [None req-0fe3f448-58e8-4ecc-b747-7eb746e95f80 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Unrescuing
Aug 09 07:02:53 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0fe3f448-58e8-4ecc-b747-7eb746e95f80 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "refresh_cache-1bde423f-0b73-448f-bdce-8d6af96d8fc6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:02:53 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0fe3f448-58e8-4ecc-b747-7eb746e95f80 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquired lock "refresh_cache-1bde423f-0b73-448f-bdce-8d6af96d8fc6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:02:53 user nova-compute[72809]: DEBUG nova.network.neutron [None req-0fe3f448-58e8-4ecc-b747-7eb746e95f80 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:02:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:54 user nova-compute[72809]: DEBUG nova.network.neutron [None req-0fe3f448-58e8-4ecc-b747-7eb746e95f80 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Updating instance_info_cache with network_info: [{"id": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "address": "fa:16:3e:3b:e0:d8", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81017ed8-c8", "ovs_interfaceid": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:02:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0fe3f448-58e8-4ecc-b747-7eb746e95f80 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Releasing lock "refresh_cache-1bde423f-0b73-448f-bdce-8d6af96d8fc6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:02:54 user nova-compute[72809]: DEBUG nova.objects.instance [None req-0fe3f448-58e8-4ecc-b747-7eb746e95f80 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lazy-loading 'flavor' on Instance uuid 1bde423f-0b73-448f-bdce-8d6af96d8fc6 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:02:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:54 user nova-compute[72809]: DEBUG nova.compute.manager [req-3ff3d6e6-0176-4937-bec7-286dd5346156 req-91f7f37c-6855-40c5-adde-b1db9e6401cb service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Received event network-vif-unplugged-81017ed8-c816-4a5d-aa4f-eb16d863571f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:02:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3ff3d6e6-0176-4937-bec7-286dd5346156 req-91f7f37c-6855-40c5-adde-b1db9e6401cb service nova] Acquiring lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3ff3d6e6-0176-4937-bec7-286dd5346156 req-91f7f37c-6855-40c5-adde-b1db9e6401cb service nova] Lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3ff3d6e6-0176-4937-bec7-286dd5346156 req-91f7f37c-6855-40c5-adde-b1db9e6401cb service nova] Lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:54 user nova-compute[72809]: DEBUG nova.compute.manager [req-3ff3d6e6-0176-4937-bec7-286dd5346156 req-91f7f37c-6855-40c5-adde-b1db9e6401cb service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] No waiting events found dispatching network-vif-unplugged-81017ed8-c816-4a5d-aa4f-eb16d863571f {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:02:54 user nova-compute[72809]: WARNING nova.compute.manager [req-3ff3d6e6-0176-4937-bec7-286dd5346156 req-91f7f37c-6855-40c5-adde-b1db9e6401cb service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Received unexpected event network-vif-unplugged-81017ed8-c816-4a5d-aa4f-eb16d863571f for instance with vm_state rescued and task_state unrescuing.
Aug 09 07:02:54 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Instance destroyed successfully.
Aug 09 07:02:56 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:56 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:56 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:56 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:56 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:56 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:56 user nova-compute[72809]: DEBUG nova.compute.manager [req-d82ea961-a32f-4a93-bd65-7aeec5042337 req-21670b04-eaa1-43fa-b91d-d37abcbaca8c service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Received event network-vif-plugged-81017ed8-c816-4a5d-aa4f-eb16d863571f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:02:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d82ea961-a32f-4a93-bd65-7aeec5042337 req-21670b04-eaa1-43fa-b91d-d37abcbaca8c service nova] Acquiring lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d82ea961-a32f-4a93-bd65-7aeec5042337 req-21670b04-eaa1-43fa-b91d-d37abcbaca8c service nova] Lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d82ea961-a32f-4a93-bd65-7aeec5042337 req-21670b04-eaa1-43fa-b91d-d37abcbaca8c service nova] Lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:56 user nova-compute[72809]: DEBUG nova.compute.manager [req-d82ea961-a32f-4a93-bd65-7aeec5042337 req-21670b04-eaa1-43fa-b91d-d37abcbaca8c service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] No waiting events found dispatching network-vif-plugged-81017ed8-c816-4a5d-aa4f-eb16d863571f {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:02:56 user nova-compute[72809]: WARNING nova.compute.manager [req-d82ea961-a32f-4a93-bd65-7aeec5042337 req-21670b04-eaa1-43fa-b91d-d37abcbaca8c service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Received unexpected event network-vif-plugged-81017ed8-c816-4a5d-aa4f-eb16d863571f for instance with vm_state rescued and task_state unrescuing.
Aug 09 07:02:56 user nova-compute[72809]: DEBUG nova.compute.manager [req-d82ea961-a32f-4a93-bd65-7aeec5042337 req-21670b04-eaa1-43fa-b91d-d37abcbaca8c service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Received event network-vif-plugged-81017ed8-c816-4a5d-aa4f-eb16d863571f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:02:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d82ea961-a32f-4a93-bd65-7aeec5042337 req-21670b04-eaa1-43fa-b91d-d37abcbaca8c service nova] Acquiring lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d82ea961-a32f-4a93-bd65-7aeec5042337 req-21670b04-eaa1-43fa-b91d-d37abcbaca8c service nova] Lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d82ea961-a32f-4a93-bd65-7aeec5042337 req-21670b04-eaa1-43fa-b91d-d37abcbaca8c service nova] Lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:56 user nova-compute[72809]: DEBUG nova.compute.manager [req-d82ea961-a32f-4a93-bd65-7aeec5042337 req-21670b04-eaa1-43fa-b91d-d37abcbaca8c service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] No waiting events found dispatching network-vif-plugged-81017ed8-c816-4a5d-aa4f-eb16d863571f {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:02:56 user nova-compute[72809]: WARNING nova.compute.manager [req-d82ea961-a32f-4a93-bd65-7aeec5042337 req-21670b04-eaa1-43fa-b91d-d37abcbaca8c service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Received unexpected event network-vif-plugged-81017ed8-c816-4a5d-aa4f-eb16d863571f for instance with vm_state rescued and task_state unrescuing.
Aug 09 07:02:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:02:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Removed pending event for 1bde423f-0b73-448f-bdce-8d6af96d8fc6 due to event {{(pid=72809) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 07:02:58 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564578.68008, 1bde423f-0b73-448f-bdce-8d6af96d8fc6 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:02:58 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] VM Resumed (Lifecycle Event)
Aug 09 07:02:58 user nova-compute[72809]: DEBUG nova.compute.manager [None req-0fe3f448-58e8-4ecc-b747-7eb746e95f80 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:02:58 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:02:58 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:02:58 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 07:02:58 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564578.6820004, 1bde423f-0b73-448f-bdce-8d6af96d8fc6 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:02:58 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] VM Started (Lifecycle Event)
Aug 09 07:02:58 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:02:58 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:02:58 user nova-compute[72809]: DEBUG nova.compute.manager [req-35a99b6b-fe3c-4dc7-95eb-68e1827b7197 req-0afc56d7-fd71-4423-8404-f20a468e8311 service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Received event network-vif-plugged-81017ed8-c816-4a5d-aa4f-eb16d863571f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:02:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-35a99b6b-fe3c-4dc7-95eb-68e1827b7197 req-0afc56d7-fd71-4423-8404-f20a468e8311 service nova] Acquiring lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:02:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-35a99b6b-fe3c-4dc7-95eb-68e1827b7197 req-0afc56d7-fd71-4423-8404-f20a468e8311 service nova] Lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:02:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-35a99b6b-fe3c-4dc7-95eb-68e1827b7197 req-0afc56d7-fd71-4423-8404-f20a468e8311 service nova] Lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:02:58 user nova-compute[72809]: DEBUG nova.compute.manager [req-35a99b6b-fe3c-4dc7-95eb-68e1827b7197 req-0afc56d7-fd71-4423-8404-f20a468e8311 service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] No waiting events found dispatching network-vif-plugged-81017ed8-c816-4a5d-aa4f-eb16d863571f {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:02:58 user nova-compute[72809]: WARNING nova.compute.manager [req-35a99b6b-fe3c-4dc7-95eb-68e1827b7197 req-0afc56d7-fd71-4423-8404-f20a468e8311 service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Received unexpected event network-vif-plugged-81017ed8-c816-4a5d-aa4f-eb16d863571f for instance with vm_state active and task_state None.
Aug 09 07:03:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:06 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:11 user nova-compute[72809]: DEBUG nova.compute.manager [None req-f68b1943-ffa4-4bb9-ad67-e0663588ef17 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:03:11 user nova-compute[72809]: INFO nova.compute.manager [None req-f68b1943-ffa4-4bb9-ad67-e0663588ef17 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] instance snapshotting
Aug 09 07:03:11 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:11 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-f68b1943-ffa4-4bb9-ad67-e0663588ef17 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Beginning live snapshot process
Aug 09 07:03:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f68b1943-ffa4-4bb9-ad67-e0663588ef17 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json -f qcow2 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f68b1943-ffa4-4bb9-ad67-e0663588ef17 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json -f qcow2" returned: 0 in 0.135s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f68b1943-ffa4-4bb9-ad67-e0663588ef17 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json -f qcow2 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f68b1943-ffa4-4bb9-ad67-e0663588ef17 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json -f qcow2" returned: 0 in 0.132s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f68b1943-ffa4-4bb9-ad67-e0663588ef17 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f68b1943-ffa4-4bb9-ad67-e0663588ef17 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.131s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f68b1943-ffa4-4bb9-ad67-e0663588ef17 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmped_lylkn/3957ee24c4c34d159f470b67fb87591f.delta 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f68b1943-ffa4-4bb9-ad67-e0663588ef17 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmped_lylkn/3957ee24c4c34d159f470b67fb87591f.delta 1073741824" returned: 0 in 0.052s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:11 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-f68b1943-ffa4-4bb9-ad67-e0663588ef17 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 07:03:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-f68b1943-ffa4-4bb9-ad67-e0663588ef17 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] COPY block job progress, current cursor: 0 final cursor: 75628544 {{(pid=72809) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 07:03:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-f68b1943-ffa4-4bb9-ad67-e0663588ef17 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] COPY block job progress, current cursor: 22609920 final cursor: 75628544 {{(pid=72809) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 07:03:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-f68b1943-ffa4-4bb9-ad67-e0663588ef17 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] COPY block job progress, current cursor: 75628544 final cursor: 75628544 {{(pid=72809) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 07:03:13 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-f68b1943-ffa4-4bb9-ad67-e0663588ef17 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 07:03:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:13 user nova-compute[72809]: DEBUG nova.privsep.utils [None req-f68b1943-ffa4-4bb9-ad67-e0663588ef17 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72809) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 07:03:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f68b1943-ffa4-4bb9-ad67-e0663588ef17 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmped_lylkn/3957ee24c4c34d159f470b67fb87591f.delta /opt/stack/data/nova/instances/snapshots/tmped_lylkn/3957ee24c4c34d159f470b67fb87591f {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f68b1943-ffa4-4bb9-ad67-e0663588ef17 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmped_lylkn/3957ee24c4c34d159f470b67fb87591f.delta /opt/stack/data/nova/instances/snapshots/tmped_lylkn/3957ee24c4c34d159f470b67fb87591f" returned: 0 in 0.245s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:13 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-f68b1943-ffa4-4bb9-ad67-e0663588ef17 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Snapshot extracted, beginning image upload
Aug 09 07:03:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:16 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-f68b1943-ffa4-4bb9-ad67-e0663588ef17 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Snapshot image upload complete
Aug 09 07:03:16 user nova-compute[72809]: INFO nova.compute.manager [None req-f68b1943-ffa4-4bb9-ad67-e0663588ef17 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Took 5.29 seconds to snapshot the instance on the hypervisor.
Aug 09 07:03:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "40bc627e-28c9-4450-9532-bf6db60845b2" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:03:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "40bc627e-28c9-4450-9532-bf6db60845b2" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:03:16 user nova-compute[72809]: INFO nova.compute.manager [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Unshelving
Aug 09 07:03:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:03:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:03:17 user nova-compute[72809]: DEBUG nova.objects.instance [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lazy-loading 'pci_requests' on Instance uuid 40bc627e-28c9-4450-9532-bf6db60845b2 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:03:17 user nova-compute[72809]: DEBUG nova.objects.instance [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lazy-loading 'numa_topology' on Instance uuid 40bc627e-28c9-4450-9532-bf6db60845b2 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:03:17 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 07:03:17 user nova-compute[72809]: INFO nova.compute.claims [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Claim successful on node user
Aug 09 07:03:17 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:03:17 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:03:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.523s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:03:17 user nova-compute[72809]: INFO nova.network.neutron [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Updating port e17ef1fb-761f-4b49-803c-b4c55115eb7c with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 09 07:03:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "refresh_cache-40bc627e-28c9-4450-9532-bf6db60845b2" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:03:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquired lock "refresh_cache-40bc627e-28c9-4450-9532-bf6db60845b2" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:03:19 user nova-compute[72809]: DEBUG nova.network.neutron [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:03:19 user nova-compute[72809]: DEBUG nova.compute.manager [req-4d8d2225-4330-478d-8c8c-f74e5427cd93 req-9b169a7c-fd19-40ed-97db-32dd219b436d service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Received event network-changed-e17ef1fb-761f-4b49-803c-b4c55115eb7c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:03:19 user nova-compute[72809]: DEBUG nova.compute.manager [req-4d8d2225-4330-478d-8c8c-f74e5427cd93 req-9b169a7c-fd19-40ed-97db-32dd219b436d service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Refreshing instance network info cache due to event network-changed-e17ef1fb-761f-4b49-803c-b4c55115eb7c. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:03:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-4d8d2225-4330-478d-8c8c-f74e5427cd93 req-9b169a7c-fd19-40ed-97db-32dd219b436d service nova] Acquiring lock "refresh_cache-40bc627e-28c9-4450-9532-bf6db60845b2" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:03:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Acquiring lock "a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:03:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:03:19 user nova-compute[72809]: DEBUG nova.compute.manager [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 07:03:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:03:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:03:19 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 07:03:19 user nova-compute[72809]: INFO nova.compute.claims [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Claim successful on node user
Aug 09 07:03:19 user nova-compute[72809]: DEBUG nova.compute.manager [req-5162a87d-c9b5-4996-bc9e-f73dd13d902d req-04f8eaf7-100a-4efe-88b3-46d211270853 service nova] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Received event network-changed-d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:03:19 user nova-compute[72809]: DEBUG nova.compute.manager [req-5162a87d-c9b5-4996-bc9e-f73dd13d902d req-04f8eaf7-100a-4efe-88b3-46d211270853 service nova] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Refreshing instance network info cache due to event network-changed-d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:03:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5162a87d-c9b5-4996-bc9e-f73dd13d902d req-04f8eaf7-100a-4efe-88b3-46d211270853 service nova] Acquiring lock "refresh_cache-59d67126-7529-408e-a2ae-39c6bc152769" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:03:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5162a87d-c9b5-4996-bc9e-f73dd13d902d req-04f8eaf7-100a-4efe-88b3-46d211270853 service nova] Acquired lock "refresh_cache-59d67126-7529-408e-a2ae-39c6bc152769" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:03:19 user nova-compute[72809]: DEBUG nova.network.neutron [req-5162a87d-c9b5-4996-bc9e-f73dd13d902d req-04f8eaf7-100a-4efe-88b3-46d211270853 service nova] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Refreshing network info cache for port d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:03:19 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:03:19 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:03:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.609s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:03:20 user nova-compute[72809]: DEBUG nova.compute.manager [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 07:03:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquiring lock "59d67126-7529-408e-a2ae-39c6bc152769" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:03:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "59d67126-7529-408e-a2ae-39c6bc152769" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:03:20 user nova-compute[72809]: DEBUG nova.objects.instance [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lazy-loading 'flavor' on Instance uuid 59d67126-7529-408e-a2ae-39c6bc152769 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:03:20 user nova-compute[72809]: DEBUG nova.compute.manager [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 07:03:20 user nova-compute[72809]: DEBUG nova.network.neutron [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 07:03:20 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Ignoring supplied device name: /dev/vdb
Aug 09 07:03:20 user nova-compute[72809]: DEBUG nova.network.neutron [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Updating instance_info_cache with network_info: [{"id": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "address": "fa:16:3e:15:53:7d", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape17ef1fb-76", "ovs_interfaceid": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:03:20 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 07:03:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "59d67126-7529-408e-a2ae-39c6bc152769" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:03:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Releasing lock "refresh_cache-40bc627e-28c9-4450-9532-bf6db60845b2" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:03:20 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 07:03:20 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Creating image(s)
Aug 09 07:03:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "/opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:03:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "/opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:03:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "/opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:03:20 user nova-compute[72809]: DEBUG nova.objects.instance [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lazy-loading 'trusted_certs' on Instance uuid 40bc627e-28c9-4450-9532-bf6db60845b2 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:03:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-4d8d2225-4330-478d-8c8c-f74e5427cd93 req-9b169a7c-fd19-40ed-97db-32dd219b436d service nova] Acquired lock "refresh_cache-40bc627e-28c9-4450-9532-bf6db60845b2" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:03:20 user nova-compute[72809]: DEBUG nova.network.neutron [req-4d8d2225-4330-478d-8c8c-f74e5427cd93 req-9b169a7c-fd19-40ed-97db-32dd219b436d service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Refreshing network info cache for port e17ef1fb-761f-4b49-803c-b4c55115eb7c {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:03:20 user nova-compute[72809]: DEBUG nova.compute.manager [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 07:03:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "73aa1c7bb0fc365f15a82b0c664ce2eb624e8b8c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:03:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "73aa1c7bb0fc365f15a82b0c664ce2eb624e8b8c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:03:20 user nova-compute[72809]: DEBUG nova.policy [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ddd99e6c6a034fffa82466ae88ea098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77be39d2ba434d42bd6b08194503031d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 07:03:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73aa1c7bb0fc365f15a82b0c664ce2eb624e8b8c.part --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:21 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:21 user nova-compute[72809]: DEBUG nova.compute.manager [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 07:03:21 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 07:03:21 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Creating image(s)
Aug 09 07:03:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Acquiring lock "/opt/stack/data/nova/instances/a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:03:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "/opt/stack/data/nova/instances/a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:03:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "/opt/stack/data/nova/instances/a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:03:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Acquiring lock "fbe71dc42b190e0bfbeee567610c2f82cf91e045" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:03:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "fbe71dc42b190e0bfbeee567610c2f82cf91e045" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:03:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquiring lock "59d67126-7529-408e-a2ae-39c6bc152769" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:03:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "59d67126-7529-408e-a2ae-39c6bc152769" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:03:21 user nova-compute[72809]: INFO nova.compute.manager [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Attaching volume 05c57159-a986-4730-b056-eb8abd6a4594 to /dev/vdb
Aug 09 07:03:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73aa1c7bb0fc365f15a82b0c664ce2eb624e8b8c.part --force-share --output=json" returned: 0 in 0.151s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:21 user nova-compute[72809]: DEBUG nova.virt.images [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] 4f2ff998-c537-418f-9f29-b1171b15d07e was qcow2, converting to raw {{(pid=72809) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 07:03:21 user nova-compute[72809]: DEBUG nova.privsep.utils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72809) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 07:03:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/73aa1c7bb0fc365f15a82b0c664ce2eb624e8b8c.part /opt/stack/data/nova/instances/_base/73aa1c7bb0fc365f15a82b0c664ce2eb624e8b8c.converted {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:21 user nova-compute[72809]: DEBUG os_brick.utils [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbe71dc42b190e0bfbeee567610c2f82cf91e045.part --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a9f8e4-e5d3-4e61-aae9-36291623ad55]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/73aa1c7bb0fc365f15a82b0c664ce2eb624e8b8c.part /opt/stack/data/nova/instances/_base/73aa1c7bb0fc365f15a82b0c664ce2eb624e8b8c.converted" returned: 0 in 0.911s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73aa1c7bb0fc365f15a82b0c664ce2eb624e8b8c.converted --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63a6526-9279-4c86-b5f7-1cf7b33048bc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbe71dc42b190e0bfbeee567610c2f82cf91e045.part --force-share --output=json" returned: 0 in 0.168s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG nova.virt.images [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] b10b2e00-2a11-4912-8765-96119c37347f was qcow2, converting to raw {{(pid=72809) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG nova.privsep.utils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72809) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fbe71dc42b190e0bfbeee567610c2f82cf91e045.part /opt/stack/data/nova/instances/_base/fbe71dc42b190e0bfbeee567610c2f82cf91e045.converted {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG nova.network.neutron [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Successfully created port: 5bd22d17-9a8a-41ce-b164-16812b74fdcd {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f9f09e-ab7d-4944-9329-28089a6dfaa3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG nova.network.neutron [req-5162a87d-c9b5-4996-bc9e-f73dd13d902d req-04f8eaf7-100a-4efe-88b3-46d211270853 service nova] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Updated VIF entry in instance network info cache for port d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG nova.network.neutron [req-5162a87d-c9b5-4996-bc9e-f73dd13d902d req-04f8eaf7-100a-4efe-88b3-46d211270853 service nova] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Updating instance_info_cache with network_info: [{"id": "d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7", "address": "fa:16:3e:51:e3:e8", "network": {"id": "ae760578-06b0-479a-9f75-b5e781b1a087", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-541750148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76e442312164689bdd7686973d25eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1962ff5-8d", "ovs_interfaceid": "d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3485b2a2-e05b-4ea8-a22d-0f76e988466f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73aa1c7bb0fc365f15a82b0c664ce2eb624e8b8c.converted --force-share --output=json" returned: 0 in 0.199s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "73aa1c7bb0fc365f15a82b0c664ce2eb624e8b8c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.454s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5162a87d-c9b5-4996-bc9e-f73dd13d902d req-04f8eaf7-100a-4efe-88b3-46d211270853 service nova] Releasing lock "refresh_cache-59d67126-7529-408e-a2ae-39c6bc152769" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73aa1c7bb0fc365f15a82b0c664ce2eb624e8b8c --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:03:22 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb012e8e-1636-47a6-922d-18ec55f6d684]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fbe71dc42b190e0bfbeee567610c2f82cf91e045.part /opt/stack/data/nova/instances/_base/fbe71dc42b190e0bfbeee567610c2f82cf91e045.converted" returned: 0 in 0.196s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG os_brick.utils [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] <== get_connector_properties: return (1183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Updating existing volume attachment record: ec4ddaa6-7325-4b4b-8055-013bb8bde714 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbe71dc42b190e0bfbeee567610c2f82cf91e045.converted --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73aa1c7bb0fc365f15a82b0c664ce2eb624e8b8c --force-share --output=json" returned: 0 in 0.147s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "73aa1c7bb0fc365f15a82b0c664ce2eb624e8b8c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "73aa1c7bb0fc365f15a82b0c664ce2eb624e8b8c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73aa1c7bb0fc365f15a82b0c664ce2eb624e8b8c --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG nova.network.neutron [req-4d8d2225-4330-478d-8c8c-f74e5427cd93 req-9b169a7c-fd19-40ed-97db-32dd219b436d service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Updated VIF entry in instance network info cache for port e17ef1fb-761f-4b49-803c-b4c55115eb7c. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG nova.network.neutron [req-4d8d2225-4330-478d-8c8c-f74e5427cd93 req-9b169a7c-fd19-40ed-97db-32dd219b436d service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Updating instance_info_cache with network_info: [{"id": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "address": "fa:16:3e:15:53:7d", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape17ef1fb-76", "ovs_interfaceid": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-4d8d2225-4330-478d-8c8c-f74e5427cd93 req-9b169a7c-fd19-40ed-97db-32dd219b436d service nova] Releasing lock "refresh_cache-40bc627e-28c9-4450-9532-bf6db60845b2" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbe71dc42b190e0bfbeee567610c2f82cf91e045.converted --force-share --output=json" returned: 0 in 0.154s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "fbe71dc42b190e0bfbeee567610c2f82cf91e045" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.505s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbe71dc42b190e0bfbeee567610c2f82cf91e045 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73aa1c7bb0fc365f15a82b0c664ce2eb624e8b8c --force-share --output=json" returned: 0 in 0.186s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73aa1c7bb0fc365f15a82b0c664ce2eb624e8b8c,backing_fmt=raw /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73aa1c7bb0fc365f15a82b0c664ce2eb624e8b8c,backing_fmt=raw /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk 1073741824" returned: 0 in 0.052s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "73aa1c7bb0fc365f15a82b0c664ce2eb624e8b8c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73aa1c7bb0fc365f15a82b0c664ce2eb624e8b8c --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbe71dc42b190e0bfbeee567610c2f82cf91e045 --force-share --output=json" returned: 0 in 0.177s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Acquiring lock "fbe71dc42b190e0bfbeee567610c2f82cf91e045" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "fbe71dc42b190e0bfbeee567610c2f82cf91e045" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbe71dc42b190e0bfbeee567610c2f82cf91e045 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73aa1c7bb0fc365f15a82b0c664ce2eb624e8b8c --force-share --output=json" returned: 0 in 0.156s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG nova.objects.instance [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lazy-loading 'migration_context' on Instance uuid 40bc627e-28c9-4450-9532-bf6db60845b2 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:03:23 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Rebasing disk image.
Aug 09 07:03:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbe71dc42b190e0bfbeee567610c2f82cf91e045 --force-share --output=json" returned: 0 in 0.229s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbe71dc42b190e0bfbeee567610c2f82cf91e045,backing_fmt=raw /opt/stack/data/nova/instances/a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbe71dc42b190e0bfbeee567610c2f82cf91e045,backing_fmt=raw /opt/stack/data/nova/instances/a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa/disk 1073741824" returned: 0 in 0.054s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "fbe71dc42b190e0bfbeee567610c2f82cf91e045" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbe71dc42b190e0bfbeee567610c2f82cf91e045 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.193s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 -F raw /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG nova.network.neutron [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Successfully updated port: 5bd22d17-9a8a-41ce-b164-16812b74fdcd {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Acquiring lock "refresh_cache-a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Acquired lock "refresh_cache-a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG nova.network.neutron [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG nova.compute.manager [req-2cb9f976-ecbc-4c11-b28d-ffef2009eef9 req-c9754d96-b898-43ba-a9d8-ac0f0da5a881 service nova] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Received event network-changed-5bd22d17-9a8a-41ce-b164-16812b74fdcd {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG nova.compute.manager [req-2cb9f976-ecbc-4c11-b28d-ffef2009eef9 req-c9754d96-b898-43ba-a9d8-ac0f0da5a881 service nova] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Refreshing instance network info cache due to event network-changed-5bd22d17-9a8a-41ce-b164-16812b74fdcd. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2cb9f976-ecbc-4c11-b28d-ffef2009eef9 req-c9754d96-b898-43ba-a9d8-ac0f0da5a881 service nova] Acquiring lock "refresh_cache-a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbe71dc42b190e0bfbeee567610c2f82cf91e045 --force-share --output=json" returned: 0 in 0.182s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG nova.objects.instance [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lazy-loading 'migration_context' on Instance uuid a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Ensure instance console log exists: /opt/stack/data/nova/instances/a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG nova.network.neutron [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG nova.network.neutron [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Updating instance_info_cache with network_info: [{"id": "5bd22d17-9a8a-41ce-b164-16812b74fdcd", "address": "fa:16:3e:d7:36:8c", "network": {"id": "aaea335c-52d5-402b-b53c-b53cc3d7385d", "bridge": "br-int", "label": "tempest-TestStampPattern-1348939935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77be39d2ba434d42bd6b08194503031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd22d17-9a", "ovs_interfaceid": "5bd22d17-9a8a-41ce-b164-16812b74fdcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Releasing lock "refresh_cache-a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG nova.compute.manager [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Instance network_info: |[{"id": "5bd22d17-9a8a-41ce-b164-16812b74fdcd", "address": "fa:16:3e:d7:36:8c", "network": {"id": "aaea335c-52d5-402b-b53c-b53cc3d7385d", "bridge": "br-int", "label": "tempest-TestStampPattern-1348939935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77be39d2ba434d42bd6b08194503031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd22d17-9a", "ovs_interfaceid": "5bd22d17-9a8a-41ce-b164-16812b74fdcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2cb9f976-ecbc-4c11-b28d-ffef2009eef9 req-c9754d96-b898-43ba-a9d8-ac0f0da5a881 service nova] Acquired lock "refresh_cache-a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG nova.network.neutron [req-2cb9f976-ecbc-4c11-b28d-ffef2009eef9 req-c9754d96-b898-43ba-a9d8-ac0f0da5a881 service nova] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Refreshing network info cache for port 5bd22d17-9a8a-41ce-b164-16812b74fdcd {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Start _get_guest_xml network_info=[{"id": "5bd22d17-9a8a-41ce-b164-16812b74fdcd", "address": "fa:16:3e:d7:36:8c", "network": {"id": "aaea335c-52d5-402b-b53c-b53cc3d7385d", "bridge": "br-int", "label": "tempest-TestStampPattern-1348939935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77be39d2ba434d42bd6b08194503031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd22d17-9a", "ovs_interfaceid": "5bd22d17-9a8a-41ce-b164-16812b74fdcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='02aae383467a0ee6e56b01fa5c63981b',container_format='bare',created_at=2023-08-09T07:03:11Z,direct_url=<?>,disk_format='qcow2',id=b10b2e00-2a11-4912-8765-96119c37347f,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-372380967',owner='77be39d2ba434d42bd6b08194503031d',properties=ImageMetaProps,protected=<?>,size=52428800,status='active',tags=<?>,updated_at=2023-08-09T07:03:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'b10b2e00-2a11-4912-8765-96119c37347f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 07:03:23 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:03:23 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:03:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='02aae383467a0ee6e56b01fa5c63981b',container_format='bare',created_at=2023-08-09T07:03:11Z,direct_url=<?>,disk_format='qcow2',id=b10b2e00-2a11-4912-8765-96119c37347f,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-372380967',owner='77be39d2ba434d42bd6b08194503031d',properties=ImageMetaProps,protected=<?>,size=52428800,status='active',tags=<?>,updated_at=2023-08-09T07:03:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 07:03:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 07:03:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 07:03:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:03:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1789581626',display_name='tempest-TestStampPattern-server-1789581626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1789581626',id=34,image_ref='b10b2e00-2a11-4912-8765-96119c37347f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqS/2/2VeQQ93OP20t6ISd1xMlLR9FaU7uvyMUqE2hZscqHexQxbkOj1PbmtjEvjmecnyXPp9gBYtCCngYh9dMwRjEB6Of/ZdkUz4BqrXPYRgKqiRTv44Mwop2+/V3zEQ==',key_name='tempest-TestStampPattern-1744378759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77be39d2ba434d42bd6b08194503031d',ramdisk_id='',reservation_id='r-eol9a3m5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='51432417-89cc-4cee-855d-c4b148e4bd37',image_min_disk='1',image_min_ram='0',image_owner_id='77be39d2ba434d42bd6b08194503031d',image_owner_project_name='tempest-TestStampPattern-1052665161',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1052665161-project-member',image_user_id='ddd99e6c6a034fffa82466ae88ea098d',network_allocated='True',owner_project_name='tempest-TestStampPattern-1052665161',owner_user_name='tempest-TestStampPattern-1052665161-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:03:20Z,user_data=None,user_id='ddd99e6c6a034fffa82466ae88ea098d',uuid=a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bd22d17-9a8a-41ce-b164-16812b74fdcd", "address": "fa:16:3e:d7:36:8c", "network": {"id": "aaea335c-52d5-402b-b53c-b53cc3d7385d", "bridge": "br-int", "label": "tempest-TestStampPattern-1348939935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77be39d2ba434d42bd6b08194503031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd22d17-9a", "ovs_interfaceid": "5bd22d17-9a8a-41ce-b164-16812b74fdcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 07:03:24 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Converting VIF {"id": "5bd22d17-9a8a-41ce-b164-16812b74fdcd", "address": "fa:16:3e:d7:36:8c", "network": {"id": "aaea335c-52d5-402b-b53c-b53cc3d7385d", "bridge": "br-int", "label": "tempest-TestStampPattern-1348939935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77be39d2ba434d42bd6b08194503031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd22d17-9a", "ovs_interfaceid": "5bd22d17-9a8a-41ce-b164-16812b74fdcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:03:24 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:36:8c,bridge_name='br-int',has_traffic_filtering=True,id=5bd22d17-9a8a-41ce-b164-16812b74fdcd,network=Network(aaea335c-52d5-402b-b53c-b53cc3d7385d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd22d17-9a') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:03:24 user nova-compute[72809]: DEBUG nova.objects.instance [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lazy-loading 'pci_devices' on Instance uuid a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:03:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] End _get_guest_xml xml=<domain type="kvm">
Aug 09 07:03:24 user nova-compute[72809]:   <uuid>a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa</uuid>
Aug 09 07:03:24 user nova-compute[72809]:   <name>instance-00000022</name>
Aug 09 07:03:24 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 07:03:24 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 07:03:24 user nova-compute[72809]:   <metadata>
Aug 09 07:03:24 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 07:03:24 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 07:03:24 user nova-compute[72809]:       <nova:name>tempest-TestStampPattern-server-1789581626</nova:name>
Aug 09 07:03:24 user nova-compute[72809]:       <nova:creationTime>2023-08-09 07:03:23</nova:creationTime>
Aug 09 07:03:24 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 07:03:24 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 07:03:24 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 07:03:24 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 07:03:24 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 07:03:24 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 07:03:24 user nova-compute[72809]:       </nova:flavor>
Aug 09 07:03:24 user nova-compute[72809]:       <nova:owner>
Aug 09 07:03:24 user nova-compute[72809]:         <nova:user uuid="ddd99e6c6a034fffa82466ae88ea098d">tempest-TestStampPattern-1052665161-project-member</nova:user>
Aug 09 07:03:24 user nova-compute[72809]:         <nova:project uuid="77be39d2ba434d42bd6b08194503031d">tempest-TestStampPattern-1052665161</nova:project>
Aug 09 07:03:24 user nova-compute[72809]:       </nova:owner>
Aug 09 07:03:24 user nova-compute[72809]:       <nova:root type="image" uuid="b10b2e00-2a11-4912-8765-96119c37347f"/>
Aug 09 07:03:24 user nova-compute[72809]:       <nova:ports>
Aug 09 07:03:24 user nova-compute[72809]:         <nova:port uuid="5bd22d17-9a8a-41ce-b164-16812b74fdcd">
Aug 09 07:03:24 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 07:03:24 user nova-compute[72809]:         </nova:port>
Aug 09 07:03:24 user nova-compute[72809]:       </nova:ports>
Aug 09 07:03:24 user nova-compute[72809]:     </nova:instance>
Aug 09 07:03:24 user nova-compute[72809]:   </metadata>
Aug 09 07:03:24 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 07:03:24 user nova-compute[72809]:     <system>
Aug 09 07:03:24 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 07:03:24 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 07:03:24 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 07:03:24 user nova-compute[72809]:       <entry name="serial">a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa</entry>
Aug 09 07:03:24 user nova-compute[72809]:       <entry name="uuid">a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa</entry>
Aug 09 07:03:24 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 07:03:24 user nova-compute[72809]:     </system>
Aug 09 07:03:24 user nova-compute[72809]:   </sysinfo>
Aug 09 07:03:24 user nova-compute[72809]:   <os>
Aug 09 07:03:24 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 07:03:24 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 07:03:24 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 07:03:24 user nova-compute[72809]:   </os>
Aug 09 07:03:24 user nova-compute[72809]:   <features>
Aug 09 07:03:24 user nova-compute[72809]:     <acpi/>
Aug 09 07:03:24 user nova-compute[72809]:     <apic/>
Aug 09 07:03:24 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 07:03:24 user nova-compute[72809]:   </features>
Aug 09 07:03:24 user nova-compute[72809]:   <clock offset="utc">
Aug 09 07:03:24 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 07:03:24 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 07:03:24 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 07:03:24 user nova-compute[72809]:   </clock>
Aug 09 07:03:24 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 07:03:24 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 07:03:24 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 07:03:24 user nova-compute[72809]:   </cpu>
Aug 09 07:03:24 user nova-compute[72809]:   <devices>
Aug 09 07:03:24 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 07:03:24 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 07:03:24 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa/disk"/>
Aug 09 07:03:24 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 07:03:24 user nova-compute[72809]:     </disk>
Aug 09 07:03:24 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 07:03:24 user nova-compute[72809]:       <mac address="fa:16:3e:d7:36:8c"/>
Aug 09 07:03:24 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:03:24 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 07:03:24 user nova-compute[72809]:       <target dev="tap5bd22d17-9a"/>
Aug 09 07:03:24 user nova-compute[72809]:     </interface>
Aug 09 07:03:24 user nova-compute[72809]:     <serial type="pty">
Aug 09 07:03:24 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa/console.log" append="off"/>
Aug 09 07:03:24 user nova-compute[72809]:     </serial>
Aug 09 07:03:24 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 07:03:24 user nova-compute[72809]:     <video>
Aug 09 07:03:24 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:03:24 user nova-compute[72809]:     </video>
Aug 09 07:03:24 user nova-compute[72809]:     <rng model="virtio">
Aug 09 07:03:24 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 07:03:24 user nova-compute[72809]:     </rng>
Aug 09 07:03:24 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 07:03:24 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 07:03:24 user nova-compute[72809]:       <stats period="10"/>
Aug 09 07:03:24 user nova-compute[72809]:     </memballoon>
Aug 09 07:03:24 user nova-compute[72809]:   </devices>
Aug 09 07:03:24 user nova-compute[72809]: </domain>
Aug 09 07:03:24 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 07:03:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:03:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1789581626',display_name='tempest-TestStampPattern-server-1789581626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1789581626',id=34,image_ref='b10b2e00-2a11-4912-8765-96119c37347f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqS/2/2VeQQ93OP20t6ISd1xMlLR9FaU7uvyMUqE2hZscqHexQxbkOj1PbmtjEvjmecnyXPp9gBYtCCngYh9dMwRjEB6Of/ZdkUz4BqrXPYRgKqiRTv44Mwop2+/V3zEQ==',key_name='tempest-TestStampPattern-1744378759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77be39d2ba434d42bd6b08194503031d',ramdisk_id='',reservation_id='r-eol9a3m5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='51432417-89cc-4cee-855d-c4b148e4bd37',image_min_disk='1',image_min_ram='0',image_owner_id='77be39d2ba434d42bd6b08194503031d',image_owner_project_name='tempest-TestStampPattern-1052665161',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1052665161-project-member',image_user_id='ddd99e6c6a034fffa82466ae88ea098d',network_allocated='True',owner_project_name='tempest-TestStampPattern-1052665161',owner_user_name='tempest-TestStampPattern-1052665161-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:03:20Z,user_data=None,user_id='ddd99e6c6a034fffa82466ae88ea098d',uuid=a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bd22d17-9a8a-41ce-b164-16812b74fdcd", "address": "fa:16:3e:d7:36:8c", "network": {"id": "aaea335c-52d5-402b-b53c-b53cc3d7385d", "bridge": "br-int", "label": "tempest-TestStampPattern-1348939935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77be39d2ba434d42bd6b08194503031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd22d17-9a", "ovs_interfaceid": "5bd22d17-9a8a-41ce-b164-16812b74fdcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 07:03:24 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Converting VIF {"id": "5bd22d17-9a8a-41ce-b164-16812b74fdcd", "address": "fa:16:3e:d7:36:8c", "network": {"id": "aaea335c-52d5-402b-b53c-b53cc3d7385d", "bridge": "br-int", "label": "tempest-TestStampPattern-1348939935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77be39d2ba434d42bd6b08194503031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd22d17-9a", "ovs_interfaceid": "5bd22d17-9a8a-41ce-b164-16812b74fdcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:03:24 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:36:8c,bridge_name='br-int',has_traffic_filtering=True,id=5bd22d17-9a8a-41ce-b164-16812b74fdcd,network=Network(aaea335c-52d5-402b-b53c-b53cc3d7385d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd22d17-9a') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:03:24 user nova-compute[72809]: DEBUG os_vif [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:36:8c,bridge_name='br-int',has_traffic_filtering=True,id=5bd22d17-9a8a-41ce-b164-16812b74fdcd,network=Network(aaea335c-52d5-402b-b53c-b53cc3d7385d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd22d17-9a') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 07:03:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:03:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 07:03:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5bd22d17-9a, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:03:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5bd22d17-9a, col_values=(('external_ids', {'iface-id': '5bd22d17-9a8a-41ce-b164-16812b74fdcd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:36:8c', 'vm-uuid': 'a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:03:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:03:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:24 user nova-compute[72809]: INFO os_vif [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:36:8c,bridge_name='br-int',has_traffic_filtering=True,id=5bd22d17-9a8a-41ce-b164-16812b74fdcd,network=Network(aaea335c-52d5-402b-b53c-b53cc3d7385d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd22d17-9a')
Aug 09 07:03:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:03:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] No VIF found with MAC fa:16:3e:d7:36:8c, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:03:24 user nova-compute[72809]: DEBUG nova.network.neutron [req-2cb9f976-ecbc-4c11-b28d-ffef2009eef9 req-c9754d96-b898-43ba-a9d8-ac0f0da5a881 service nova] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Updated VIF entry in instance network info cache for port 5bd22d17-9a8a-41ce-b164-16812b74fdcd. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:03:24 user nova-compute[72809]: DEBUG nova.network.neutron [req-2cb9f976-ecbc-4c11-b28d-ffef2009eef9 req-c9754d96-b898-43ba-a9d8-ac0f0da5a881 service nova] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Updating instance_info_cache with network_info: [{"id": "5bd22d17-9a8a-41ce-b164-16812b74fdcd", "address": "fa:16:3e:d7:36:8c", "network": {"id": "aaea335c-52d5-402b-b53c-b53cc3d7385d", "bridge": "br-int", "label": "tempest-TestStampPattern-1348939935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77be39d2ba434d42bd6b08194503031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd22d17-9a", "ovs_interfaceid": "5bd22d17-9a8a-41ce-b164-16812b74fdcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:03:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2cb9f976-ecbc-4c11-b28d-ffef2009eef9 req-c9754d96-b898-43ba-a9d8-ac0f0da5a881 service nova] Releasing lock "refresh_cache-a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 -F raw /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk" returned: 0 in 2.738s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Ensure instance console log exists: /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Start _get_guest_xml network_info=[{"id": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "address": "fa:16:3e:15:53:7d", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape17ef1fb-76", "ovs_interfaceid": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='f0f2321b68d24dc6a377430bb990a04c',container_format='bare',created_at=2023-08-09T07:01:24Z,direct_url=<?>,disk_format='qcow2',id=4f2ff998-c537-418f-9f29-b1171b15d07e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-301681722-shelved',owner='0ec36de19d984ff3a150db4fdd8ce327',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T07:01:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 07:03:26 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:03:26 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:03:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='f0f2321b68d24dc6a377430bb990a04c',container_format='bare',created_at=2023-08-09T07:01:24Z,direct_url=<?>,disk_format='qcow2',id=4f2ff998-c537-418f-9f29-b1171b15d07e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-301681722-shelved',owner='0ec36de19d984ff3a150db4fdd8ce327',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T07:01:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG nova.objects.instance [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lazy-loading 'vcpu_model' on Instance uuid 40bc627e-28c9-4450-9532-bf6db60845b2 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T06:59:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-301681722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-301681722',id=27,image_ref='4f2ff998-c537-418f-9f29-b1171b15d07e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1856803890',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:59:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0ec36de19d984ff3a150db4fdd8ce327',ramdisk_id='',reservation_id='r-3ai7s74q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1006961404',owner_user_name='tempest-AttachVolumeShelveTestJSON-1006961404-project-member',shelved_at='2023-08-09T07:01:28.233262',shelved_host='user',shelved_image_id='4f2ff998-c537-418f-9f29-b1171b15d07e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:03:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e51e8a984c724efe966662c14b0dbffc',uuid=40bc627e-28c9-4450-9532-bf6db60845b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "address": "fa:16:3e:15:53:7d", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape17ef1fb-76", "ovs_interfaceid": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Converting VIF {"id": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "address": "fa:16:3e:15:53:7d", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape17ef1fb-76", "ovs_interfaceid": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:53:7d,bridge_name='br-int',has_traffic_filtering=True,id=e17ef1fb-761f-4b49-803c-b4c55115eb7c,network=Network(39277410-6754-4b40-b1bc-9777841910ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape17ef1fb-76') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG nova.objects.instance [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lazy-loading 'pci_devices' on Instance uuid 40bc627e-28c9-4450-9532-bf6db60845b2 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] End _get_guest_xml xml=<domain type="kvm">
Aug 09 07:03:26 user nova-compute[72809]:   <uuid>40bc627e-28c9-4450-9532-bf6db60845b2</uuid>
Aug 09 07:03:26 user nova-compute[72809]:   <name>instance-0000001b</name>
Aug 09 07:03:26 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 07:03:26 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 07:03:26 user nova-compute[72809]:   <metadata>
Aug 09 07:03:26 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 07:03:26 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 07:03:26 user nova-compute[72809]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-301681722</nova:name>
Aug 09 07:03:26 user nova-compute[72809]:       <nova:creationTime>2023-08-09 07:03:26</nova:creationTime>
Aug 09 07:03:26 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 07:03:26 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 07:03:26 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 07:03:26 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 07:03:26 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 07:03:26 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 07:03:26 user nova-compute[72809]:       </nova:flavor>
Aug 09 07:03:26 user nova-compute[72809]:       <nova:owner>
Aug 09 07:03:26 user nova-compute[72809]:         <nova:user uuid="e51e8a984c724efe966662c14b0dbffc">tempest-AttachVolumeShelveTestJSON-1006961404-project-member</nova:user>
Aug 09 07:03:26 user nova-compute[72809]:         <nova:project uuid="0ec36de19d984ff3a150db4fdd8ce327">tempest-AttachVolumeShelveTestJSON-1006961404</nova:project>
Aug 09 07:03:26 user nova-compute[72809]:       </nova:owner>
Aug 09 07:03:26 user nova-compute[72809]:       <nova:root type="image" uuid="4f2ff998-c537-418f-9f29-b1171b15d07e"/>
Aug 09 07:03:26 user nova-compute[72809]:       <nova:ports>
Aug 09 07:03:26 user nova-compute[72809]:         <nova:port uuid="e17ef1fb-761f-4b49-803c-b4c55115eb7c">
Aug 09 07:03:26 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 07:03:26 user nova-compute[72809]:         </nova:port>
Aug 09 07:03:26 user nova-compute[72809]:       </nova:ports>
Aug 09 07:03:26 user nova-compute[72809]:     </nova:instance>
Aug 09 07:03:26 user nova-compute[72809]:   </metadata>
Aug 09 07:03:26 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 07:03:26 user nova-compute[72809]:     <system>
Aug 09 07:03:26 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 07:03:26 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 07:03:26 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 07:03:26 user nova-compute[72809]:       <entry name="serial">40bc627e-28c9-4450-9532-bf6db60845b2</entry>
Aug 09 07:03:26 user nova-compute[72809]:       <entry name="uuid">40bc627e-28c9-4450-9532-bf6db60845b2</entry>
Aug 09 07:03:26 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 07:03:26 user nova-compute[72809]:     </system>
Aug 09 07:03:26 user nova-compute[72809]:   </sysinfo>
Aug 09 07:03:26 user nova-compute[72809]:   <os>
Aug 09 07:03:26 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 07:03:26 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 07:03:26 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 07:03:26 user nova-compute[72809]:   </os>
Aug 09 07:03:26 user nova-compute[72809]:   <features>
Aug 09 07:03:26 user nova-compute[72809]:     <acpi/>
Aug 09 07:03:26 user nova-compute[72809]:     <apic/>
Aug 09 07:03:26 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 07:03:26 user nova-compute[72809]:   </features>
Aug 09 07:03:26 user nova-compute[72809]:   <clock offset="utc">
Aug 09 07:03:26 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 07:03:26 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 07:03:26 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 07:03:26 user nova-compute[72809]:   </clock>
Aug 09 07:03:26 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 07:03:26 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 07:03:26 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 07:03:26 user nova-compute[72809]:   </cpu>
Aug 09 07:03:26 user nova-compute[72809]:   <devices>
Aug 09 07:03:26 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 07:03:26 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 07:03:26 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk"/>
Aug 09 07:03:26 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 07:03:26 user nova-compute[72809]:     </disk>
Aug 09 07:03:26 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 07:03:26 user nova-compute[72809]:       <mac address="fa:16:3e:15:53:7d"/>
Aug 09 07:03:26 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:03:26 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 07:03:26 user nova-compute[72809]:       <target dev="tape17ef1fb-76"/>
Aug 09 07:03:26 user nova-compute[72809]:     </interface>
Aug 09 07:03:26 user nova-compute[72809]:     <serial type="pty">
Aug 09 07:03:26 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/console.log" append="off"/>
Aug 09 07:03:26 user nova-compute[72809]:     </serial>
Aug 09 07:03:26 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 07:03:26 user nova-compute[72809]:     <video>
Aug 09 07:03:26 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:03:26 user nova-compute[72809]:     </video>
Aug 09 07:03:26 user nova-compute[72809]:     <rng model="virtio">
Aug 09 07:03:26 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 07:03:26 user nova-compute[72809]:     </rng>
Aug 09 07:03:26 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 07:03:26 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 07:03:26 user nova-compute[72809]:       <stats period="10"/>
Aug 09 07:03:26 user nova-compute[72809]:     </memballoon>
Aug 09 07:03:26 user nova-compute[72809]:   </devices>
Aug 09 07:03:26 user nova-compute[72809]: </domain>
Aug 09 07:03:26 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T06:59:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-301681722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-301681722',id=27,image_ref='4f2ff998-c537-418f-9f29-b1171b15d07e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1856803890',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:59:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0ec36de19d984ff3a150db4fdd8ce327',ramdisk_id='',reservation_id='r-3ai7s74q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1006961404',owner_user_name='tempest-AttachVolumeShelveTestJSON-1006961404-project-member',shelved_at='2023-08-09T07:01:28.233262',shelved_host='user',shelved_image_id='4f2ff998-c537-418f-9f29-b1171b15d07e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:03:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e51e8a984c724efe966662c14b0dbffc',uuid=40bc627e-28c9-4450-9532-bf6db60845b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "address": "fa:16:3e:15:53:7d", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape17ef1fb-76", "ovs_interfaceid": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Converting VIF {"id": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "address": "fa:16:3e:15:53:7d", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape17ef1fb-76", "ovs_interfaceid": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:53:7d,bridge_name='br-int',has_traffic_filtering=True,id=e17ef1fb-761f-4b49-803c-b4c55115eb7c,network=Network(39277410-6754-4b40-b1bc-9777841910ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape17ef1fb-76') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG os_vif [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:53:7d,bridge_name='br-int',has_traffic_filtering=True,id=e17ef1fb-761f-4b49-803c-b4c55115eb7c,network=Network(39277410-6754-4b40-b1bc-9777841910ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape17ef1fb-76') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape17ef1fb-76, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape17ef1fb-76, col_values=(('external_ids', {'iface-id': 'e17ef1fb-761f-4b49-803c-b4c55115eb7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:53:7d', 'vm-uuid': '40bc627e-28c9-4450-9532-bf6db60845b2'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:26 user nova-compute[72809]: INFO os_vif [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:53:7d,bridge_name='br-int',has_traffic_filtering=True,id=e17ef1fb-761f-4b49-803c-b4c55115eb7c,network=Network(39277410-6754-4b40-b1bc-9777841910ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape17ef1fb-76')
Aug 09 07:03:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] No VIF found with MAC fa:16:3e:15:53:7d, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG nova.compute.manager [req-f3485d44-6320-4590-8b48-11b87c6f5c7b req-57183885-6bff-4102-80b9-a472eb053acd service nova] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Received event network-vif-plugged-5bd22d17-9a8a-41ce-b164-16812b74fdcd {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f3485d44-6320-4590-8b48-11b87c6f5c7b req-57183885-6bff-4102-80b9-a472eb053acd service nova] Acquiring lock "a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f3485d44-6320-4590-8b48-11b87c6f5c7b req-57183885-6bff-4102-80b9-a472eb053acd service nova] Lock "a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f3485d44-6320-4590-8b48-11b87c6f5c7b req-57183885-6bff-4102-80b9-a472eb053acd service nova] Lock "a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:03:26 user nova-compute[72809]: DEBUG nova.compute.manager [req-f3485d44-6320-4590-8b48-11b87c6f5c7b req-57183885-6bff-4102-80b9-a472eb053acd service nova] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] No waiting events found dispatching network-vif-plugged-5bd22d17-9a8a-41ce-b164-16812b74fdcd {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:03:26 user nova-compute[72809]: WARNING nova.compute.manager [req-f3485d44-6320-4590-8b48-11b87c6f5c7b req-57183885-6bff-4102-80b9-a472eb053acd service nova] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Received unexpected event network-vif-plugged-5bd22d17-9a8a-41ce-b164-16812b74fdcd for instance with vm_state building and task_state spawning.
Aug 09 07:03:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:28 user nova-compute[72809]: DEBUG nova.compute.manager [req-3863a15a-cdcd-47fa-a5a3-8b2a1711fbea req-2c44f7ed-0ec9-438d-adeb-d17f4cb40fa5 service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Received event network-vif-plugged-e17ef1fb-761f-4b49-803c-b4c55115eb7c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:03:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3863a15a-cdcd-47fa-a5a3-8b2a1711fbea req-2c44f7ed-0ec9-438d-adeb-d17f4cb40fa5 service nova] Acquiring lock "40bc627e-28c9-4450-9532-bf6db60845b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:03:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3863a15a-cdcd-47fa-a5a3-8b2a1711fbea req-2c44f7ed-0ec9-438d-adeb-d17f4cb40fa5 service nova] Lock "40bc627e-28c9-4450-9532-bf6db60845b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:03:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3863a15a-cdcd-47fa-a5a3-8b2a1711fbea req-2c44f7ed-0ec9-438d-adeb-d17f4cb40fa5 service nova] Lock "40bc627e-28c9-4450-9532-bf6db60845b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:03:28 user nova-compute[72809]: DEBUG nova.compute.manager [req-3863a15a-cdcd-47fa-a5a3-8b2a1711fbea req-2c44f7ed-0ec9-438d-adeb-d17f4cb40fa5 service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] No waiting events found dispatching network-vif-plugged-e17ef1fb-761f-4b49-803c-b4c55115eb7c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:03:28 user nova-compute[72809]: WARNING nova.compute.manager [req-3863a15a-cdcd-47fa-a5a3-8b2a1711fbea req-2c44f7ed-0ec9-438d-adeb-d17f4cb40fa5 service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Received unexpected event network-vif-plugged-e17ef1fb-761f-4b49-803c-b4c55115eb7c for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 07:03:28 user nova-compute[72809]: DEBUG nova.compute.manager [req-03088387-72cd-4051-9703-4c2ffb5fc72f req-d10fb932-ce3b-4df2-bda9-0546b436d25a service nova] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Received event network-vif-plugged-5bd22d17-9a8a-41ce-b164-16812b74fdcd {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:03:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-03088387-72cd-4051-9703-4c2ffb5fc72f req-d10fb932-ce3b-4df2-bda9-0546b436d25a service nova] Acquiring lock "a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:03:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-03088387-72cd-4051-9703-4c2ffb5fc72f req-d10fb932-ce3b-4df2-bda9-0546b436d25a service nova] Lock "a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:03:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-03088387-72cd-4051-9703-4c2ffb5fc72f req-d10fb932-ce3b-4df2-bda9-0546b436d25a service nova] Lock "a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:03:28 user nova-compute[72809]: DEBUG nova.compute.manager [req-03088387-72cd-4051-9703-4c2ffb5fc72f req-d10fb932-ce3b-4df2-bda9-0546b436d25a service nova] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] No waiting events found dispatching network-vif-plugged-5bd22d17-9a8a-41ce-b164-16812b74fdcd {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:03:28 user nova-compute[72809]: WARNING nova.compute.manager [req-03088387-72cd-4051-9703-4c2ffb5fc72f req-d10fb932-ce3b-4df2-bda9-0546b436d25a service nova] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Received unexpected event network-vif-plugged-5bd22d17-9a8a-41ce-b164-16812b74fdcd for instance with vm_state building and task_state spawning.
Aug 09 07:03:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:29 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564609.761439, a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:03:29 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] VM Resumed (Lifecycle Event)
Aug 09 07:03:29 user nova-compute[72809]: DEBUG nova.compute.manager [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 07:03:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 07:03:29 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Instance spawned successfully.
Aug 09 07:03:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 07:03:29 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:03:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:03:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:03:29 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:03:29 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:03:29 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564609.7628207, a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:03:29 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] VM Started (Lifecycle Event)
Aug 09 07:03:29 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:03:29 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:03:29 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:03:29 user nova-compute[72809]: INFO nova.compute.manager [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Took 8.51 seconds to spawn the instance on the hypervisor.
Aug 09 07:03:29 user nova-compute[72809]: DEBUG nova.compute.manager [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:03:30 user nova-compute[72809]: INFO nova.compute.manager [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Took 10.67 seconds to build instance.
Aug 09 07:03:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-042d8b2d-4374-4a3a-82df-69236c40c486 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.784s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:03:30 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564610.3552012, 40bc627e-28c9-4450-9532-bf6db60845b2 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:03:30 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] VM Resumed (Lifecycle Event)
Aug 09 07:03:30 user nova-compute[72809]: DEBUG nova.compute.manager [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 07:03:30 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 07:03:30 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Instance spawned successfully.
Aug 09 07:03:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-50dfd7c1-8248-4453-8572-ae5b184d9117 req-7d623bb8-a06c-47d1-b974-9abc5aeab0ac service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Received event network-vif-plugged-e17ef1fb-761f-4b49-803c-b4c55115eb7c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:03:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-50dfd7c1-8248-4453-8572-ae5b184d9117 req-7d623bb8-a06c-47d1-b974-9abc5aeab0ac service nova] Acquiring lock "40bc627e-28c9-4450-9532-bf6db60845b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:03:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-50dfd7c1-8248-4453-8572-ae5b184d9117 req-7d623bb8-a06c-47d1-b974-9abc5aeab0ac service nova] Lock "40bc627e-28c9-4450-9532-bf6db60845b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:03:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-50dfd7c1-8248-4453-8572-ae5b184d9117 req-7d623bb8-a06c-47d1-b974-9abc5aeab0ac service nova] Lock "40bc627e-28c9-4450-9532-bf6db60845b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:03:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-50dfd7c1-8248-4453-8572-ae5b184d9117 req-7d623bb8-a06c-47d1-b974-9abc5aeab0ac service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] No waiting events found dispatching network-vif-plugged-e17ef1fb-761f-4b49-803c-b4c55115eb7c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:03:30 user nova-compute[72809]: WARNING nova.compute.manager [req-50dfd7c1-8248-4453-8572-ae5b184d9117 req-7d623bb8-a06c-47d1-b974-9abc5aeab0ac service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Received unexpected event network-vif-plugged-e17ef1fb-761f-4b49-803c-b4c55115eb7c for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 07:03:30 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:03:30 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:03:30 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:03:30 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564610.359429, 40bc627e-28c9-4450-9532-bf6db60845b2 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:03:30 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] VM Started (Lifecycle Event)
Aug 09 07:03:30 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:03:30 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:03:30 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:03:30 user nova-compute[72809]: DEBUG nova.compute.manager [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:03:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4681246c-c2bf-4d79-b485-2138492e3fad tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "40bc627e-28c9-4450-9532-bf6db60845b2" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.851s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:03:31 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EVZgdbWU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:03:32 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:03:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:03:32 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:03:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:03:32 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 07:03:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594 -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66913c3-719a-4b45-a946-2652473829da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 07:03:32 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594 -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[400af121-18a5-4ae9-b434-d40d0961259d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594] added
Aug 09 07:03:32 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[137a3d59-24d2-4430-97d4-93b084a565b4]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8948fb8-2c2b-4c66-bbf1-20526a6f5884]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EVZgdbWU {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EVZgdbWU" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[43340ad1-3fa1-4d4c-b43d-1e5683418ba6]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EVZgdbWU'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5ce140-0580-4003-b8da-87c4f57cc387]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ced5857-728d-4ed5-84cc-590cbdb882d0]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:03:32 user nova-compute[72809]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:03:32 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:03:32 user nova-compute[72809]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:03:32 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594 -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f16502-fd6a-4a7c-9f6a-9a405849ee8a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594, portal: 172.16.0.220,3260]
Aug 09 07:03:32 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594, portal: 172.16.0.220,3260] successful.
Aug 09 07:03:32 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5ca5d8-5f0e-4745-85d2-ca179d5f37f1]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9743fe3-93a8-4659-83fa-aad4e5bfda0f]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:03:32 user nova-compute[72809]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:03:32 user nova-compute[72809]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594 (non-flash)
Aug 09 07:03:32 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:03:32 user nova-compute[72809]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:03:32 user nova-compute[72809]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594 (non-flash)
Aug 09 07:03:32 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[857db114-436e-46ae-85f7-6c491165e1c6]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:03:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EVZgdbWU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 07:03:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:03:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '26434343366396130', 'path': '/dev/sdd'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:03:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434343366396130', 'path': '/dev/sdd'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 07:03:33 user nova-compute[72809]: DEBUG nova.objects.instance [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lazy-loading 'flavor' on Instance uuid 59d67126-7529-408e-a2ae-39c6bc152769 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:03:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 07:03:33 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:03:33 user nova-compute[72809]:   <source dev="/dev/sdd"/>
Aug 09 07:03:33 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:03:33 user nova-compute[72809]:   <serial>05c57159-a986-4730-b056-eb8abd6a4594</serial>
Aug 09 07:03:33 user nova-compute[72809]: </disk>
Aug 09 07:03:33 user nova-compute[72809]:  {{(pid=72809) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 07:03:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:33 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:03:33 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 07:03:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-bebd5a14-6272-4de1-a1a1-4fb45b867c7f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:03:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-bebd5a14-6272-4de1-a1a1-4fb45b867c7f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:03:33 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 07:03:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:03:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:03:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] No VIF found with MAC fa:16:3e:51:e3:e8, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:03:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3b024099-25d1-4621-bb14-1c049d7ac6fc tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "59d67126-7529-408e-a2ae-39c6bc152769" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.653s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:03:34 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Updating instance_info_cache with network_info: [{"id": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "address": "fa:16:3e:95:65:6f", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c034fd-3a", "ovs_interfaceid": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:03:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-bebd5a14-6272-4de1-a1a1-4fb45b867c7f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:03:34 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 07:03:36 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:36 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:03:36 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:03:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:03:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:03:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:03:36 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 07:03:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:03:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:03:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/466a8e58-5f88-4ffe-a7fd-a346003f3508/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/466a8e58-5f88-4ffe-a7fd-a346003f3508/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/466a8e58-5f88-4ffe-a7fd-a346003f3508/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/466a8e58-5f88-4ffe-a7fd-a346003f3508/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d67126-7529-408e-a2ae-39c6bc152769/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d67126-7529-408e-a2ae-39c6bc152769/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d67126-7529-408e-a2ae-39c6bc152769/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d67126-7529-408e-a2ae-39c6bc152769/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:03:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cab676-b3c0-4f05-9e44-42e5a6677857/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cab676-b3c0-4f05-9e44-42e5a6677857/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cab676-b3c0-4f05-9e44-42e5a6677857/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cab676-b3c0-4f05-9e44-42e5a6677857/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:41 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:03:41 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:03:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=7240MB free_disk=25.01813507080078GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 07:03:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:03:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:03:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 336770eb-4f09-4134-92ef-f96039bf4fa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:03:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 1bde423f-0b73-448f-bdce-8d6af96d8fc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:03:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance bebd5a14-6272-4de1-a1a1-4fb45b867c7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:03:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 339372ed-140d-4226-ba00-2cc682214d5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:03:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 38319c37-9cc0-4e84-8415-ddcf37451daf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:03:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 51432417-89cc-4cee-855d-c4b148e4bd37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:03:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 466a8e58-5f88-4ffe-a7fd-a346003f3508 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:03:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 59d67126-7529-408e-a2ae-39c6bc152769 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:03:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance b5cab676-b3c0-4f05-9e44-42e5a6677857 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:03:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance a754327a-9985-4430-af66-1d8bc82fb868 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:03:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 40bc627e-28c9-4450-9532-bf6db60845b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:03:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:03:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 07:03:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 07:03:42 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:03:42 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:03:42 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 07:03:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.719s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:03:44 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:03:44 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:03:44 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:03:44 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:03:44 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:03:44 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:03:44 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 07:03:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:03:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:03:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72809) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 07:03:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:03:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:03:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:54 user nova-compute[72809]: DEBUG nova.compute.manager [req-8c0bc3ad-06c6-4ac0-9ed5-a57c7d0876ed req-16fa4934-4050-439d-946a-79104469d959 service nova] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Received event network-changed-df6b4846-8c11-4271-9184-f9f93aec39d5 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:03:54 user nova-compute[72809]: DEBUG nova.compute.manager [req-8c0bc3ad-06c6-4ac0-9ed5-a57c7d0876ed req-16fa4934-4050-439d-946a-79104469d959 service nova] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Refreshing instance network info cache due to event network-changed-df6b4846-8c11-4271-9184-f9f93aec39d5. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:03:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-8c0bc3ad-06c6-4ac0-9ed5-a57c7d0876ed req-16fa4934-4050-439d-946a-79104469d959 service nova] Acquiring lock "refresh_cache-b5cab676-b3c0-4f05-9e44-42e5a6677857" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:03:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-8c0bc3ad-06c6-4ac0-9ed5-a57c7d0876ed req-16fa4934-4050-439d-946a-79104469d959 service nova] Acquired lock "refresh_cache-b5cab676-b3c0-4f05-9e44-42e5a6677857" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:03:54 user nova-compute[72809]: DEBUG nova.network.neutron [req-8c0bc3ad-06c6-4ac0-9ed5-a57c7d0876ed req-16fa4934-4050-439d-946a-79104469d959 service nova] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Refreshing network info cache for port df6b4846-8c11-4271-9184-f9f93aec39d5 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:03:55 user nova-compute[72809]: DEBUG nova.network.neutron [req-8c0bc3ad-06c6-4ac0-9ed5-a57c7d0876ed req-16fa4934-4050-439d-946a-79104469d959 service nova] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Updated VIF entry in instance network info cache for port df6b4846-8c11-4271-9184-f9f93aec39d5. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:03:55 user nova-compute[72809]: DEBUG nova.network.neutron [req-8c0bc3ad-06c6-4ac0-9ed5-a57c7d0876ed req-16fa4934-4050-439d-946a-79104469d959 service nova] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Updating instance_info_cache with network_info: [{"id": "df6b4846-8c11-4271-9184-f9f93aec39d5", "address": "fa:16:3e:5f:ac:5e", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6b4846-8c", "ovs_interfaceid": "df6b4846-8c11-4271-9184-f9f93aec39d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:03:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-8c0bc3ad-06c6-4ac0-9ed5-a57c7d0876ed req-16fa4934-4050-439d-946a-79104469d959 service nova] Releasing lock "refresh_cache-b5cab676-b3c0-4f05-9e44-42e5a6677857" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:03:56 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "b5cab676-b3c0-4f05-9e44-42e5a6677857" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:03:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "b5cab676-b3c0-4f05-9e44-42e5a6677857" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:03:58 user nova-compute[72809]: DEBUG nova.objects.instance [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lazy-loading 'flavor' on Instance uuid b5cab676-b3c0-4f05-9e44-42e5a6677857 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:03:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:03:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "b5cab676-b3c0-4f05-9e44-42e5a6677857" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:03:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "b5cab676-b3c0-4f05-9e44-42e5a6677857" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:03:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "b5cab676-b3c0-4f05-9e44-42e5a6677857" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:03:58 user nova-compute[72809]: INFO nova.compute.manager [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Attaching volume d89ab0d3-ce90-485a-82d8-7ccd1a77c43e to /dev/vdb
Aug 09 07:03:58 user nova-compute[72809]: DEBUG os_brick.utils [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:03:58 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:58 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:58 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a3a4d5-3588-40c9-b6fd-7c92419371c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:03:58 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:58 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:58 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab67b9f-957d-4a0d-b9ac-0799810985fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:03:58 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:58 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:03:58 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53bca5a-c5de-4890-a65e-f7e4b6085baf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:03:58 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c411522b-d336-4647-9bca-82448abcaa90]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:03:58 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:58 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:03:58 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 07:03:58 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:03:58 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:03:58 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 07:03:58 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5d4616-afba-4026-aa72-65c081073115]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:03:58 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 07:03:58 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 07:03:58 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 07:03:58 user nova-compute[72809]: DEBUG os_brick.utils [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:03:58 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Updating existing volume attachment record: 83b46609-2116-45ca-a977-529e34c7ea3b {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 07:04:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:02 user nova-compute[72809]: INFO nova.compute.manager [None req-d0de52fd-791b-4015-b222-dd8303de584b tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Unrescuing
Aug 09 07:04:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d0de52fd-791b-4015-b222-dd8303de584b tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "refresh_cache-466a8e58-5f88-4ffe-a7fd-a346003f3508" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:04:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d0de52fd-791b-4015-b222-dd8303de584b tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquired lock "refresh_cache-466a8e58-5f88-4ffe-a7fd-a346003f3508" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:04:02 user nova-compute[72809]: DEBUG nova.network.neutron [None req-d0de52fd-791b-4015-b222-dd8303de584b tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:04:03 user nova-compute[72809]: DEBUG nova.network.neutron [None req-d0de52fd-791b-4015-b222-dd8303de584b tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Updating instance_info_cache with network_info: [{"id": "8a95ff1b-0686-455d-977c-cedac8be3930", "address": "fa:16:3e:42:8d:bd", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a95ff1b-06", "ovs_interfaceid": "8a95ff1b-0686-455d-977c-cedac8be3930", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:04:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d0de52fd-791b-4015-b222-dd8303de584b tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Releasing lock "refresh_cache-466a8e58-5f88-4ffe-a7fd-a346003f3508" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:04:03 user nova-compute[72809]: DEBUG nova.objects.instance [None req-d0de52fd-791b-4015-b222-dd8303de584b tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lazy-loading 'flavor' on Instance uuid 466a8e58-5f88-4ffe-a7fd-a346003f3508 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:04:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:03 user nova-compute[72809]: DEBUG nova.compute.manager [req-0ef5de21-26c5-4d52-95d8-2ab3be142f76 req-f6068179-42a8-4f98-9631-4748ff7f7ca8 service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Received event network-vif-unplugged-8a95ff1b-0686-455d-977c-cedac8be3930 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:04:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0ef5de21-26c5-4d52-95d8-2ab3be142f76 req-f6068179-42a8-4f98-9631-4748ff7f7ca8 service nova] Acquiring lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:04:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0ef5de21-26c5-4d52-95d8-2ab3be142f76 req-f6068179-42a8-4f98-9631-4748ff7f7ca8 service nova] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:04:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0ef5de21-26c5-4d52-95d8-2ab3be142f76 req-f6068179-42a8-4f98-9631-4748ff7f7ca8 service nova] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:04:03 user nova-compute[72809]: DEBUG nova.compute.manager [req-0ef5de21-26c5-4d52-95d8-2ab3be142f76 req-f6068179-42a8-4f98-9631-4748ff7f7ca8 service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] No waiting events found dispatching network-vif-unplugged-8a95ff1b-0686-455d-977c-cedac8be3930 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:04:03 user nova-compute[72809]: WARNING nova.compute.manager [req-0ef5de21-26c5-4d52-95d8-2ab3be142f76 req-f6068179-42a8-4f98-9631-4748ff7f7ca8 service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Received unexpected event network-vif-unplugged-8a95ff1b-0686-455d-977c-cedac8be3930 for instance with vm_state rescued and task_state unrescuing.
Aug 09 07:04:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:03 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Instance destroyed successfully.
Aug 09 07:04:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:05 user nova-compute[72809]: DEBUG nova.compute.manager [req-a250705e-52fe-4c6a-9481-c2649874c75d req-6d6c12ce-3eec-46c7-b6a1-8847c740ecd9 service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Received event network-vif-plugged-8a95ff1b-0686-455d-977c-cedac8be3930 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:04:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a250705e-52fe-4c6a-9481-c2649874c75d req-6d6c12ce-3eec-46c7-b6a1-8847c740ecd9 service nova] Acquiring lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:04:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a250705e-52fe-4c6a-9481-c2649874c75d req-6d6c12ce-3eec-46c7-b6a1-8847c740ecd9 service nova] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:04:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a250705e-52fe-4c6a-9481-c2649874c75d req-6d6c12ce-3eec-46c7-b6a1-8847c740ecd9 service nova] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:04:05 user nova-compute[72809]: DEBUG nova.compute.manager [req-a250705e-52fe-4c6a-9481-c2649874c75d req-6d6c12ce-3eec-46c7-b6a1-8847c740ecd9 service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] No waiting events found dispatching network-vif-plugged-8a95ff1b-0686-455d-977c-cedac8be3930 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:04:05 user nova-compute[72809]: WARNING nova.compute.manager [req-a250705e-52fe-4c6a-9481-c2649874c75d req-6d6c12ce-3eec-46c7-b6a1-8847c740ecd9 service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Received unexpected event network-vif-plugged-8a95ff1b-0686-455d-977c-cedac8be3930 for instance with vm_state rescued and task_state unrescuing.
Aug 09 07:04:05 user nova-compute[72809]: DEBUG nova.compute.manager [req-a250705e-52fe-4c6a-9481-c2649874c75d req-6d6c12ce-3eec-46c7-b6a1-8847c740ecd9 service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Received event network-vif-plugged-8a95ff1b-0686-455d-977c-cedac8be3930 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:04:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a250705e-52fe-4c6a-9481-c2649874c75d req-6d6c12ce-3eec-46c7-b6a1-8847c740ecd9 service nova] Acquiring lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:04:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a250705e-52fe-4c6a-9481-c2649874c75d req-6d6c12ce-3eec-46c7-b6a1-8847c740ecd9 service nova] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:04:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a250705e-52fe-4c6a-9481-c2649874c75d req-6d6c12ce-3eec-46c7-b6a1-8847c740ecd9 service nova] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:04:05 user nova-compute[72809]: DEBUG nova.compute.manager [req-a250705e-52fe-4c6a-9481-c2649874c75d req-6d6c12ce-3eec-46c7-b6a1-8847c740ecd9 service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] No waiting events found dispatching network-vif-plugged-8a95ff1b-0686-455d-977c-cedac8be3930 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:04:05 user nova-compute[72809]: WARNING nova.compute.manager [req-a250705e-52fe-4c6a-9481-c2649874c75d req-6d6c12ce-3eec-46c7-b6a1-8847c740ecd9 service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Received unexpected event network-vif-plugged-8a95ff1b-0686-455d-977c-cedac8be3930 for instance with vm_state rescued and task_state unrescuing.
Aug 09 07:04:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquiring lock "59d67126-7529-408e-a2ae-39c6bc152769" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:04:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "59d67126-7529-408e-a2ae-39c6bc152769" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:04:06 user nova-compute[72809]: INFO nova.compute.manager [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Detaching volume 05c57159-a986-4730-b056-eb8abd6a4594
Aug 09 07:04:06 user nova-compute[72809]: INFO nova.virt.block_device [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Attempting to driver detach volume 05c57159-a986-4730-b056-eb8abd6a4594 from mountpoint /dev/vdb
Aug 09 07:04:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Attempting to detach device vdb from instance 59d67126-7529-408e-a2ae-39c6bc152769 from the persistent domain config. {{(pid=72809) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 07:04:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:04:06 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:04:06 user nova-compute[72809]:   <source dev="/dev/sdd"/>
Aug 09 07:04:06 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:04:06 user nova-compute[72809]:   <serial>05c57159-a986-4730-b056-eb8abd6a4594</serial>
Aug 09 07:04:06 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 07:04:06 user nova-compute[72809]: </disk>
Aug 09 07:04:06 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:04:06 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Successfully detached device vdb from instance 59d67126-7529-408e-a2ae-39c6bc152769 from the persistent domain config.
Aug 09 07:04:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 59d67126-7529-408e-a2ae-39c6bc152769 from the live domain config. {{(pid=72809) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 07:04:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:04:06 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:04:06 user nova-compute[72809]:   <source dev="/dev/sdd"/>
Aug 09 07:04:06 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:04:06 user nova-compute[72809]:   <serial>05c57159-a986-4730-b056-eb8abd6a4594</serial>
Aug 09 07:04:06 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 07:04:06 user nova-compute[72809]: </disk>
Aug 09 07:04:06 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:04:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquiring lock "59d67126-7529-408e-a2ae-39c6bc152769" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:04:06 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Received event <DeviceRemovedEvent: 1691564647.2117357, 59d67126-7529-408e-a2ae-39c6bc152769 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72809) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 59d67126-7529-408e-a2ae-39c6bc152769 {{(pid=72809) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 07:04:07 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Successfully detached device vdb from instance 59d67126-7529-408e-a2ae-39c6bc152769 from the live domain config.
Aug 09 07:04:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EVZgdbWU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:04:07 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:04:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9bda44-0718-4bca-aca5-faeb50a4ec1b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Removed pending event for 466a8e58-5f88-4ffe-a7fd-a346003f3508 due to event {{(pid=72809) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564647.2843146, 466a8e58-5f88-4ffe-a7fd-a346003f3508 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:04:07 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] VM Resumed (Lifecycle Event)
Aug 09 07:04:07 user nova-compute[72809]: DEBUG nova.compute.manager [None req-d0de52fd-791b-4015-b222-dd8303de584b tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1b2a84-2a7a-47d4-907a-211780c34f8a]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:04:07 user nova-compute[72809]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:04:07 user nova-compute[72809]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594 (non-flash)
Aug 09 07:04:07 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:04:07 user nova-compute[72809]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:04:07 user nova-compute[72809]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594 (non-flash)
Aug 09 07:04:07 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc15864f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594'): ({'sdd'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Removing single pathed devices sdd {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[462b2bb6-d8a6-4f41-9bec-1336a8366ab0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:07 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 07:04:07 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564647.2881446, 466a8e58-5f88-4ffe-a7fd-a346003f3508 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:04:07 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] VM Started (Lifecycle Event)
Aug 09 07:04:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d56b95-7630-471e-86a0-47734a84c338]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Flushing IO for device /dev/sdd {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a6dea3-e51c-4fd5-bfbc-dc418c1c7bb3]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec74158-79c0-4cc2-a5b8-9ccda4a8c7b4]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] SCSI volumes sdd have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e933284f-029f-4e65-8a1b-fa92ed87c580]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594 -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3d7c8d-1b92-4cef-9fbb-e81f0c19b6da]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594, portal: 172.16.0.220,3260]
Aug 09 07:04:07 user nova-compute[72809]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594, portal: 172.16.0.220,3260] successful.
Aug 09 07:04:07 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594 -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-38f854a2-77f4-4cb5-9f30-945101d78ddb req-7702dd7e-659a-482b-a77b-ee28d05d34f0 service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Received event network-vif-plugged-8a95ff1b-0686-455d-977c-cedac8be3930 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-38f854a2-77f4-4cb5-9f30-945101d78ddb req-7702dd7e-659a-482b-a77b-ee28d05d34f0 service nova] Acquiring lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-38f854a2-77f4-4cb5-9f30-945101d78ddb req-7702dd7e-659a-482b-a77b-ee28d05d34f0 service nova] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-38f854a2-77f4-4cb5-9f30-945101d78ddb req-7702dd7e-659a-482b-a77b-ee28d05d34f0 service nova] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-38f854a2-77f4-4cb5-9f30-945101d78ddb req-7702dd7e-659a-482b-a77b-ee28d05d34f0 service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] No waiting events found dispatching network-vif-plugged-8a95ff1b-0686-455d-977c-cedac8be3930 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:04:07 user nova-compute[72809]: WARNING nova.compute.manager [req-38f854a2-77f4-4cb5-9f30-945101d78ddb req-7702dd7e-659a-482b-a77b-ee28d05d34f0 service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Received unexpected event network-vif-plugged-8a95ff1b-0686-455d-977c-cedac8be3930 for instance with vm_state active and task_state None.
Aug 09 07:04:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[34125298-afd5-4f4c-b05a-d99ae2f973d7]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] <== disconnect_volume: return (338ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:04:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KRQVJTPg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:04:08 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:04:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:04:08 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:04:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:04:08 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9082cf-28ab-4678-85d2-89d763452b8d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 07:04:08 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[72be23fc-c043-44d1-9eb2-11b6718bd8a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e] added
Aug 09 07:04:08 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3d4f32-79f4-4913-a941-116686ee5bb5]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78c5fc7-1ad9-4ec1-82fa-dcdd02f3d626]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KRQVJTPg {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KRQVJTPg" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7639d4-a89d-4339-bf73-bd99c87f73f3]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KRQVJTPg'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2749bd-c28d-47d0-a0ec-752d260488ba]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee12bb4-f78d-4336-991a-6e2bc897c0a1]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:04:08 user nova-compute[72809]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:04:08 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:04:08 user nova-compute[72809]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:04:08 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0f8581-ff03-4c5d-a002-bfba2d890021]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e, portal: 172.16.0.220,3260]
Aug 09 07:04:08 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e, portal: 172.16.0.220,3260] successful.
Aug 09 07:04:08 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3e334d-82a2-4f70-b60d-eb456f5b9e31]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31fe436-8cab-4d11-ba82-59d4eeb8e07d]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:04:08 user nova-compute[72809]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:04:08 user nova-compute[72809]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e (non-flash)
Aug 09 07:04:08 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:04:08 user nova-compute[72809]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:04:08 user nova-compute[72809]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e (non-flash)
Aug 09 07:04:08 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fa0e8d-a992-4279-899a-b683e9812450]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: None {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG nova.objects.instance [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lazy-loading 'flavor' on Instance uuid 59d67126-7529-408e-a2ae-39c6bc152769 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d020628f-9edb-4c65-8ae3-8005db32bea0 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "59d67126-7529-408e-a2ae-39c6bc152769" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "59d67126-7529-408e-a2ae-39c6bc152769" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.874s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquiring lock "59d67126-7529-408e-a2ae-39c6bc152769-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "59d67126-7529-408e-a2ae-39c6bc152769-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "59d67126-7529-408e-a2ae-39c6bc152769-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:04:08 user nova-compute[72809]: INFO nova.compute.manager [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Terminating instance
Aug 09 07:04:08 user nova-compute[72809]: DEBUG nova.compute.manager [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:09 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Instance destroyed successfully.
Aug 09 07:04:09 user nova-compute[72809]: DEBUG nova.objects.instance [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lazy-loading 'resources' on Instance uuid 59d67126-7529-408e-a2ae-39c6bc152769 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:01:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-89747799',display_name='tempest-VolumesSnapshotTestJSON-instance-89747799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-89747799',id=31,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZH2CwceOe6rWWo2O1xhwSuA65LMVN81uz4lh/eV5yfcPZqrgGPT1+gGjIwXPaSeQaxCRd85HmCphgLwVquH8tNSFMgbnYW9VDJ7VLOi7yJ3nnAKH9Kd9Vc4vDnbVs6CA==',key_name='tempest-keypair-733064279',keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:01:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f76e442312164689bdd7686973d25eda',ramdisk_id='',reservation_id='r-k13a0vz6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1130129930',owner_user_name='tempest-VolumesSnapshotTestJSON-1130129930-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9b206fdca44420984d9c279db01ef1b',uuid=59d67126-7529-408e-a2ae-39c6bc152769,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7", "address": "fa:16:3e:51:e3:e8", "network": {"id": "ae760578-06b0-479a-9f75-b5e781b1a087", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-541750148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76e442312164689bdd7686973d25eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1962ff5-8d", "ovs_interfaceid": "d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Converting VIF {"id": "d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7", "address": "fa:16:3e:51:e3:e8", "network": {"id": "ae760578-06b0-479a-9f75-b5e781b1a087", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-541750148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76e442312164689bdd7686973d25eda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1962ff5-8d", "ovs_interfaceid": "d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:e3:e8,bridge_name='br-int',has_traffic_filtering=True,id=d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7,network=Network(ae760578-06b0-479a-9f75-b5e781b1a087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1962ff5-8d') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG os_vif [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:e3:e8,bridge_name='br-int',has_traffic_filtering=True,id=d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7,network=Network(ae760578-06b0-479a-9f75-b5e781b1a087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1962ff5-8d') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1962ff5-8d, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KRQVJTPg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23365616632343735', 'path': '/dev/sdd'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365616632343735', 'path': '/dev/sdd'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:04:09 user nova-compute[72809]: INFO os_vif [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:e3:e8,bridge_name='br-int',has_traffic_filtering=True,id=d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7,network=Network(ae760578-06b0-479a-9f75-b5e781b1a087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1962ff5-8d')
Aug 09 07:04:09 user nova-compute[72809]: DEBUG nova.objects.instance [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lazy-loading 'flavor' on Instance uuid b5cab676-b3c0-4f05-9e44-42e5a6677857 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EVZgdbWU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:04:09 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:04:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05c57159-a986-4730-b056-eb8abd6a4594', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c349d419-f136-4b98-aabe-e58f93f5cc5a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 07:04:09 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:04:09 user nova-compute[72809]:   <source dev="/dev/sdd"/>
Aug 09 07:04:09 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:04:09 user nova-compute[72809]:   <serial>d89ab0d3-ce90-485a-82d8-7ccd1a77c43e</serial>
Aug 09 07:04:09 user nova-compute[72809]: </disk>
Aug 09 07:04:09 user nova-compute[72809]:  {{(pid=72809) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e151f2-b4ea-424f-a3c8-d432a1c7923f]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:04:09 user nova-compute[72809]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:04:09 user nova-compute[72809]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e (non-flash)
Aug 09 07:04:09 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:04:09 user nova-compute[72809]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:04:09 user nova-compute[72809]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e (non-flash)
Aug 09 07:04:09 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc158328c10>, {}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Disconnecting from: [] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.051s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] <== disconnect_volume: return (53ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:04:09 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Deleting instance files /opt/stack/data/nova/instances/59d67126-7529-408e-a2ae-39c6bc152769_del
Aug 09 07:04:09 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Deletion of /opt/stack/data/nova/instances/59d67126-7529-408e-a2ae-39c6bc152769_del complete
Aug 09 07:04:09 user nova-compute[72809]: INFO nova.compute.manager [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 09 07:04:09 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG nova.compute.manager [req-1bcb72d5-7f60-45c7-b739-d997bc6eaf82 req-d5e05e48-7e19-437c-ba88-287a39ff5779 service nova] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Received event network-vif-unplugged-d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1bcb72d5-7f60-45c7-b739-d997bc6eaf82 req-d5e05e48-7e19-437c-ba88-287a39ff5779 service nova] Acquiring lock "59d67126-7529-408e-a2ae-39c6bc152769-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1bcb72d5-7f60-45c7-b739-d997bc6eaf82 req-d5e05e48-7e19-437c-ba88-287a39ff5779 service nova] Lock "59d67126-7529-408e-a2ae-39c6bc152769-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1bcb72d5-7f60-45c7-b739-d997bc6eaf82 req-d5e05e48-7e19-437c-ba88-287a39ff5779 service nova] Lock "59d67126-7529-408e-a2ae-39c6bc152769-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG nova.compute.manager [req-1bcb72d5-7f60-45c7-b739-d997bc6eaf82 req-d5e05e48-7e19-437c-ba88-287a39ff5779 service nova] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] No waiting events found dispatching network-vif-unplugged-d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG nova.compute.manager [req-1bcb72d5-7f60-45c7-b739-d997bc6eaf82 req-d5e05e48-7e19-437c-ba88-287a39ff5779 service nova] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Received event network-vif-unplugged-d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG nova.compute.manager [req-1bcb72d5-7f60-45c7-b739-d997bc6eaf82 req-d5e05e48-7e19-437c-ba88-287a39ff5779 service nova] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Received event network-vif-plugged-d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1bcb72d5-7f60-45c7-b739-d997bc6eaf82 req-d5e05e48-7e19-437c-ba88-287a39ff5779 service nova] Acquiring lock "59d67126-7529-408e-a2ae-39c6bc152769-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1bcb72d5-7f60-45c7-b739-d997bc6eaf82 req-d5e05e48-7e19-437c-ba88-287a39ff5779 service nova] Lock "59d67126-7529-408e-a2ae-39c6bc152769-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1bcb72d5-7f60-45c7-b739-d997bc6eaf82 req-d5e05e48-7e19-437c-ba88-287a39ff5779 service nova] Lock "59d67126-7529-408e-a2ae-39c6bc152769-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:04:09 user nova-compute[72809]: DEBUG nova.compute.manager [req-1bcb72d5-7f60-45c7-b739-d997bc6eaf82 req-d5e05e48-7e19-437c-ba88-287a39ff5779 service nova] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] No waiting events found dispatching network-vif-plugged-d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:04:09 user nova-compute[72809]: WARNING nova.compute.manager [req-1bcb72d5-7f60-45c7-b739-d997bc6eaf82 req-d5e05e48-7e19-437c-ba88-287a39ff5779 service nova] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Received unexpected event network-vif-plugged-d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7 for instance with vm_state active and task_state deleting.
Aug 09 07:04:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:04:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:04:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] No VIF found with MAC fa:16:3e:5f:ac:5e, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:04:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4d447862-72f7-480a-be32-e1752b4791b6 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "b5cab676-b3c0-4f05-9e44-42e5a6677857" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.402s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:04:10 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:04:10 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Took 0.99 seconds to deallocate network for instance.
Aug 09 07:04:10 user nova-compute[72809]: DEBUG nova.compute.manager [req-89a54971-887e-4d46-8bef-3478e881cdc0 req-eb414d2f-5dd3-4a12-a0aa-089446ebccd4 service nova] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Received event network-vif-deleted-d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:04:10 user nova-compute[72809]: INFO nova.compute.manager [req-89a54971-887e-4d46-8bef-3478e881cdc0 req-eb414d2f-5dd3-4a12-a0aa-089446ebccd4 service nova] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Neutron deleted interface d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7; detaching it from the instance and deleting it from the info cache
Aug 09 07:04:10 user nova-compute[72809]: DEBUG nova.network.neutron [req-89a54971-887e-4d46-8bef-3478e881cdc0 req-eb414d2f-5dd3-4a12-a0aa-089446ebccd4 service nova] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:04:10 user nova-compute[72809]: WARNING nova.volume.cinder [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Attachment ec4ddaa6-7325-4b4b-8055-013bb8bde714 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = ec4ddaa6-7325-4b4b-8055-013bb8bde714. (HTTP 404) (Request-ID: req-dc9bece3-f565-4e7f-9007-06905902b1ca)
Aug 09 07:04:10 user nova-compute[72809]: INFO nova.compute.manager [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Took 0.02 seconds to detach 1 volumes for instance.
Aug 09 07:04:10 user nova-compute[72809]: DEBUG nova.compute.manager [req-89a54971-887e-4d46-8bef-3478e881cdc0 req-eb414d2f-5dd3-4a12-a0aa-089446ebccd4 service nova] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Detach interface failed, port_id=d1962ff5-8d61-49d1-94d4-f3e3f1b33bd7, reason: Instance 59d67126-7529-408e-a2ae-39c6bc152769 could not be found. {{(pid=72809) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 07:04:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:04:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:04:10 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "b5cab676-b3c0-4f05-9e44-42e5a6677857" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "b5cab676-b3c0-4f05-9e44-42e5a6677857" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:04:11 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Deleted allocations for instance 59d67126-7529-408e-a2ae-39c6bc152769
Aug 09 07:04:11 user nova-compute[72809]: INFO nova.compute.manager [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Detaching volume d89ab0d3-ce90-485a-82d8-7ccd1a77c43e
Aug 09 07:04:11 user nova-compute[72809]: INFO nova.virt.block_device [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Attempting to driver detach volume d89ab0d3-ce90-485a-82d8-7ccd1a77c43e from mountpoint /dev/vdb
Aug 09 07:04:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-929cb575-54dd-4494-8158-b7c175189646 tempest-VolumesSnapshotTestJSON-1130129930 tempest-VolumesSnapshotTestJSON-1130129930-project-member] Lock "59d67126-7529-408e-a2ae-39c6bc152769" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.661s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Attempting to detach device vdb from instance b5cab676-b3c0-4f05-9e44-42e5a6677857 from the persistent domain config. {{(pid=72809) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:04:11 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:04:11 user nova-compute[72809]:   <source dev="/dev/sdd"/>
Aug 09 07:04:11 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:04:11 user nova-compute[72809]:   <serial>d89ab0d3-ce90-485a-82d8-7ccd1a77c43e</serial>
Aug 09 07:04:11 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 07:04:11 user nova-compute[72809]: </disk>
Aug 09 07:04:11 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:04:11 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Successfully detached device vdb from instance b5cab676-b3c0-4f05-9e44-42e5a6677857 from the persistent domain config.
Aug 09 07:04:11 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b5cab676-b3c0-4f05-9e44-42e5a6677857 from the live domain config. {{(pid=72809) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:04:11 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:04:11 user nova-compute[72809]:   <source dev="/dev/sdd"/>
Aug 09 07:04:11 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:04:11 user nova-compute[72809]:   <serial>d89ab0d3-ce90-485a-82d8-7ccd1a77c43e</serial>
Aug 09 07:04:11 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 07:04:11 user nova-compute[72809]: </disk>
Aug 09 07:04:11 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Received event <DeviceRemovedEvent: 1691564651.6790504, b5cab676-b3c0-4f05-9e44-42e5a6677857 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72809) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b5cab676-b3c0-4f05-9e44-42e5a6677857 {{(pid=72809) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 07:04:11 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Successfully detached device vdb from instance b5cab676-b3c0-4f05-9e44-42e5a6677857 from the live domain config.
Aug 09 07:04:11 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KRQVJTPg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:04:11 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:04:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf1a01c-ee89-486f-b94b-3d35e79847e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0dd471-e13c-4f2b-a66f-bb1c748a6c02]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:04:11 user nova-compute[72809]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:04:11 user nova-compute[72809]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e (non-flash)
Aug 09 07:04:11 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:04:11 user nova-compute[72809]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:04:11 user nova-compute[72809]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e (non-flash)
Aug 09 07:04:11 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc15864f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e'): ({'sdd'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Removing single pathed devices sdd {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac0845d-9b4e-4bc9-9041-aac442ddec1f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce65edc-8c12-4505-96af-fa242b8c7679]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Flushing IO for device /dev/sdd {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7629b7-945b-472f-94be-d950779cfed5]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[030e761d-4d71-40b2-8b88-a268a7572304]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] SCSI volumes sdd have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf371fb-5819-4a77-b9ff-f897ac1e2f27]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[45058cb4-2ffe-4b6e-b7d6-ed1d9b73f2bc]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e, portal: 172.16.0.220,3260]
Aug 09 07:04:11 user nova-compute[72809]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e, portal: 172.16.0.220,3260] successful.
Aug 09 07:04:11 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89ab0d3-ce90-485a-82d8-7ccd1a77c43e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b50ed96-eaa8-47de-9814-756e546fee0c]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] <== disconnect_volume: return (270ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:04:11 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:04:12 user nova-compute[72809]: DEBUG nova.objects.instance [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lazy-loading 'flavor' on Instance uuid b5cab676-b3c0-4f05-9e44-42e5a6677857 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:04:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2dceedfc-868a-4b6a-b6dc-284dccf6a0b7 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "b5cab676-b3c0-4f05-9e44-42e5a6677857" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.655s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:04:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:04:21 user nova-compute[72809]: DEBUG nova.compute.manager [req-73c01446-91a6-422c-99e9-2459f3fc6ccd req-b106e66a-830f-4476-9634-ecb437280319 service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Received event network-changed-8ac68313-9d94-449d-87e1-9fb135c7bab5 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:04:21 user nova-compute[72809]: DEBUG nova.compute.manager [req-73c01446-91a6-422c-99e9-2459f3fc6ccd req-b106e66a-830f-4476-9634-ecb437280319 service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Refreshing instance network info cache due to event network-changed-8ac68313-9d94-449d-87e1-9fb135c7bab5. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:04:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-73c01446-91a6-422c-99e9-2459f3fc6ccd req-b106e66a-830f-4476-9634-ecb437280319 service nova] Acquiring lock "refresh_cache-336770eb-4f09-4134-92ef-f96039bf4fa9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:04:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-73c01446-91a6-422c-99e9-2459f3fc6ccd req-b106e66a-830f-4476-9634-ecb437280319 service nova] Acquired lock "refresh_cache-336770eb-4f09-4134-92ef-f96039bf4fa9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:04:21 user nova-compute[72809]: DEBUG nova.network.neutron [req-73c01446-91a6-422c-99e9-2459f3fc6ccd req-b106e66a-830f-4476-9634-ecb437280319 service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Refreshing network info cache for port 8ac68313-9d94-449d-87e1-9fb135c7bab5 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:04:22 user nova-compute[72809]: DEBUG nova.network.neutron [req-73c01446-91a6-422c-99e9-2459f3fc6ccd req-b106e66a-830f-4476-9634-ecb437280319 service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Updated VIF entry in instance network info cache for port 8ac68313-9d94-449d-87e1-9fb135c7bab5. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:04:22 user nova-compute[72809]: DEBUG nova.network.neutron [req-73c01446-91a6-422c-99e9-2459f3fc6ccd req-b106e66a-830f-4476-9634-ecb437280319 service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Updating instance_info_cache with network_info: [{"id": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "address": "fa:16:3e:b9:56:8d", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac68313-9d", "ovs_interfaceid": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:04:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-73c01446-91a6-422c-99e9-2459f3fc6ccd req-b106e66a-830f-4476-9634-ecb437280319 service nova] Releasing lock "refresh_cache-336770eb-4f09-4134-92ef-f96039bf4fa9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:04:23 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Stashing vm_state: active {{(pid=72809) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 09 07:04:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:04:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:04:23 user nova-compute[72809]: DEBUG nova.objects.instance [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lazy-loading 'pci_requests' on Instance uuid a754327a-9985-4430-af66-1d8bc82fb868 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:04:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 07:04:23 user nova-compute[72809]: INFO nova.compute.claims [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Claim successful on node user
Aug 09 07:04:23 user nova-compute[72809]: DEBUG nova.objects.instance [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lazy-loading 'resources' on Instance uuid a754327a-9985-4430-af66-1d8bc82fb868 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:04:23 user nova-compute[72809]: DEBUG nova.objects.instance [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lazy-loading 'pci_devices' on Instance uuid a754327a-9985-4430-af66-1d8bc82fb868 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:04:23 user nova-compute[72809]: INFO nova.compute.resource_tracker [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Updating resource usage from migration e576542e-d733-40bc-8749-08b38fac6842
Aug 09 07:04:23 user nova-compute[72809]: DEBUG nova.compute.manager [req-7c3cd439-90f4-4799-8ee1-dff70424f6bc req-c336dcd3-f0e8-40dc-acd4-4f47b0ab38db service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Received event network-changed-79d0335e-d56b-4916-9b58-c198843ed750 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:04:23 user nova-compute[72809]: DEBUG nova.compute.manager [req-7c3cd439-90f4-4799-8ee1-dff70424f6bc req-c336dcd3-f0e8-40dc-acd4-4f47b0ab38db service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Refreshing instance network info cache due to event network-changed-79d0335e-d56b-4916-9b58-c198843ed750. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:04:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7c3cd439-90f4-4799-8ee1-dff70424f6bc req-c336dcd3-f0e8-40dc-acd4-4f47b0ab38db service nova] Acquiring lock "refresh_cache-a754327a-9985-4430-af66-1d8bc82fb868" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:04:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7c3cd439-90f4-4799-8ee1-dff70424f6bc req-c336dcd3-f0e8-40dc-acd4-4f47b0ab38db service nova] Acquired lock "refresh_cache-a754327a-9985-4430-af66-1d8bc82fb868" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:04:23 user nova-compute[72809]: DEBUG nova.network.neutron [req-7c3cd439-90f4-4799-8ee1-dff70424f6bc req-c336dcd3-f0e8-40dc-acd4-4f47b0ab38db service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Refreshing network info cache for port 79d0335e-d56b-4916-9b58-c198843ed750 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:04:23 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:04:23 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:04:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.471s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:04:23 user nova-compute[72809]: INFO nova.compute.manager [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Migrating
Aug 09 07:04:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "refresh_cache-a754327a-9985-4430-af66-1d8bc82fb868" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:04:24 user nova-compute[72809]: DEBUG nova.network.neutron [req-7c3cd439-90f4-4799-8ee1-dff70424f6bc req-c336dcd3-f0e8-40dc-acd4-4f47b0ab38db service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Updated VIF entry in instance network info cache for port 79d0335e-d56b-4916-9b58-c198843ed750. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:04:24 user nova-compute[72809]: DEBUG nova.network.neutron [req-7c3cd439-90f4-4799-8ee1-dff70424f6bc req-c336dcd3-f0e8-40dc-acd4-4f47b0ab38db service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Updating instance_info_cache with network_info: [{"id": "79d0335e-d56b-4916-9b58-c198843ed750", "address": "fa:16:3e:d4:01:03", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d0335e-d5", "ovs_interfaceid": "79d0335e-d56b-4916-9b58-c198843ed750", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:04:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7c3cd439-90f4-4799-8ee1-dff70424f6bc req-c336dcd3-f0e8-40dc-acd4-4f47b0ab38db service nova] Releasing lock "refresh_cache-a754327a-9985-4430-af66-1d8bc82fb868" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:04:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquired lock "refresh_cache-a754327a-9985-4430-af66-1d8bc82fb868" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:04:24 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:04:24 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691564649.3391752, 59d67126-7529-408e-a2ae-39c6bc152769 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:04:24 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] VM Stopped (Lifecycle Event)
Aug 09 07:04:24 user nova-compute[72809]: DEBUG nova.compute.manager [None req-594f1880-9d38-41e2-9d00-484918c4c6fa None None] [instance: 59d67126-7529-408e-a2ae-39c6bc152769] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:04:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:24 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Updating instance_info_cache with network_info: [{"id": "79d0335e-d56b-4916-9b58-c198843ed750", "address": "fa:16:3e:d4:01:03", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d0335e-d5", "ovs_interfaceid": "79d0335e-d56b-4916-9b58-c198843ed750", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:04:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Releasing lock "refresh_cache-a754327a-9985-4430-af66-1d8bc82fb868" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:04:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Starting migrate_disk_and_power_off {{(pid=72809) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 09 07:04:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG nova.compute.manager [req-a1df6da8-ce8f-4f27-b969-6d5e714efcd7 req-c64db8cc-ee46-4da9-a9ea-75a485492b47 service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Received event network-vif-unplugged-79d0335e-d56b-4916-9b58-c198843ed750 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a1df6da8-ce8f-4f27-b969-6d5e714efcd7 req-c64db8cc-ee46-4da9-a9ea-75a485492b47 service nova] Acquiring lock "a754327a-9985-4430-af66-1d8bc82fb868-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a1df6da8-ce8f-4f27-b969-6d5e714efcd7 req-c64db8cc-ee46-4da9-a9ea-75a485492b47 service nova] Lock "a754327a-9985-4430-af66-1d8bc82fb868-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a1df6da8-ce8f-4f27-b969-6d5e714efcd7 req-c64db8cc-ee46-4da9-a9ea-75a485492b47 service nova] Lock "a754327a-9985-4430-af66-1d8bc82fb868-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG nova.compute.manager [req-a1df6da8-ce8f-4f27-b969-6d5e714efcd7 req-c64db8cc-ee46-4da9-a9ea-75a485492b47 service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] No waiting events found dispatching network-vif-unplugged-79d0335e-d56b-4916-9b58-c198843ed750 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:04:25 user nova-compute[72809]: WARNING nova.compute.manager [req-a1df6da8-ce8f-4f27-b969-6d5e714efcd7 req-c64db8cc-ee46-4da9-a9ea-75a485492b47 service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Received unexpected event network-vif-unplugged-79d0335e-d56b-4916-9b58-c198843ed750 for instance with vm_state active and task_state resize_migrating.
Aug 09 07:04:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:25 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Instance destroyed successfully.
Aug 09 07:04:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:02:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1201311549',display_name='tempest-ServerActionsTestOtherA-server-1201311549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1201311549',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCouL5r1ONNNh4MEm1cE7q85fOqyiHXG74zUMePb7Qx7FM94grlflWjrtC3jQ2LeCgVBOqUmmFTQqcvNJ0pbLdMAdhZ4dM0vJEiMtEgevMXZ2oGhFPDEpbVyaR20DJopHw==',key_name='tempest-keypair-888098152',keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:02:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6da97330281c4d0eba99e485db051973',ramdisk_id='',reservation_id='r-jua86bod',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-118844208',owner_user_name='tempest-ServerActionsTestOtherA-118844208-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:04:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10e067d2b5b7459cadf50b1ed89a8864',uuid=a754327a-9985-4430-af66-1d8bc82fb868,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79d0335e-d56b-4916-9b58-c198843ed750", "address": "fa:16:3e:d4:01:03", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-268127379-network", "vif_mac": "fa:16:3e:d4:01:03"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d0335e-d5", "ovs_interfaceid": "79d0335e-d56b-4916-9b58-c198843ed750", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Converting VIF {"id": "79d0335e-d56b-4916-9b58-c198843ed750", "address": "fa:16:3e:d4:01:03", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-268127379-network", "vif_mac": "fa:16:3e:d4:01:03"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d0335e-d5", "ovs_interfaceid": "79d0335e-d56b-4916-9b58-c198843ed750", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:01:03,bridge_name='br-int',has_traffic_filtering=True,id=79d0335e-d56b-4916-9b58-c198843ed750,network=Network(0e68e18b-480a-4b6c-b194-39ba1099a4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d0335e-d5') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG os_vif [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:01:03,bridge_name='br-int',has_traffic_filtering=True,id=79d0335e-d56b-4916-9b58-c198843ed750,network=Network(0e68e18b-480a-4b6c-b194-39ba1099a4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d0335e-d5') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79d0335e-d5, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:25 user nova-compute[72809]: INFO os_vif [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:01:03,bridge_name='br-int',has_traffic_filtering=True,id=79d0335e-d56b-4916-9b58-c198843ed750,network=Network(0e68e18b-480a-4b6c-b194-39ba1099a4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d0335e-d5')
Aug 09 07:04:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YNXuUTFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:04:25 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:04:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6559c60b-73fb-4e41-8240-7d56ca427041]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee48bb9-be61-49bb-a952-49da81577337]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:04:25 user nova-compute[72809]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:04:25 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:04:25 user nova-compute[72809]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:04:25 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc15864dfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059'): ({'sdc'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Removing single pathed devices sdc {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a1eeea-7e22-45ba-a33f-c31679ad0191]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f385cc91-98f8-4367-9a95-494ee808c82c]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Flushing IO for device /dev/sdc {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4946944-4bc0-4b32-ae67-4d9e91835beb]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e20979-4b77-47c3-bf07-484c656b9261]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] SCSI volumes sdc have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_5f2d33e8', '/dev/disk/by-id/scsi-23130313138663865', '/dev/disk/by-id/scsi-1SCST_BIO5f2d33e8-10118f8ebf507a12') {{(pid=83900) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[454b2a1a-176e-4c4f-add8-4940aa7afc62]: (4, None) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c04aa3-c340-4684-9a9d-9ea87ccc6bf6]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62b5dba-b1a4-4c17-928b-5cbc62a1baf2]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059, portal: 172.16.0.220,3260]
Aug 09 07:04:25 user nova-compute[72809]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059, portal: 172.16.0.220,3260] successful.
Aug 09 07:04:25 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cf7974-b6f3-4d2a-8f48-6dee786db779]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] <== disconnect_volume: return (290ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:04:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:04:26 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Port 79d0335e-d56b-4916-9b58-c198843ed750 binding to destination host user is already ACTIVE {{(pid=72809) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 09 07:04:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "a754327a-9985-4430-af66-1d8bc82fb868-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:04:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "a754327a-9985-4430-af66-1d8bc82fb868-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:04:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "a754327a-9985-4430-af66-1d8bc82fb868-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:04:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "refresh_cache-a754327a-9985-4430-af66-1d8bc82fb868" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:04:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquired lock "refresh_cache-a754327a-9985-4430-af66-1d8bc82fb868" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:04:26 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:04:27 user nova-compute[72809]: DEBUG nova.compute.manager [req-96d22aee-4fd2-469a-936b-a16a54f0fecf req-5ecd3319-1fbe-448c-a6c0-66e1081bca01 service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Received event network-vif-plugged-79d0335e-d56b-4916-9b58-c198843ed750 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:04:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-96d22aee-4fd2-469a-936b-a16a54f0fecf req-5ecd3319-1fbe-448c-a6c0-66e1081bca01 service nova] Acquiring lock "a754327a-9985-4430-af66-1d8bc82fb868-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:04:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-96d22aee-4fd2-469a-936b-a16a54f0fecf req-5ecd3319-1fbe-448c-a6c0-66e1081bca01 service nova] Lock "a754327a-9985-4430-af66-1d8bc82fb868-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:04:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-96d22aee-4fd2-469a-936b-a16a54f0fecf req-5ecd3319-1fbe-448c-a6c0-66e1081bca01 service nova] Lock "a754327a-9985-4430-af66-1d8bc82fb868-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:04:27 user nova-compute[72809]: DEBUG nova.compute.manager [req-96d22aee-4fd2-469a-936b-a16a54f0fecf req-5ecd3319-1fbe-448c-a6c0-66e1081bca01 service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] No waiting events found dispatching network-vif-plugged-79d0335e-d56b-4916-9b58-c198843ed750 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:04:27 user nova-compute[72809]: WARNING nova.compute.manager [req-96d22aee-4fd2-469a-936b-a16a54f0fecf req-5ecd3319-1fbe-448c-a6c0-66e1081bca01 service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Received unexpected event network-vif-plugged-79d0335e-d56b-4916-9b58-c198843ed750 for instance with vm_state active and task_state resize_migrated.
Aug 09 07:04:27 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Updating instance_info_cache with network_info: [{"id": "79d0335e-d56b-4916-9b58-c198843ed750", "address": "fa:16:3e:d4:01:03", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d0335e-d5", "ovs_interfaceid": "79d0335e-d56b-4916-9b58-c198843ed750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:04:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Releasing lock "refresh_cache-a754327a-9985-4430-af66-1d8bc82fb868" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:04:27 user nova-compute[72809]: DEBUG os_brick.utils [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:04:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:27 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c82df4-57ce-424b-97a8-777d38988388]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:27 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56b5f85-b889-4e35-92b3-5812ad47368d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:27 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a381d6-190a-4d82-9a21-ef0fa7d1b23e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:27 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe984f3-e3a7-4893-8055-70a0c327db20]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:04:27 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 07:04:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:04:27 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 07:04:27 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[551a2762-7e86-4c83-8a11-2ac19367747d]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:27 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 07:04:27 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 07:04:27 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 07:04:27 user nova-compute[72809]: DEBUG os_brick.utils [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:04:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:33 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:04:33 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 07:04:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-339372ed-140d-4226-ba00-2cc682214d5c" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:04:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-339372ed-140d-4226-ba00-2cc682214d5c" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:04:33 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 07:04:34 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Updating instance_info_cache with network_info: [{"id": "b50b65dc-a03d-4f22-bb35-f2b9dc67596d", "address": "fa:16:3e:67:6b:ac", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50b65dc-a0", "ovs_interfaceid": "b50b65dc-a03d-4f22-bb35-f2b9dc67596d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:04:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-339372ed-140d-4226-ba00-2cc682214d5c" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:04:34 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 07:04:35 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Starting finish_migration {{(pid=72809) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Instance directory exists: not creating {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 07:04:36 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Creating image(s)
Aug 09 07:04:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Did not create local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Ensure instance console log exists: /opt/stack/data/nova/instances/a754327a-9985-4430-af66-1d8bc82fb868/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Start _get_guest_xml network_info=[{"id": "79d0335e-d56b-4916-9b58-c198843ed750", "address": "fa:16:3e:d4:01:03", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-268127379-network", "vif_mac": "fa:16:3e:d4:01:03"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d0335e-d5", "ovs_interfaceid": "79d0335e-d56b-4916-9b58-c198843ed750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YNXuUTFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a754327a-9985-4430-af66-1d8bc82fb868', 'attached_at': '2023-08-09T07:04:36.000000', 'detached_at': '', 'volume_id': 'f1cadbe9-56c6-4639-a5d6-898730c79059', 'serial': 'f1cadbe9-56c6-4639-a5d6-898730c79059'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'boot_index': 0, 'attachment_id': '0be88068-ea34-4f61-8894-c381bf6f30b9', 'volume_type': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 07:04:36 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:04:36 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:04:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG nova.objects.instance [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lazy-loading 'vcpu_model' on Instance uuid a754327a-9985-4430-af66-1d8bc82fb868 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YNXuUTFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:04:36 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:04:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:04:36 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:04:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:04:36 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f89b62-4654-4ff7-9de8-41646324cbaf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 07:04:36 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[54547013-88c3-4631-b3dd-a34050e4332a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059] added
Aug 09 07:04:36 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ae5ee4-76bd-4f91-9fd5-ba4618a70241]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c950ecd-4cc9-4376-adea-b26de13c87a6]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YNXuUTFt {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YNXuUTFt" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ad5448-072a-4048-b67e-eacfcc0bb5ce]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YNXuUTFt'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[8955fec4-1211-411d-abab-c0fa6abe698f]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff66576e-3116-477f-aa9b-8d2e701706d6]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:04:36 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:04:36 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b22a8f-ec40-4a94-825f-ea8bd3b4c24e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059, portal: 172.16.0.220,3260]
Aug 09 07:04:36 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059, portal: 172.16.0.220,3260] successful.
Aug 09 07:04:36 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[47531246-2127-43a4-8937-83c0a3271591]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ade39fd-ef27-45a0-9681-fae700f3407c]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:04:36 user nova-compute[72809]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:04:36 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:04:36 user nova-compute[72809]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:04:36 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d72e375-dcde-4ba4-89e1-e85d1ba4ee18]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:04:36 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: None {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:04:37 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:04:37 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YNXuUTFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 07:04:37 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:04:37 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23130313138663865', 'path': '/dev/sdc'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:04:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130313138663865', 'path': '/dev/sdc'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 07:04:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:02:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1201311549',display_name='tempest-ServerActionsTestOtherA-server-1201311549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1201311549',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCouL5r1ONNNh4MEm1cE7q85fOqyiHXG74zUMePb7Qx7FM94grlflWjrtC3jQ2LeCgVBOqUmmFTQqcvNJ0pbLdMAdhZ4dM0vJEiMtEgevMXZ2oGhFPDEpbVyaR20DJopHw==',key_name='tempest-keypair-888098152',keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:02:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6da97330281c4d0eba99e485db051973',ramdisk_id='',reservation_id='r-jua86bod',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-118844208',owner_user_name='tempest-ServerActionsTestOtherA-118844208-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:04:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10e067d2b5b7459cadf50b1ed89a8864',uuid=a754327a-9985-4430-af66-1d8bc82fb868,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79d0335e-d56b-4916-9b58-c198843ed750", "address": "fa:16:3e:d4:01:03", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-268127379-network", "vif_mac": "fa:16:3e:d4:01:03"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d0335e-d5", "ovs_interfaceid": "79d0335e-d56b-4916-9b58-c198843ed750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 07:04:37 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Converting VIF {"id": "79d0335e-d56b-4916-9b58-c198843ed750", "address": "fa:16:3e:d4:01:03", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-268127379-network", "vif_mac": "fa:16:3e:d4:01:03"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d0335e-d5", "ovs_interfaceid": "79d0335e-d56b-4916-9b58-c198843ed750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:04:37 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:01:03,bridge_name='br-int',has_traffic_filtering=True,id=79d0335e-d56b-4916-9b58-c198843ed750,network=Network(0e68e18b-480a-4b6c-b194-39ba1099a4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d0335e-d5') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:04:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] End _get_guest_xml xml=<domain type="kvm">
Aug 09 07:04:37 user nova-compute[72809]:   <uuid>a754327a-9985-4430-af66-1d8bc82fb868</uuid>
Aug 09 07:04:37 user nova-compute[72809]:   <name>instance-00000021</name>
Aug 09 07:04:37 user nova-compute[72809]:   <memory>2097152</memory>
Aug 09 07:04:37 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 07:04:37 user nova-compute[72809]:   <metadata>
Aug 09 07:04:37 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 07:04:37 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 07:04:37 user nova-compute[72809]:       <nova:name>tempest-ServerActionsTestOtherA-server-1201311549</nova:name>
Aug 09 07:04:37 user nova-compute[72809]:       <nova:creationTime>2023-08-09 07:04:36</nova:creationTime>
Aug 09 07:04:37 user nova-compute[72809]:       <nova:flavor name="m1.small">
Aug 09 07:04:37 user nova-compute[72809]:         <nova:memory>2048</nova:memory>
Aug 09 07:04:37 user nova-compute[72809]:         <nova:disk>20</nova:disk>
Aug 09 07:04:37 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 07:04:37 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 07:04:37 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 07:04:37 user nova-compute[72809]:       </nova:flavor>
Aug 09 07:04:37 user nova-compute[72809]:       <nova:owner>
Aug 09 07:04:37 user nova-compute[72809]:         <nova:user uuid="10e067d2b5b7459cadf50b1ed89a8864">tempest-ServerActionsTestOtherA-118844208-project-member</nova:user>
Aug 09 07:04:37 user nova-compute[72809]:         <nova:project uuid="6da97330281c4d0eba99e485db051973">tempest-ServerActionsTestOtherA-118844208</nova:project>
Aug 09 07:04:37 user nova-compute[72809]:       </nova:owner>
Aug 09 07:04:37 user nova-compute[72809]:       <nova:ports>
Aug 09 07:04:37 user nova-compute[72809]:         <nova:port uuid="79d0335e-d56b-4916-9b58-c198843ed750">
Aug 09 07:04:37 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 07:04:37 user nova-compute[72809]:         </nova:port>
Aug 09 07:04:37 user nova-compute[72809]:       </nova:ports>
Aug 09 07:04:37 user nova-compute[72809]:     </nova:instance>
Aug 09 07:04:37 user nova-compute[72809]:   </metadata>
Aug 09 07:04:37 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 07:04:37 user nova-compute[72809]:     <system>
Aug 09 07:04:37 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 07:04:37 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 07:04:37 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 07:04:37 user nova-compute[72809]:       <entry name="serial">a754327a-9985-4430-af66-1d8bc82fb868</entry>
Aug 09 07:04:37 user nova-compute[72809]:       <entry name="uuid">a754327a-9985-4430-af66-1d8bc82fb868</entry>
Aug 09 07:04:37 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 07:04:37 user nova-compute[72809]:     </system>
Aug 09 07:04:37 user nova-compute[72809]:   </sysinfo>
Aug 09 07:04:37 user nova-compute[72809]:   <os>
Aug 09 07:04:37 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 07:04:37 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 07:04:37 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 07:04:37 user nova-compute[72809]:   </os>
Aug 09 07:04:37 user nova-compute[72809]:   <features>
Aug 09 07:04:37 user nova-compute[72809]:     <acpi/>
Aug 09 07:04:37 user nova-compute[72809]:     <apic/>
Aug 09 07:04:37 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 07:04:37 user nova-compute[72809]:   </features>
Aug 09 07:04:37 user nova-compute[72809]:   <clock offset="utc">
Aug 09 07:04:37 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 07:04:37 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 07:04:37 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 07:04:37 user nova-compute[72809]:   </clock>
Aug 09 07:04:37 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 07:04:37 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 07:04:37 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 07:04:37 user nova-compute[72809]:   </cpu>
Aug 09 07:04:37 user nova-compute[72809]:   <devices>
Aug 09 07:04:37 user nova-compute[72809]:     <disk type="block" device="disk">
Aug 09 07:04:37 user nova-compute[72809]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:04:37 user nova-compute[72809]:       <source dev="/dev/sdc"/>
Aug 09 07:04:37 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 07:04:37 user nova-compute[72809]:       <serial>f1cadbe9-56c6-4639-a5d6-898730c79059</serial>
Aug 09 07:04:37 user nova-compute[72809]:     </disk>
Aug 09 07:04:37 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 07:04:37 user nova-compute[72809]:       <mac address="fa:16:3e:d4:01:03"/>
Aug 09 07:04:37 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:04:37 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 07:04:37 user nova-compute[72809]:       <target dev="tap79d0335e-d5"/>
Aug 09 07:04:37 user nova-compute[72809]:     </interface>
Aug 09 07:04:37 user nova-compute[72809]:     <serial type="pty">
Aug 09 07:04:37 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/a754327a-9985-4430-af66-1d8bc82fb868/console.log" append="off"/>
Aug 09 07:04:37 user nova-compute[72809]:     </serial>
Aug 09 07:04:37 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 07:04:37 user nova-compute[72809]:     <video>
Aug 09 07:04:37 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:04:37 user nova-compute[72809]:     </video>
Aug 09 07:04:37 user nova-compute[72809]:     <rng model="virtio">
Aug 09 07:04:37 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 07:04:37 user nova-compute[72809]:     </rng>
Aug 09 07:04:37 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 07:04:37 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 07:04:37 user nova-compute[72809]:       <stats period="10"/>
Aug 09 07:04:37 user nova-compute[72809]:     </memballoon>
Aug 09 07:04:37 user nova-compute[72809]:   </devices>
Aug 09 07:04:37 user nova-compute[72809]: </domain>
Aug 09 07:04:37 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 07:04:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:02:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1201311549',display_name='tempest-ServerActionsTestOtherA-server-1201311549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1201311549',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCouL5r1ONNNh4MEm1cE7q85fOqyiHXG74zUMePb7Qx7FM94grlflWjrtC3jQ2LeCgVBOqUmmFTQqcvNJ0pbLdMAdhZ4dM0vJEiMtEgevMXZ2oGhFPDEpbVyaR20DJopHw==',key_name='tempest-keypair-888098152',keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:02:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6da97330281c4d0eba99e485db051973',ramdisk_id='',reservation_id='r-jua86bod',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-118844208',owner_user_name='tempest-ServerActionsTestOtherA-118844208-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:04:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10e067d2b5b7459cadf50b1ed89a8864',uuid=a754327a-9985-4430-af66-1d8bc82fb868,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79d0335e-d56b-4916-9b58-c198843ed750", "address": "fa:16:3e:d4:01:03", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-268127379-network", "vif_mac": "fa:16:3e:d4:01:03"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d0335e-d5", "ovs_interfaceid": "79d0335e-d56b-4916-9b58-c198843ed750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 07:04:37 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Converting VIF {"id": "79d0335e-d56b-4916-9b58-c198843ed750", "address": "fa:16:3e:d4:01:03", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-268127379-network", "vif_mac": "fa:16:3e:d4:01:03"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d0335e-d5", "ovs_interfaceid": "79d0335e-d56b-4916-9b58-c198843ed750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:04:37 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:01:03,bridge_name='br-int',has_traffic_filtering=True,id=79d0335e-d56b-4916-9b58-c198843ed750,network=Network(0e68e18b-480a-4b6c-b194-39ba1099a4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d0335e-d5') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:04:37 user nova-compute[72809]: DEBUG os_vif [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:01:03,bridge_name='br-int',has_traffic_filtering=True,id=79d0335e-d56b-4916-9b58-c198843ed750,network=Network(0e68e18b-480a-4b6c-b194-39ba1099a4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d0335e-d5') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 07:04:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:04:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 07:04:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79d0335e-d5, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:04:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap79d0335e-d5, col_values=(('external_ids', {'iface-id': '79d0335e-d56b-4916-9b58-c198843ed750', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:01:03', 'vm-uuid': 'a754327a-9985-4430-af66-1d8bc82fb868'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:04:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:04:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:37 user nova-compute[72809]: INFO os_vif [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:01:03,bridge_name='br-int',has_traffic_filtering=True,id=79d0335e-d56b-4916-9b58-c198843ed750,network=Network(0e68e18b-480a-4b6c-b194-39ba1099a4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d0335e-d5')
Aug 09 07:04:37 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:04:37 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:04:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:04:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:04:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:04:37 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 07:04:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:04:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] No VIF found with MAC fa:16:3e:d4:01:03, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:04:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:39 user nova-compute[72809]: DEBUG nova.compute.manager [req-2b9b8dd0-ac68-431d-aae5-4ce502bd4046 req-6351ba08-8afd-43b8-9535-3cb6795d18c9 service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Received event network-vif-plugged-79d0335e-d56b-4916-9b58-c198843ed750 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:04:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2b9b8dd0-ac68-431d-aae5-4ce502bd4046 req-6351ba08-8afd-43b8-9535-3cb6795d18c9 service nova] Acquiring lock "a754327a-9985-4430-af66-1d8bc82fb868-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:04:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2b9b8dd0-ac68-431d-aae5-4ce502bd4046 req-6351ba08-8afd-43b8-9535-3cb6795d18c9 service nova] Lock "a754327a-9985-4430-af66-1d8bc82fb868-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:04:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2b9b8dd0-ac68-431d-aae5-4ce502bd4046 req-6351ba08-8afd-43b8-9535-3cb6795d18c9 service nova] Lock "a754327a-9985-4430-af66-1d8bc82fb868-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:04:39 user nova-compute[72809]: DEBUG nova.compute.manager [req-2b9b8dd0-ac68-431d-aae5-4ce502bd4046 req-6351ba08-8afd-43b8-9535-3cb6795d18c9 service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] No waiting events found dispatching network-vif-plugged-79d0335e-d56b-4916-9b58-c198843ed750 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:04:39 user nova-compute[72809]: WARNING nova.compute.manager [req-2b9b8dd0-ac68-431d-aae5-4ce502bd4046 req-6351ba08-8afd-43b8-9535-3cb6795d18c9 service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Received unexpected event network-vif-plugged-79d0335e-d56b-4916-9b58-c198843ed750 for instance with vm_state active and task_state resize_finish.
Aug 09 07:04:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:04:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:40 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691564665.425764, a754327a-9985-4430-af66-1d8bc82fb868 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:04:40 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: a754327a-9985-4430-af66-1d8bc82fb868] VM Stopped (Lifecycle Event)
Aug 09 07:04:40 user nova-compute[72809]: DEBUG nova.compute.manager [None req-73e8ab7e-09c0-4c3c-b200-9bc5e0950c5d None None] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:04:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:41 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564681.3861766, a754327a-9985-4430-af66-1d8bc82fb868 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:04:41 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: a754327a-9985-4430-af66-1d8bc82fb868] VM Resumed (Lifecycle Event)
Aug 09 07:04:41 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 07:04:41 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Instance running successfully.
Aug 09 07:04:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Failed to set time: agent not configured {{(pid=72809) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 09 07:04:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ea8aa2d3-1ef4-4dc5-a396-b3d73d7e1999 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] finish_migration finished successfully. {{(pid=72809) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 09 07:04:41 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:04:41 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:04:41 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: a754327a-9985-4430-af66-1d8bc82fb868] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 07:04:41 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564681.3877583, a754327a-9985-4430-af66-1d8bc82fb868 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:04:41 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: a754327a-9985-4430-af66-1d8bc82fb868] VM Started (Lifecycle Event)
Aug 09 07:04:41 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:04:41 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:04:41 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: a754327a-9985-4430-af66-1d8bc82fb868] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 07:04:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:41 user nova-compute[72809]: DEBUG nova.compute.manager [req-f559aaec-9798-4b60-b024-130739ac477c req-bc3211b3-26ad-43f4-901c-3a722229e70e service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Received event network-vif-plugged-79d0335e-d56b-4916-9b58-c198843ed750 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:04:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f559aaec-9798-4b60-b024-130739ac477c req-bc3211b3-26ad-43f4-901c-3a722229e70e service nova] Acquiring lock "a754327a-9985-4430-af66-1d8bc82fb868-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:04:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f559aaec-9798-4b60-b024-130739ac477c req-bc3211b3-26ad-43f4-901c-3a722229e70e service nova] Lock "a754327a-9985-4430-af66-1d8bc82fb868-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:04:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f559aaec-9798-4b60-b024-130739ac477c req-bc3211b3-26ad-43f4-901c-3a722229e70e service nova] Lock "a754327a-9985-4430-af66-1d8bc82fb868-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:04:41 user nova-compute[72809]: DEBUG nova.compute.manager [req-f559aaec-9798-4b60-b024-130739ac477c req-bc3211b3-26ad-43f4-901c-3a722229e70e service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] No waiting events found dispatching network-vif-plugged-79d0335e-d56b-4916-9b58-c198843ed750 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:04:41 user nova-compute[72809]: WARNING nova.compute.manager [req-f559aaec-9798-4b60-b024-130739ac477c req-bc3211b3-26ad-43f4-901c-3a722229e70e service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Received unexpected event network-vif-plugged-79d0335e-d56b-4916-9b58-c198843ed750 for instance with vm_state active and task_state resize_finish.
Aug 09 07:04:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:04:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cab676-b3c0-4f05-9e44-42e5a6677857/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cab676-b3c0-4f05-9e44-42e5a6677857/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cab676-b3c0-4f05-9e44-42e5a6677857/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cab676-b3c0-4f05-9e44-42e5a6677857/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:43 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:04:43 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:04:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=7384MB free_disk=25.03377914428711GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 07:04:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:04:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:04:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Applying migration context for instance a754327a-9985-4430-af66-1d8bc82fb868 as it has an incoming, in-progress migration e576542e-d733-40bc-8749-08b38fac6842. Migration status is finished {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 09 07:04:43 user nova-compute[72809]: INFO nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Updating resource usage from migration e576542e-d733-40bc-8749-08b38fac6842
Aug 09 07:04:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 336770eb-4f09-4134-92ef-f96039bf4fa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:04:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 1bde423f-0b73-448f-bdce-8d6af96d8fc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:04:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance bebd5a14-6272-4de1-a1a1-4fb45b867c7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:04:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 339372ed-140d-4226-ba00-2cc682214d5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:04:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 38319c37-9cc0-4e84-8415-ddcf37451daf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:04:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 51432417-89cc-4cee-855d-c4b148e4bd37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:04:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 466a8e58-5f88-4ffe-a7fd-a346003f3508 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:04:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance b5cab676-b3c0-4f05-9e44-42e5a6677857 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:04:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 40bc627e-28c9-4450-9532-bf6db60845b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:04:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:04:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Migration e576542e-d733-40bc-8749-08b38fac6842 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 09 07:04:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance a754327a-9985-4430-af66-1d8bc82fb868 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:04:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 07:04:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 07:04:43 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:43 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:04:43 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:04:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 07:04:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.785s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:04:43 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:04:43 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Cleaning up deleted instances {{(pid=72809) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 07:04:43 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] There are 0 instances to clean {{(pid=72809) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 07:04:43 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:04:46 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:04:46 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:04:46 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:04:46 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:04:46 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:04:46 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:04:46 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 07:04:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:49 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:04:51 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:04:51 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72809) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 07:04:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:04:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72809) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 07:04:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:04:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:04:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "63936bb9-97de-4a87-aa29-14129104c1d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:04:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "63936bb9-97de-4a87-aa29-14129104c1d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:04:54 user nova-compute[72809]: DEBUG nova.compute.manager [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 07:04:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:04:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:04:55 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 07:04:55 user nova-compute[72809]: INFO nova.compute.claims [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Claim successful on node user
Aug 09 07:04:55 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:04:55 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:04:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:04:55 user nova-compute[72809]: DEBUG nova.compute.manager [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 07:04:55 user nova-compute[72809]: DEBUG nova.compute.manager [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 07:04:55 user nova-compute[72809]: DEBUG nova.network.neutron [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 07:04:55 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 07:04:55 user nova-compute[72809]: DEBUG nova.compute.manager [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 07:04:55 user nova-compute[72809]: DEBUG nova.policy [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '740071d735364ce5b0e6a7bb0dbdffe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75b8536be334abba712e1c6f6886cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 07:04:55 user nova-compute[72809]: DEBUG nova.compute.manager [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 07:04:55 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 07:04:55 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Creating image(s)
Aug 09 07:04:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "/opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:04:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "/opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:04:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "/opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:04:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.140s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:04:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:04:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.134s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:56 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk 1073741824" returned: 0 in 0.050s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:04:56 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:56 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.137s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:56 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Checking if we can resize image /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 07:04:56 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:04:56 user nova-compute[72809]: DEBUG nova.network.neutron [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Successfully created port: 871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 07:04:56 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:04:56 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Cannot resize image /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 07:04:56 user nova-compute[72809]: DEBUG nova.objects.instance [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lazy-loading 'migration_context' on Instance uuid 63936bb9-97de-4a87-aa29-14129104c1d3 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:04:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 07:04:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Ensure instance console log exists: /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 07:04:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:04:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:04:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG nova.network.neutron [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Successfully updated port: 871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "refresh_cache-63936bb9-97de-4a87-aa29-14129104c1d3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquired lock "refresh_cache-63936bb9-97de-4a87-aa29-14129104c1d3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG nova.network.neutron [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG nova.compute.manager [req-d460d825-dd61-410a-a74f-0bafe0f88396 req-077f3ce3-a495-4f29-9b24-355ff4993908 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Received event network-changed-871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG nova.compute.manager [req-d460d825-dd61-410a-a74f-0bafe0f88396 req-077f3ce3-a495-4f29-9b24-355ff4993908 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Refreshing instance network info cache due to event network-changed-871a925e-dae2-45d5-8e6d-24d429032d70. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d460d825-dd61-410a-a74f-0bafe0f88396 req-077f3ce3-a495-4f29-9b24-355ff4993908 service nova] Acquiring lock "refresh_cache-63936bb9-97de-4a87-aa29-14129104c1d3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG nova.network.neutron [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG nova.network.neutron [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Updating instance_info_cache with network_info: [{"id": "871a925e-dae2-45d5-8e6d-24d429032d70", "address": "fa:16:3e:a0:e1:1d", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871a925e-da", "ovs_interfaceid": "871a925e-dae2-45d5-8e6d-24d429032d70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Releasing lock "refresh_cache-63936bb9-97de-4a87-aa29-14129104c1d3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG nova.compute.manager [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Instance network_info: |[{"id": "871a925e-dae2-45d5-8e6d-24d429032d70", "address": "fa:16:3e:a0:e1:1d", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871a925e-da", "ovs_interfaceid": "871a925e-dae2-45d5-8e6d-24d429032d70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d460d825-dd61-410a-a74f-0bafe0f88396 req-077f3ce3-a495-4f29-9b24-355ff4993908 service nova] Acquired lock "refresh_cache-63936bb9-97de-4a87-aa29-14129104c1d3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG nova.network.neutron [req-d460d825-dd61-410a-a74f-0bafe0f88396 req-077f3ce3-a495-4f29-9b24-355ff4993908 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Refreshing network info cache for port 871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Start _get_guest_xml network_info=[{"id": "871a925e-dae2-45d5-8e6d-24d429032d70", "address": "fa:16:3e:a0:e1:1d", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871a925e-da", "ovs_interfaceid": "871a925e-dae2-45d5-8e6d-24d429032d70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 07:04:57 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:04:57 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:04:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:04:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1556535521',display_name='tempest-ServerRescueNegativeTestJSON-server-1556535521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1556535521',id=35,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHeoIs5ATCyUGa031aHbazVkBN/+n/Z8VWoRm/Wus5x5A8l851hJVnTTm9YA2bIXyG0hvdO+4f6Xok23XdDFN+F0ZS83bBZmztR4TmBSoz2mlXYe3ZeHSAukj28ybVZyQ==',key_name='tempest-keypair-1071783678',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e75b8536be334abba712e1c6f6886cdf',ramdisk_id='',reservation_id='r-mngut0hx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1153742012',owner_user_name='tempest-ServerRescueNegativeTestJSON-1153742012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:04:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='740071d735364ce5b0e6a7bb0dbdffe3',uuid=63936bb9-97de-4a87-aa29-14129104c1d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "871a925e-dae2-45d5-8e6d-24d429032d70", "address": "fa:16:3e:a0:e1:1d", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871a925e-da", "ovs_interfaceid": "871a925e-dae2-45d5-8e6d-24d429032d70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Converting VIF {"id": "871a925e-dae2-45d5-8e6d-24d429032d70", "address": "fa:16:3e:a0:e1:1d", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871a925e-da", "ovs_interfaceid": "871a925e-dae2-45d5-8e6d-24d429032d70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:e1:1d,bridge_name='br-int',has_traffic_filtering=True,id=871a925e-dae2-45d5-8e6d-24d429032d70,network=Network(fb9ae39b-117a-4cca-8080-683f63e8a318),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap871a925e-da') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG nova.objects.instance [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lazy-loading 'pci_devices' on Instance uuid 63936bb9-97de-4a87-aa29-14129104c1d3 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] End _get_guest_xml xml=<domain type="kvm">
Aug 09 07:04:57 user nova-compute[72809]:   <uuid>63936bb9-97de-4a87-aa29-14129104c1d3</uuid>
Aug 09 07:04:57 user nova-compute[72809]:   <name>instance-00000023</name>
Aug 09 07:04:57 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 07:04:57 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 07:04:57 user nova-compute[72809]:   <metadata>
Aug 09 07:04:57 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 07:04:57 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 07:04:57 user nova-compute[72809]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1556535521</nova:name>
Aug 09 07:04:57 user nova-compute[72809]:       <nova:creationTime>2023-08-09 07:04:57</nova:creationTime>
Aug 09 07:04:57 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 07:04:57 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 07:04:57 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 07:04:57 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 07:04:57 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 07:04:57 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 07:04:57 user nova-compute[72809]:       </nova:flavor>
Aug 09 07:04:57 user nova-compute[72809]:       <nova:owner>
Aug 09 07:04:57 user nova-compute[72809]:         <nova:user uuid="740071d735364ce5b0e6a7bb0dbdffe3">tempest-ServerRescueNegativeTestJSON-1153742012-project-member</nova:user>
Aug 09 07:04:57 user nova-compute[72809]:         <nova:project uuid="e75b8536be334abba712e1c6f6886cdf">tempest-ServerRescueNegativeTestJSON-1153742012</nova:project>
Aug 09 07:04:57 user nova-compute[72809]:       </nova:owner>
Aug 09 07:04:57 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 07:04:57 user nova-compute[72809]:       <nova:ports>
Aug 09 07:04:57 user nova-compute[72809]:         <nova:port uuid="871a925e-dae2-45d5-8e6d-24d429032d70">
Aug 09 07:04:57 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 07:04:57 user nova-compute[72809]:         </nova:port>
Aug 09 07:04:57 user nova-compute[72809]:       </nova:ports>
Aug 09 07:04:57 user nova-compute[72809]:     </nova:instance>
Aug 09 07:04:57 user nova-compute[72809]:   </metadata>
Aug 09 07:04:57 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 07:04:57 user nova-compute[72809]:     <system>
Aug 09 07:04:57 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 07:04:57 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 07:04:57 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 07:04:57 user nova-compute[72809]:       <entry name="serial">63936bb9-97de-4a87-aa29-14129104c1d3</entry>
Aug 09 07:04:57 user nova-compute[72809]:       <entry name="uuid">63936bb9-97de-4a87-aa29-14129104c1d3</entry>
Aug 09 07:04:57 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 07:04:57 user nova-compute[72809]:     </system>
Aug 09 07:04:57 user nova-compute[72809]:   </sysinfo>
Aug 09 07:04:57 user nova-compute[72809]:   <os>
Aug 09 07:04:57 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 07:04:57 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 07:04:57 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 07:04:57 user nova-compute[72809]:   </os>
Aug 09 07:04:57 user nova-compute[72809]:   <features>
Aug 09 07:04:57 user nova-compute[72809]:     <acpi/>
Aug 09 07:04:57 user nova-compute[72809]:     <apic/>
Aug 09 07:04:57 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 07:04:57 user nova-compute[72809]:   </features>
Aug 09 07:04:57 user nova-compute[72809]:   <clock offset="utc">
Aug 09 07:04:57 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 07:04:57 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 07:04:57 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 07:04:57 user nova-compute[72809]:   </clock>
Aug 09 07:04:57 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 07:04:57 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 07:04:57 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 07:04:57 user nova-compute[72809]:   </cpu>
Aug 09 07:04:57 user nova-compute[72809]:   <devices>
Aug 09 07:04:57 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 07:04:57 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 07:04:57 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk"/>
Aug 09 07:04:57 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 07:04:57 user nova-compute[72809]:     </disk>
Aug 09 07:04:57 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 07:04:57 user nova-compute[72809]:       <mac address="fa:16:3e:a0:e1:1d"/>
Aug 09 07:04:57 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:04:57 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 07:04:57 user nova-compute[72809]:       <target dev="tap871a925e-da"/>
Aug 09 07:04:57 user nova-compute[72809]:     </interface>
Aug 09 07:04:57 user nova-compute[72809]:     <serial type="pty">
Aug 09 07:04:57 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/console.log" append="off"/>
Aug 09 07:04:57 user nova-compute[72809]:     </serial>
Aug 09 07:04:57 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 07:04:57 user nova-compute[72809]:     <video>
Aug 09 07:04:57 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:04:57 user nova-compute[72809]:     </video>
Aug 09 07:04:57 user nova-compute[72809]:     <rng model="virtio">
Aug 09 07:04:57 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 07:04:57 user nova-compute[72809]:     </rng>
Aug 09 07:04:57 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 07:04:57 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 07:04:57 user nova-compute[72809]:       <stats period="10"/>
Aug 09 07:04:57 user nova-compute[72809]:     </memballoon>
Aug 09 07:04:57 user nova-compute[72809]:   </devices>
Aug 09 07:04:57 user nova-compute[72809]: </domain>
Aug 09 07:04:57 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:04:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1556535521',display_name='tempest-ServerRescueNegativeTestJSON-server-1556535521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1556535521',id=35,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHeoIs5ATCyUGa031aHbazVkBN/+n/Z8VWoRm/Wus5x5A8l851hJVnTTm9YA2bIXyG0hvdO+4f6Xok23XdDFN+F0ZS83bBZmztR4TmBSoz2mlXYe3ZeHSAukj28ybVZyQ==',key_name='tempest-keypair-1071783678',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e75b8536be334abba712e1c6f6886cdf',ramdisk_id='',reservation_id='r-mngut0hx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1153742012',owner_user_name='tempest-ServerRescueNegativeTestJSON-1153742012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:04:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='740071d735364ce5b0e6a7bb0dbdffe3',uuid=63936bb9-97de-4a87-aa29-14129104c1d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "871a925e-dae2-45d5-8e6d-24d429032d70", "address": "fa:16:3e:a0:e1:1d", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871a925e-da", "ovs_interfaceid": "871a925e-dae2-45d5-8e6d-24d429032d70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Converting VIF {"id": "871a925e-dae2-45d5-8e6d-24d429032d70", "address": "fa:16:3e:a0:e1:1d", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871a925e-da", "ovs_interfaceid": "871a925e-dae2-45d5-8e6d-24d429032d70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:e1:1d,bridge_name='br-int',has_traffic_filtering=True,id=871a925e-dae2-45d5-8e6d-24d429032d70,network=Network(fb9ae39b-117a-4cca-8080-683f63e8a318),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap871a925e-da') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG os_vif [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:e1:1d,bridge_name='br-int',has_traffic_filtering=True,id=871a925e-dae2-45d5-8e6d-24d429032d70,network=Network(fb9ae39b-117a-4cca-8080-683f63e8a318),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap871a925e-da') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap871a925e-da, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap871a925e-da, col_values=(('external_ids', {'iface-id': '871a925e-dae2-45d5-8e6d-24d429032d70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:e1:1d', 'vm-uuid': '63936bb9-97de-4a87-aa29-14129104c1d3'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:04:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:57 user nova-compute[72809]: INFO os_vif [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:e1:1d,bridge_name='br-int',has_traffic_filtering=True,id=871a925e-dae2-45d5-8e6d-24d429032d70,network=Network(fb9ae39b-117a-4cca-8080-683f63e8a318),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap871a925e-da')
Aug 09 07:04:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:04:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] No VIF found with MAC fa:16:3e:a0:e1:1d, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:04:58 user nova-compute[72809]: DEBUG nova.network.neutron [req-d460d825-dd61-410a-a74f-0bafe0f88396 req-077f3ce3-a495-4f29-9b24-355ff4993908 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Updated VIF entry in instance network info cache for port 871a925e-dae2-45d5-8e6d-24d429032d70. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:04:58 user nova-compute[72809]: DEBUG nova.network.neutron [req-d460d825-dd61-410a-a74f-0bafe0f88396 req-077f3ce3-a495-4f29-9b24-355ff4993908 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Updating instance_info_cache with network_info: [{"id": "871a925e-dae2-45d5-8e6d-24d429032d70", "address": "fa:16:3e:a0:e1:1d", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871a925e-da", "ovs_interfaceid": "871a925e-dae2-45d5-8e6d-24d429032d70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:04:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d460d825-dd61-410a-a74f-0bafe0f88396 req-077f3ce3-a495-4f29-9b24-355ff4993908 service nova] Releasing lock "refresh_cache-63936bb9-97de-4a87-aa29-14129104c1d3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:04:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:04:59 user nova-compute[72809]: DEBUG nova.compute.manager [req-2d88c5ee-b34c-4c69-b7a5-89d58f350a72 req-844e0afa-940a-45ea-918e-17345d0bc277 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Received event network-vif-plugged-871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:04:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2d88c5ee-b34c-4c69-b7a5-89d58f350a72 req-844e0afa-940a-45ea-918e-17345d0bc277 service nova] Acquiring lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:04:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2d88c5ee-b34c-4c69-b7a5-89d58f350a72 req-844e0afa-940a-45ea-918e-17345d0bc277 service nova] Lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:04:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2d88c5ee-b34c-4c69-b7a5-89d58f350a72 req-844e0afa-940a-45ea-918e-17345d0bc277 service nova] Lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:04:59 user nova-compute[72809]: DEBUG nova.compute.manager [req-2d88c5ee-b34c-4c69-b7a5-89d58f350a72 req-844e0afa-940a-45ea-918e-17345d0bc277 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] No waiting events found dispatching network-vif-plugged-871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:04:59 user nova-compute[72809]: WARNING nova.compute.manager [req-2d88c5ee-b34c-4c69-b7a5-89d58f350a72 req-844e0afa-940a-45ea-918e-17345d0bc277 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Received unexpected event network-vif-plugged-871a925e-dae2-45d5-8e6d-24d429032d70 for instance with vm_state building and task_state spawning.
Aug 09 07:05:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-533de27a-10ff-4ea7-aeac-97ef53defd09 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "b5cab676-b3c0-4f05-9e44-42e5a6677857" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-533de27a-10ff-4ea7-aeac-97ef53defd09 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "b5cab676-b3c0-4f05-9e44-42e5a6677857" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-533de27a-10ff-4ea7-aeac-97ef53defd09 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "b5cab676-b3c0-4f05-9e44-42e5a6677857-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-533de27a-10ff-4ea7-aeac-97ef53defd09 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "b5cab676-b3c0-4f05-9e44-42e5a6677857-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-533de27a-10ff-4ea7-aeac-97ef53defd09 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "b5cab676-b3c0-4f05-9e44-42e5a6677857-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:01 user nova-compute[72809]: INFO nova.compute.manager [None req-533de27a-10ff-4ea7-aeac-97ef53defd09 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Terminating instance
Aug 09 07:05:01 user nova-compute[72809]: DEBUG nova.compute.manager [None req-533de27a-10ff-4ea7-aeac-97ef53defd09 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:05:01 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564701.5889826, 63936bb9-97de-4a87-aa29-14129104c1d3 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:05:01 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] VM Resumed (Lifecycle Event)
Aug 09 07:05:01 user nova-compute[72809]: DEBUG nova.compute.manager [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 07:05:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 07:05:01 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Instance spawned successfully.
Aug 09 07:05:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 07:05:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:05:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:05:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:05:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:05:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:05:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:05:01 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:05:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:01 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:05:01 user nova-compute[72809]: DEBUG nova.compute.manager [req-109516c1-be7f-4033-a48e-98deb9d81ee2 req-180fc2e4-7f84-4256-9717-7047b71e5a93 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Received event network-vif-plugged-871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:05:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-109516c1-be7f-4033-a48e-98deb9d81ee2 req-180fc2e4-7f84-4256-9717-7047b71e5a93 service nova] Acquiring lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-109516c1-be7f-4033-a48e-98deb9d81ee2 req-180fc2e4-7f84-4256-9717-7047b71e5a93 service nova] Lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-109516c1-be7f-4033-a48e-98deb9d81ee2 req-180fc2e4-7f84-4256-9717-7047b71e5a93 service nova] Lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:01 user nova-compute[72809]: DEBUG nova.compute.manager [req-109516c1-be7f-4033-a48e-98deb9d81ee2 req-180fc2e4-7f84-4256-9717-7047b71e5a93 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] No waiting events found dispatching network-vif-plugged-871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:05:01 user nova-compute[72809]: WARNING nova.compute.manager [req-109516c1-be7f-4033-a48e-98deb9d81ee2 req-180fc2e4-7f84-4256-9717-7047b71e5a93 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Received unexpected event network-vif-plugged-871a925e-dae2-45d5-8e6d-24d429032d70 for instance with vm_state building and task_state spawning.
Aug 09 07:05:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:01 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:05:01 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564701.5973887, 63936bb9-97de-4a87-aa29-14129104c1d3 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:05:01 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] VM Started (Lifecycle Event)
Aug 09 07:05:01 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:05:01 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:05:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:01 user nova-compute[72809]: INFO nova.compute.manager [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Took 6.14 seconds to spawn the instance on the hypervisor.
Aug 09 07:05:01 user nova-compute[72809]: DEBUG nova.compute.manager [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:05:01 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:05:01 user nova-compute[72809]: DEBUG nova.compute.manager [req-820fb5c0-19fe-4b13-8ec4-077c138a7fd5 req-8d779470-943c-4a65-8f18-35f7d3c7575c service nova] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Received event network-vif-unplugged-df6b4846-8c11-4271-9184-f9f93aec39d5 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:05:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-820fb5c0-19fe-4b13-8ec4-077c138a7fd5 req-8d779470-943c-4a65-8f18-35f7d3c7575c service nova] Acquiring lock "b5cab676-b3c0-4f05-9e44-42e5a6677857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-820fb5c0-19fe-4b13-8ec4-077c138a7fd5 req-8d779470-943c-4a65-8f18-35f7d3c7575c service nova] Lock "b5cab676-b3c0-4f05-9e44-42e5a6677857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-820fb5c0-19fe-4b13-8ec4-077c138a7fd5 req-8d779470-943c-4a65-8f18-35f7d3c7575c service nova] Lock "b5cab676-b3c0-4f05-9e44-42e5a6677857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:01 user nova-compute[72809]: DEBUG nova.compute.manager [req-820fb5c0-19fe-4b13-8ec4-077c138a7fd5 req-8d779470-943c-4a65-8f18-35f7d3c7575c service nova] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] No waiting events found dispatching network-vif-unplugged-df6b4846-8c11-4271-9184-f9f93aec39d5 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:05:01 user nova-compute[72809]: DEBUG nova.compute.manager [req-820fb5c0-19fe-4b13-8ec4-077c138a7fd5 req-8d779470-943c-4a65-8f18-35f7d3c7575c service nova] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Received event network-vif-unplugged-df6b4846-8c11-4271-9184-f9f93aec39d5 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:05:01 user nova-compute[72809]: INFO nova.compute.manager [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Took 6.95 seconds to build instance.
Aug 09 07:05:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79872a7e-144b-4943-b3d5-9febd0e223f1 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "63936bb9-97de-4a87-aa29-14129104c1d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.054s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:02 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Instance destroyed successfully.
Aug 09 07:05:02 user nova-compute[72809]: DEBUG nova.objects.instance [None req-533de27a-10ff-4ea7-aeac-97ef53defd09 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lazy-loading 'resources' on Instance uuid b5cab676-b3c0-4f05-9e44-42e5a6677857 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:05:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-533de27a-10ff-4ea7-aeac-97ef53defd09 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:02:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-688250549',display_name='tempest-AttachVolumeNegativeTest-server-688250549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-688250549',id=32,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGfSo4DnR6adPalFM6PjjdebJ8nE+BaVjdwiVPJ4Sns/2C3/6sEc3T8MEg6RpF3p+Y0KBHIfVAsD+J7PEnpcwdPscKXuCnaI4B0WnJuGRxMfljx685GCBljf3J3+JOKcA==',key_name='tempest-keypair-462626796',keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:02:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ce7c486aaca4ef89eb7e392b717e3d7',ramdisk_id='',reservation_id='r-ctqz6wra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2066250801',owner_user_name='tempest-AttachVolumeNegativeTest-2066250801-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:02:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f85a1f2a88fd40a48d1c4dba13f0ac09',uuid=b5cab676-b3c0-4f05-9e44-42e5a6677857,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df6b4846-8c11-4271-9184-f9f93aec39d5", "address": "fa:16:3e:5f:ac:5e", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6b4846-8c", "ovs_interfaceid": "df6b4846-8c11-4271-9184-f9f93aec39d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:05:02 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-533de27a-10ff-4ea7-aeac-97ef53defd09 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Converting VIF {"id": "df6b4846-8c11-4271-9184-f9f93aec39d5", "address": "fa:16:3e:5f:ac:5e", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6b4846-8c", "ovs_interfaceid": "df6b4846-8c11-4271-9184-f9f93aec39d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:05:02 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-533de27a-10ff-4ea7-aeac-97ef53defd09 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:ac:5e,bridge_name='br-int',has_traffic_filtering=True,id=df6b4846-8c11-4271-9184-f9f93aec39d5,network=Network(1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf6b4846-8c') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:05:02 user nova-compute[72809]: DEBUG os_vif [None req-533de27a-10ff-4ea7-aeac-97ef53defd09 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:ac:5e,bridge_name='br-int',has_traffic_filtering=True,id=df6b4846-8c11-4271-9184-f9f93aec39d5,network=Network(1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf6b4846-8c') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:05:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf6b4846-8c, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:05:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:05:02 user nova-compute[72809]: INFO os_vif [None req-533de27a-10ff-4ea7-aeac-97ef53defd09 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:ac:5e,bridge_name='br-int',has_traffic_filtering=True,id=df6b4846-8c11-4271-9184-f9f93aec39d5,network=Network(1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf6b4846-8c')
Aug 09 07:05:02 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-533de27a-10ff-4ea7-aeac-97ef53defd09 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Deleting instance files /opt/stack/data/nova/instances/b5cab676-b3c0-4f05-9e44-42e5a6677857_del
Aug 09 07:05:02 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-533de27a-10ff-4ea7-aeac-97ef53defd09 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Deletion of /opt/stack/data/nova/instances/b5cab676-b3c0-4f05-9e44-42e5a6677857_del complete
Aug 09 07:05:02 user nova-compute[72809]: INFO nova.compute.manager [None req-533de27a-10ff-4ea7-aeac-97ef53defd09 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 09 07:05:02 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-533de27a-10ff-4ea7-aeac-97ef53defd09 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:05:02 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:05:02 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:05:03 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:05:03 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Took 1.06 seconds to deallocate network for instance.
Aug 09 07:05:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-533de27a-10ff-4ea7-aeac-97ef53defd09 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-533de27a-10ff-4ea7-aeac-97ef53defd09 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:03 user nova-compute[72809]: DEBUG nova.compute.manager [req-be6647da-c5c0-425b-9c01-0d3286ed51a8 req-8a0a9044-53d7-4ea9-8dfc-c57e167f9de5 service nova] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Received event network-vif-plugged-df6b4846-8c11-4271-9184-f9f93aec39d5 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:05:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-be6647da-c5c0-425b-9c01-0d3286ed51a8 req-8a0a9044-53d7-4ea9-8dfc-c57e167f9de5 service nova] Acquiring lock "b5cab676-b3c0-4f05-9e44-42e5a6677857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-be6647da-c5c0-425b-9c01-0d3286ed51a8 req-8a0a9044-53d7-4ea9-8dfc-c57e167f9de5 service nova] Lock "b5cab676-b3c0-4f05-9e44-42e5a6677857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-be6647da-c5c0-425b-9c01-0d3286ed51a8 req-8a0a9044-53d7-4ea9-8dfc-c57e167f9de5 service nova] Lock "b5cab676-b3c0-4f05-9e44-42e5a6677857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:03 user nova-compute[72809]: DEBUG nova.compute.manager [req-be6647da-c5c0-425b-9c01-0d3286ed51a8 req-8a0a9044-53d7-4ea9-8dfc-c57e167f9de5 service nova] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] No waiting events found dispatching network-vif-plugged-df6b4846-8c11-4271-9184-f9f93aec39d5 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:05:03 user nova-compute[72809]: WARNING nova.compute.manager [req-be6647da-c5c0-425b-9c01-0d3286ed51a8 req-8a0a9044-53d7-4ea9-8dfc-c57e167f9de5 service nova] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Received unexpected event network-vif-plugged-df6b4846-8c11-4271-9184-f9f93aec39d5 for instance with vm_state deleted and task_state None.
Aug 09 07:05:03 user nova-compute[72809]: DEBUG nova.compute.manager [req-be6647da-c5c0-425b-9c01-0d3286ed51a8 req-8a0a9044-53d7-4ea9-8dfc-c57e167f9de5 service nova] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Received event network-vif-deleted-df6b4846-8c11-4271-9184-f9f93aec39d5 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:05:04 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-533de27a-10ff-4ea7-aeac-97ef53defd09 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:05:04 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-533de27a-10ff-4ea7-aeac-97ef53defd09 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:05:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-533de27a-10ff-4ea7-aeac-97ef53defd09 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.487s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:04 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-533de27a-10ff-4ea7-aeac-97ef53defd09 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Deleted allocations for instance b5cab676-b3c0-4f05-9e44-42e5a6677857
Aug 09 07:05:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-533de27a-10ff-4ea7-aeac-97ef53defd09 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "b5cab676-b3c0-4f05-9e44-42e5a6677857" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.885s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-18c978c3-b1e4-4d4e-9d2a-0d131b03b5b6 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "40bc627e-28c9-4450-9532-bf6db60845b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-18c978c3-b1e4-4d4e-9d2a-0d131b03b5b6 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "40bc627e-28c9-4450-9532-bf6db60845b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-18c978c3-b1e4-4d4e-9d2a-0d131b03b5b6 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "40bc627e-28c9-4450-9532-bf6db60845b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-18c978c3-b1e4-4d4e-9d2a-0d131b03b5b6 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "40bc627e-28c9-4450-9532-bf6db60845b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-18c978c3-b1e4-4d4e-9d2a-0d131b03b5b6 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "40bc627e-28c9-4450-9532-bf6db60845b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:07 user nova-compute[72809]: INFO nova.compute.manager [None req-18c978c3-b1e4-4d4e-9d2a-0d131b03b5b6 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Terminating instance
Aug 09 07:05:07 user nova-compute[72809]: DEBUG nova.compute.manager [None req-18c978c3-b1e4-4d4e-9d2a-0d131b03b5b6 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:05:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-acda9b68-fdca-48ec-b4f0-a54675bd7b19 req-0d9de2f1-7150-4ab7-a28f-c99785b54e62 service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Received event network-vif-unplugged-e17ef1fb-761f-4b49-803c-b4c55115eb7c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:05:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-acda9b68-fdca-48ec-b4f0-a54675bd7b19 req-0d9de2f1-7150-4ab7-a28f-c99785b54e62 service nova] Acquiring lock "40bc627e-28c9-4450-9532-bf6db60845b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-acda9b68-fdca-48ec-b4f0-a54675bd7b19 req-0d9de2f1-7150-4ab7-a28f-c99785b54e62 service nova] Lock "40bc627e-28c9-4450-9532-bf6db60845b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-acda9b68-fdca-48ec-b4f0-a54675bd7b19 req-0d9de2f1-7150-4ab7-a28f-c99785b54e62 service nova] Lock "40bc627e-28c9-4450-9532-bf6db60845b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-acda9b68-fdca-48ec-b4f0-a54675bd7b19 req-0d9de2f1-7150-4ab7-a28f-c99785b54e62 service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] No waiting events found dispatching network-vif-unplugged-e17ef1fb-761f-4b49-803c-b4c55115eb7c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:05:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-acda9b68-fdca-48ec-b4f0-a54675bd7b19 req-0d9de2f1-7150-4ab7-a28f-c99785b54e62 service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Received event network-vif-unplugged-e17ef1fb-761f-4b49-803c-b4c55115eb7c for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:05:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:07 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Instance destroyed successfully.
Aug 09 07:05:07 user nova-compute[72809]: DEBUG nova.objects.instance [None req-18c978c3-b1e4-4d4e-9d2a-0d131b03b5b6 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lazy-loading 'resources' on Instance uuid 40bc627e-28c9-4450-9532-bf6db60845b2 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:05:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-18c978c3-b1e4-4d4e-9d2a-0d131b03b5b6 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T06:59:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-301681722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-301681722',id=27,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiPUyyU9HwEFMGL8DnXEkkfedQ6deONPsZPZUAGuNY6FGS6oRpyMZpNJ7zXpxN+k6Z2hKUAdewWqVFpwArkxpr2rp1VkYEweMSI5/AQLY/62y6Lc4WGoK047l4JlSqa1Q==',key_name='tempest-keypair-1856803890',keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:03:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ec36de19d984ff3a150db4fdd8ce327',ramdisk_id='',reservation_id='r-3ai7s74q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1006961404',owner_user_name='tempest-AttachVolumeShelveTestJSON-1006961404-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:03:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e51e8a984c724efe966662c14b0dbffc',uuid=40bc627e-28c9-4450-9532-bf6db60845b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "address": "fa:16:3e:15:53:7d", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape17ef1fb-76", "ovs_interfaceid": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:05:07 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-18c978c3-b1e4-4d4e-9d2a-0d131b03b5b6 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Converting VIF {"id": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "address": "fa:16:3e:15:53:7d", "network": {"id": "39277410-6754-4b40-b1bc-9777841910ae", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1953133641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec36de19d984ff3a150db4fdd8ce327", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape17ef1fb-76", "ovs_interfaceid": "e17ef1fb-761f-4b49-803c-b4c55115eb7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:05:07 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-18c978c3-b1e4-4d4e-9d2a-0d131b03b5b6 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:53:7d,bridge_name='br-int',has_traffic_filtering=True,id=e17ef1fb-761f-4b49-803c-b4c55115eb7c,network=Network(39277410-6754-4b40-b1bc-9777841910ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape17ef1fb-76') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:05:07 user nova-compute[72809]: DEBUG os_vif [None req-18c978c3-b1e4-4d4e-9d2a-0d131b03b5b6 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:53:7d,bridge_name='br-int',has_traffic_filtering=True,id=e17ef1fb-761f-4b49-803c-b4c55115eb7c,network=Network(39277410-6754-4b40-b1bc-9777841910ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape17ef1fb-76') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:05:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape17ef1fb-76, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:05:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:05:07 user nova-compute[72809]: INFO os_vif [None req-18c978c3-b1e4-4d4e-9d2a-0d131b03b5b6 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:53:7d,bridge_name='br-int',has_traffic_filtering=True,id=e17ef1fb-761f-4b49-803c-b4c55115eb7c,network=Network(39277410-6754-4b40-b1bc-9777841910ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape17ef1fb-76')
Aug 09 07:05:07 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-18c978c3-b1e4-4d4e-9d2a-0d131b03b5b6 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Deleting instance files /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2_del
Aug 09 07:05:07 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-18c978c3-b1e4-4d4e-9d2a-0d131b03b5b6 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Deletion of /opt/stack/data/nova/instances/40bc627e-28c9-4450-9532-bf6db60845b2_del complete
Aug 09 07:05:07 user nova-compute[72809]: INFO nova.compute.manager [None req-18c978c3-b1e4-4d4e-9d2a-0d131b03b5b6 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 09 07:05:07 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-18c978c3-b1e4-4d4e-9d2a-0d131b03b5b6 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:05:07 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:05:07 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:05:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:08 user nova-compute[72809]: DEBUG nova.compute.manager [req-8551b3d8-5c8f-4105-8320-8cced0f78ec3 req-85f47d1c-c9c9-44ab-bb5c-288dd6ea9e94 service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Received event network-vif-deleted-e17ef1fb-761f-4b49-803c-b4c55115eb7c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:05:08 user nova-compute[72809]: INFO nova.compute.manager [req-8551b3d8-5c8f-4105-8320-8cced0f78ec3 req-85f47d1c-c9c9-44ab-bb5c-288dd6ea9e94 service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Neutron deleted interface e17ef1fb-761f-4b49-803c-b4c55115eb7c; detaching it from the instance and deleting it from the info cache
Aug 09 07:05:08 user nova-compute[72809]: DEBUG nova.network.neutron [req-8551b3d8-5c8f-4105-8320-8cced0f78ec3 req-85f47d1c-c9c9-44ab-bb5c-288dd6ea9e94 service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:05:08 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:05:08 user nova-compute[72809]: DEBUG nova.compute.manager [req-8551b3d8-5c8f-4105-8320-8cced0f78ec3 req-85f47d1c-c9c9-44ab-bb5c-288dd6ea9e94 service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Detach interface failed, port_id=e17ef1fb-761f-4b49-803c-b4c55115eb7c, reason: Instance 40bc627e-28c9-4450-9532-bf6db60845b2 could not be found. {{(pid=72809) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 07:05:08 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Took 0.91 seconds to deallocate network for instance.
Aug 09 07:05:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-18c978c3-b1e4-4d4e-9d2a-0d131b03b5b6 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-18c978c3-b1e4-4d4e-9d2a-0d131b03b5b6 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:08 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-18c978c3-b1e4-4d4e-9d2a-0d131b03b5b6 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Refreshing inventories for resource provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 07:05:08 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-18c978c3-b1e4-4d4e-9d2a-0d131b03b5b6 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Updating ProviderTree inventory for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 07:05:08 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-18c978c3-b1e4-4d4e-9d2a-0d131b03b5b6 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Updating inventory in ProviderTree for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 07:05:09 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-18c978c3-b1e4-4d4e-9d2a-0d131b03b5b6 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Refreshing aggregate associations for resource provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3, aggregates: None {{(pid=72809) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 07:05:09 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-18c978c3-b1e4-4d4e-9d2a-0d131b03b5b6 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Refreshing trait associations for resource provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI {{(pid=72809) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 07:05:09 user nova-compute[72809]: DEBUG nova.compute.manager [req-9744f603-ba94-4e9d-95d0-9ad14eb4a220 req-2715ffe6-f9be-4368-bb10-955281d70ec9 service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Received event network-vif-plugged-e17ef1fb-761f-4b49-803c-b4c55115eb7c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:05:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9744f603-ba94-4e9d-95d0-9ad14eb4a220 req-2715ffe6-f9be-4368-bb10-955281d70ec9 service nova] Acquiring lock "40bc627e-28c9-4450-9532-bf6db60845b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9744f603-ba94-4e9d-95d0-9ad14eb4a220 req-2715ffe6-f9be-4368-bb10-955281d70ec9 service nova] Lock "40bc627e-28c9-4450-9532-bf6db60845b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9744f603-ba94-4e9d-95d0-9ad14eb4a220 req-2715ffe6-f9be-4368-bb10-955281d70ec9 service nova] Lock "40bc627e-28c9-4450-9532-bf6db60845b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:09 user nova-compute[72809]: DEBUG nova.compute.manager [req-9744f603-ba94-4e9d-95d0-9ad14eb4a220 req-2715ffe6-f9be-4368-bb10-955281d70ec9 service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] No waiting events found dispatching network-vif-plugged-e17ef1fb-761f-4b49-803c-b4c55115eb7c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:05:09 user nova-compute[72809]: WARNING nova.compute.manager [req-9744f603-ba94-4e9d-95d0-9ad14eb4a220 req-2715ffe6-f9be-4368-bb10-955281d70ec9 service nova] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Received unexpected event network-vif-plugged-e17ef1fb-761f-4b49-803c-b4c55115eb7c for instance with vm_state deleted and task_state None.
Aug 09 07:05:09 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-18c978c3-b1e4-4d4e-9d2a-0d131b03b5b6 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:05:09 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-18c978c3-b1e4-4d4e-9d2a-0d131b03b5b6 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:05:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-18c978c3-b1e4-4d4e-9d2a-0d131b03b5b6 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.667s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:09 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-18c978c3-b1e4-4d4e-9d2a-0d131b03b5b6 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Deleted allocations for instance 40bc627e-28c9-4450-9532-bf6db60845b2
Aug 09 07:05:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-18c978c3-b1e4-4d4e-9d2a-0d131b03b5b6 tempest-AttachVolumeShelveTestJSON-1006961404 tempest-AttachVolumeShelveTestJSON-1006961404-project-member] Lock "40bc627e-28c9-4450-9532-bf6db60845b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.676s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:11 user nova-compute[72809]: DEBUG nova.compute.manager [req-0908d043-f8ac-4f7f-b7ba-8c39a5bdb2d4 req-82c5648c-a76c-49a9-9046-6ab859deb757 service nova] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Received event network-changed-5bd22d17-9a8a-41ce-b164-16812b74fdcd {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:05:11 user nova-compute[72809]: DEBUG nova.compute.manager [req-0908d043-f8ac-4f7f-b7ba-8c39a5bdb2d4 req-82c5648c-a76c-49a9-9046-6ab859deb757 service nova] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Refreshing instance network info cache due to event network-changed-5bd22d17-9a8a-41ce-b164-16812b74fdcd. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:05:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0908d043-f8ac-4f7f-b7ba-8c39a5bdb2d4 req-82c5648c-a76c-49a9-9046-6ab859deb757 service nova] Acquiring lock "refresh_cache-a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:05:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0908d043-f8ac-4f7f-b7ba-8c39a5bdb2d4 req-82c5648c-a76c-49a9-9046-6ab859deb757 service nova] Acquired lock "refresh_cache-a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:05:11 user nova-compute[72809]: DEBUG nova.network.neutron [req-0908d043-f8ac-4f7f-b7ba-8c39a5bdb2d4 req-82c5648c-a76c-49a9-9046-6ab859deb757 service nova] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Refreshing network info cache for port 5bd22d17-9a8a-41ce-b164-16812b74fdcd {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:05:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Acquiring lock "a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:12 user nova-compute[72809]: DEBUG nova.network.neutron [req-0908d043-f8ac-4f7f-b7ba-8c39a5bdb2d4 req-82c5648c-a76c-49a9-9046-6ab859deb757 service nova] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Updated VIF entry in instance network info cache for port 5bd22d17-9a8a-41ce-b164-16812b74fdcd. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:05:12 user nova-compute[72809]: DEBUG nova.network.neutron [req-0908d043-f8ac-4f7f-b7ba-8c39a5bdb2d4 req-82c5648c-a76c-49a9-9046-6ab859deb757 service nova] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Updating instance_info_cache with network_info: [{"id": "5bd22d17-9a8a-41ce-b164-16812b74fdcd", "address": "fa:16:3e:d7:36:8c", "network": {"id": "aaea335c-52d5-402b-b53c-b53cc3d7385d", "bridge": "br-int", "label": "tempest-TestStampPattern-1348939935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77be39d2ba434d42bd6b08194503031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd22d17-9a", "ovs_interfaceid": "5bd22d17-9a8a-41ce-b164-16812b74fdcd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:05:12 user nova-compute[72809]: DEBUG nova.objects.instance [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lazy-loading 'flavor' on Instance uuid a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:05:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0908d043-f8ac-4f7f-b7ba-8c39a5bdb2d4 req-82c5648c-a76c-49a9-9046-6ab859deb757 service nova] Releasing lock "refresh_cache-a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:05:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Acquiring lock "a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:12 user nova-compute[72809]: INFO nova.compute.manager [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Attaching volume 46bc503b-7daa-4462-ab53-05a9ebf9b329 to /dev/vdb
Aug 09 07:05:12 user nova-compute[72809]: DEBUG os_brick.utils [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:05:12 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:12 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:12 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[eade63f8-b58c-4c8c-a6b2-6e7cfd2b74cb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:05:12 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:12 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:12 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaabfa6a-0231-429d-b64c-9eafa9e110b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:05:12 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:12 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:12 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[8544df87-4abd-4735-8bb6-41618b186137]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:05:12 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9038f1ff-2f07-4f50-b429-9b7225d84613]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:05:12 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:12 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:05:12 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 07:05:12 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:12 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:05:12 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 07:05:12 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cf875d-487f-48fd-b636-c01609ade19c]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:05:12 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 07:05:12 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 07:05:12 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 07:05:12 user nova-compute[72809]: DEBUG os_brick.utils [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:05:12 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Updating existing volume attachment record: 8f7071e5-3a8f-4480-ba43-a00be827f86a {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 07:05:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:17 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691564702.4547157, b5cab676-b3c0-4f05-9e44-42e5a6677857 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:05:17 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] VM Stopped (Lifecycle Event)
Aug 09 07:05:17 user nova-compute[72809]: DEBUG nova.compute.manager [None req-30f14dca-6e80-4c23-9813-b92247d303fd None None] [instance: b5cab676-b3c0-4f05-9e44-42e5a6677857] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:05:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SAyjPZXd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:05:21 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:05:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:05:21 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:05:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:05:21 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 07:05:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329 -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[8468f748-a6c2-4c29-be6f-ef0caeddffb6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 07:05:21 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329 -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2c5d07-0910-483d-8629-a56ce86bad45]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329] added
Aug 09 07:05:21 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d72372-2f19-49c0-954f-43ee703f7c13]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c017255-9d87-45a3-8c4e-23e07c393576]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SAyjPZXd {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SAyjPZXd" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b292e16e-2b2d-472a-b009-9f9fcbbb66b1]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SAyjPZXd'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[53961b39-c3a3-4366-9459-aa27bac7be1b]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[be746f55-4d9b-4d84-a186-6f47631bec80]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:05:21 user nova-compute[72809]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:05:21 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:05:21 user nova-compute[72809]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:05:21 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329 -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[12023b2e-68b0-47ed-a376-27afe3e9a33e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329, portal: 172.16.0.220,3260]
Aug 09 07:05:21 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329, portal: 172.16.0.220,3260] successful.
Aug 09 07:05:21 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf5bfe2-0beb-44fa-ad7d-d37c7fb60ac6]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6f1f10-f545-48ab-82c9-3022fe1b780a]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:05:21 user nova-compute[72809]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:05:21 user nova-compute[72809]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329 (non-flash)
Aug 09 07:05:21 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:05:21 user nova-compute[72809]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:05:21 user nova-compute[72809]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329 (non-flash)
Aug 09 07:05:21 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f626fd2-33d5-4e5f-8730-562e135178e4]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:05:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SAyjPZXd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 07:05:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:05:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23638643937646139', 'path': '/dev/sdd'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:05:22 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638643937646139', 'path': '/dev/sdd'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 07:05:22 user nova-compute[72809]: DEBUG nova.objects.instance [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lazy-loading 'flavor' on Instance uuid a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:05:22 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 07:05:22 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:05:22 user nova-compute[72809]:   <source dev="/dev/sdd"/>
Aug 09 07:05:22 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:05:22 user nova-compute[72809]:   <serial>46bc503b-7daa-4462-ab53-05a9ebf9b329</serial>
Aug 09 07:05:22 user nova-compute[72809]: </disk>
Aug 09 07:05:22 user nova-compute[72809]:  {{(pid=72809) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 07:05:22 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691564707.79538, 40bc627e-28c9-4450-9532-bf6db60845b2 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:05:22 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] VM Stopped (Lifecycle Event)
Aug 09 07:05:22 user nova-compute[72809]: DEBUG nova.compute.manager [None req-87d8a175-33fb-470a-a677-26cf73da03c7 None None] [instance: 40bc627e-28c9-4450-9532-bf6db60845b2] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:05:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:22 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:05:22 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:05:22 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] No VIF found with MAC fa:16:3e:d7:36:8c, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:05:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cfbc31fa-8dba-4514-a61a-602193bfd66c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.506s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Acquiring lock "a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:24 user nova-compute[72809]: INFO nova.compute.manager [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Detaching volume 46bc503b-7daa-4462-ab53-05a9ebf9b329
Aug 09 07:05:24 user nova-compute[72809]: INFO nova.virt.block_device [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Attempting to driver detach volume 46bc503b-7daa-4462-ab53-05a9ebf9b329 from mountpoint /dev/vdb
Aug 09 07:05:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Attempting to detach device vdb from instance a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa from the persistent domain config. {{(pid=72809) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 07:05:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:05:24 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:05:24 user nova-compute[72809]:   <source dev="/dev/sdd"/>
Aug 09 07:05:24 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:05:24 user nova-compute[72809]:   <serial>46bc503b-7daa-4462-ab53-05a9ebf9b329</serial>
Aug 09 07:05:24 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 07:05:24 user nova-compute[72809]: </disk>
Aug 09 07:05:24 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:05:24 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Successfully detached device vdb from instance a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa from the persistent domain config.
Aug 09 07:05:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa from the live domain config. {{(pid=72809) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 07:05:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:05:24 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:05:24 user nova-compute[72809]:   <source dev="/dev/sdd"/>
Aug 09 07:05:24 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:05:24 user nova-compute[72809]:   <serial>46bc503b-7daa-4462-ab53-05a9ebf9b329</serial>
Aug 09 07:05:24 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 07:05:24 user nova-compute[72809]: </disk>
Aug 09 07:05:24 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Received event <DeviceRemovedEvent: 1691564725.097381, a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72809) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa {{(pid=72809) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 07:05:25 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Successfully detached device vdb from instance a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa from the live domain config.
Aug 09 07:05:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SAyjPZXd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:05:25 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:05:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[476873b3-0272-4f98-af58-74d3d98e3fb0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[24002cff-fa40-4fe4-90d7-009cb7ba26f9]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:05:25 user nova-compute[72809]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:05:25 user nova-compute[72809]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329 (non-flash)
Aug 09 07:05:25 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:05:25 user nova-compute[72809]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:05:25 user nova-compute[72809]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329 (non-flash)
Aug 09 07:05:25 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc1385cf910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329'): ({'sdd'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Removing single pathed devices sdd {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fdbb2d-82e1-412d-b587-3156128b3778]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ec136f-2039-4a07-8a53-e918b9756a90]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Flushing IO for device /dev/sdd {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed05ba9d-013f-4b6e-9fa1-7e9880e09085]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[22048b59-4903-4105-939e-a406084c2d1d]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] SCSI volumes sdd have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[302d063f-a56f-43f6-ae16-c2a6532e13a1]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329 -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b646b3-6724-4474-ab5c-9ac96d8f222a]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329, portal: 172.16.0.220,3260]
Aug 09 07:05:25 user nova-compute[72809]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329, portal: 172.16.0.220,3260] successful.
Aug 09 07:05:25 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329 -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46bc503b-7daa-4462-ab53-05a9ebf9b329 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c9a435-5c40-40bc-ad52-fbe49f1d6e3e]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] <== disconnect_volume: return (266ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:05:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:05:26 user nova-compute[72809]: DEBUG nova.objects.instance [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lazy-loading 'flavor' on Instance uuid a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:05:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-fb55de88-e4c0-4318-b5a5-7217405c109d tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.558s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:32 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._sync_power_states {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Triggering sync for uuid 336770eb-4f09-4134-92ef-f96039bf4fa9 {{(pid=72809) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Triggering sync for uuid 1bde423f-0b73-448f-bdce-8d6af96d8fc6 {{(pid=72809) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Triggering sync for uuid bebd5a14-6272-4de1-a1a1-4fb45b867c7f {{(pid=72809) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Triggering sync for uuid 339372ed-140d-4226-ba00-2cc682214d5c {{(pid=72809) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Triggering sync for uuid 38319c37-9cc0-4e84-8415-ddcf37451daf {{(pid=72809) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Triggering sync for uuid 51432417-89cc-4cee-855d-c4b148e4bd37 {{(pid=72809) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Triggering sync for uuid 466a8e58-5f88-4ffe-a7fd-a346003f3508 {{(pid=72809) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Triggering sync for uuid a754327a-9985-4430-af66-1d8bc82fb868 {{(pid=72809) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Triggering sync for uuid a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa {{(pid=72809) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Triggering sync for uuid 63936bb9-97de-4a87-aa29-14129104c1d3 {{(pid=72809) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "336770eb-4f09-4134-92ef-f96039bf4fa9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "336770eb-4f09-4134-92ef-f96039bf4fa9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "339372ed-140d-4226-ba00-2cc682214d5c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "339372ed-140d-4226-ba00-2cc682214d5c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "38319c37-9cc0-4e84-8415-ddcf37451daf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "38319c37-9cc0-4e84-8415-ddcf37451daf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "51432417-89cc-4cee-855d-c4b148e4bd37" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "51432417-89cc-4cee-855d-c4b148e4bd37" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "466a8e58-5f88-4ffe-a7fd-a346003f3508" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "a754327a-9985-4430-af66-1d8bc82fb868" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "a754327a-9985-4430-af66-1d8bc82fb868" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "63936bb9-97de-4a87-aa29-14129104c1d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "63936bb9-97de-4a87-aa29-14129104c1d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "336770eb-4f09-4134-92ef-f96039bf4fa9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "38319c37-9cc0-4e84-8415-ddcf37451daf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "51432417-89cc-4cee-855d-c4b148e4bd37" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "339372ed-140d-4226-ba00-2cc682214d5c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "a754327a-9985-4430-af66-1d8bc82fb868" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "63936bb9-97de-4a87-aa29-14129104c1d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:34 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:05:34 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 07:05:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-38319c37-9cc0-4e84-8415-ddcf37451daf" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:05:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-38319c37-9cc0-4e84-8415-ddcf37451daf" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:05:34 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 07:05:35 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Updating instance_info_cache with network_info: [{"id": "1b035fe4-63e9-43eb-9cd1-c7daa830c393", "address": "fa:16:3e:6f:5e:56", "network": {"id": "957d253a-5f0b-4a0d-89e0-5a4ee590929b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1432478722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb54b76021d41c3b047dcad448441d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b035fe4-63", "ovs_interfaceid": "1b035fe4-63e9-43eb-9cd1-c7daa830c393", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:05:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-38319c37-9cc0-4e84-8415-ddcf37451daf" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:05:35 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 07:05:37 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:05:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:37 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 07:05:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:38 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:05:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:05:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:41 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:05:41 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:05:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=7458MB free_disk=25.056987762451172GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 07:05:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Applying migration context for instance a754327a-9985-4430-af66-1d8bc82fb868 as it has an incoming, in-progress migration e576542e-d733-40bc-8749-08b38fac6842. Migration status is finished {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 09 07:05:41 user nova-compute[72809]: INFO nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Updating resource usage from migration e576542e-d733-40bc-8749-08b38fac6842
Aug 09 07:05:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 336770eb-4f09-4134-92ef-f96039bf4fa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:05:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 1bde423f-0b73-448f-bdce-8d6af96d8fc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:05:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance bebd5a14-6272-4de1-a1a1-4fb45b867c7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:05:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 339372ed-140d-4226-ba00-2cc682214d5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:05:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 38319c37-9cc0-4e84-8415-ddcf37451daf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:05:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 51432417-89cc-4cee-855d-c4b148e4bd37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:05:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 466a8e58-5f88-4ffe-a7fd-a346003f3508 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:05:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:05:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Migration e576542e-d733-40bc-8749-08b38fac6842 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 09 07:05:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance a754327a-9985-4430-af66-1d8bc82fb868 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:05:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 63936bb9-97de-4a87-aa29-14129104c1d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:05:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 07:05:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 07:05:41 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:05:41 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:05:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 07:05:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.474s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:05:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72809) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 07:05:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:05:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:05:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:43 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:43 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:05:43 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:05:43 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:05:43 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:05:44 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:05:45 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:05:46 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:05:46 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 07:05:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "6e9996e8-c5eb-42c1-b88f-d75654e160c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "6e9996e8-c5eb-42c1-b88f-d75654e160c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:54 user nova-compute[72809]: DEBUG nova.compute.manager [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 07:05:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:54 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 07:05:54 user nova-compute[72809]: INFO nova.compute.claims [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Claim successful on node user
Aug 09 07:05:55 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:05:55 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:05:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.507s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:55 user nova-compute[72809]: DEBUG nova.compute.manager [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 07:05:55 user nova-compute[72809]: DEBUG nova.compute.manager [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 07:05:55 user nova-compute[72809]: DEBUG nova.network.neutron [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 07:05:55 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 07:05:55 user nova-compute[72809]: DEBUG nova.compute.manager [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 07:05:55 user nova-compute[72809]: DEBUG nova.policy [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c4c5942852b412885a5b4698552058d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1903437f7ed4c14a0660f64a2e0c647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 07:05:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "b3249e5c-5657-4c08-8ada-50820d9955d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "b3249e5c-5657-4c08-8ada-50820d9955d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:55 user nova-compute[72809]: DEBUG nova.compute.manager [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 07:05:55 user nova-compute[72809]: DEBUG nova.compute.manager [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 07:05:55 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 07:05:55 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Creating image(s)
Aug 09 07:05:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "/opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "/opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "/opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:55 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 07:05:55 user nova-compute[72809]: INFO nova.compute.claims [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Claim successful on node user
Aug 09 07:05:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.144s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.159s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk 1073741824" returned: 0 in 0.057s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.147s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:55 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 07:05:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:55 user nova-compute[72809]: DEBUG nova.network.neutron [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Successfully created port: c0891ee7-fd99-4abf-96bd-9389e7032aab {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 07:05:56 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:56 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Cannot resize image /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 07:05:56 user nova-compute[72809]: DEBUG nova.objects.instance [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lazy-loading 'migration_context' on Instance uuid 6e9996e8-c5eb-42c1-b88f-d75654e160c5 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:05:56 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:05:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 07:05:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Ensure instance console log exists: /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 07:05:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:56 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:05:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.638s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:56 user nova-compute[72809]: DEBUG nova.compute.manager [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 07:05:56 user nova-compute[72809]: DEBUG nova.compute.manager [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 07:05:56 user nova-compute[72809]: DEBUG nova.network.neutron [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 07:05:56 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 07:05:56 user nova-compute[72809]: DEBUG nova.compute.manager [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 07:05:56 user nova-compute[72809]: DEBUG nova.policy [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f85a1f2a88fd40a48d1c4dba13f0ac09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce7c486aaca4ef89eb7e392b717e3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 07:05:56 user nova-compute[72809]: DEBUG nova.compute.manager [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 07:05:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 07:05:56 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Creating image(s)
Aug 09 07:05:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "/opt/stack/data/nova/instances/b3249e5c-5657-4c08-8ada-50820d9955d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "/opt/stack/data/nova/instances/b3249e5c-5657-4c08-8ada-50820d9955d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "/opt/stack/data/nova/instances/b3249e5c-5657-4c08-8ada-50820d9955d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:56 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:56 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.166s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:56 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:56 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.160s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:56 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/b3249e5c-5657-4c08-8ada-50820d9955d4/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:56 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/b3249e5c-5657-4c08-8ada-50820d9955d4/disk 1073741824" returned: 0 in 0.063s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:56 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:56 user nova-compute[72809]: DEBUG nova.network.neutron [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Successfully created port: fa550cf1-3f73-4435-a6fe-91752e664b2f {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 07:05:56 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.164s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:56 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b3249e5c-5657-4c08-8ada-50820d9955d4/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 07:05:56 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3249e5c-5657-4c08-8ada-50820d9955d4/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.network.neutron [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Successfully updated port: c0891ee7-fd99-4abf-96bd-9389e7032aab {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "refresh_cache-6e9996e8-c5eb-42c1-b88f-d75654e160c5" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquired lock "refresh_cache-6e9996e8-c5eb-42c1-b88f-d75654e160c5" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.network.neutron [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.compute.manager [req-36f2eb5d-7453-4f05-adcd-6e508f6184da req-a478efc8-9bde-48da-91b2-f731210d098b service nova] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Received event network-changed-c0891ee7-fd99-4abf-96bd-9389e7032aab {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.compute.manager [req-36f2eb5d-7453-4f05-adcd-6e508f6184da req-a478efc8-9bde-48da-91b2-f731210d098b service nova] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Refreshing instance network info cache due to event network-changed-c0891ee7-fd99-4abf-96bd-9389e7032aab. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-36f2eb5d-7453-4f05-adcd-6e508f6184da req-a478efc8-9bde-48da-91b2-f731210d098b service nova] Acquiring lock "refresh_cache-6e9996e8-c5eb-42c1-b88f-d75654e160c5" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3249e5c-5657-4c08-8ada-50820d9955d4/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Cannot resize image /opt/stack/data/nova/instances/b3249e5c-5657-4c08-8ada-50820d9955d4/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.objects.instance [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lazy-loading 'migration_context' on Instance uuid b3249e5c-5657-4c08-8ada-50820d9955d4 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Ensure instance console log exists: /opt/stack/data/nova/instances/b3249e5c-5657-4c08-8ada-50820d9955d4/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.network.neutron [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.network.neutron [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Updating instance_info_cache with network_info: [{"id": "c0891ee7-fd99-4abf-96bd-9389e7032aab", "address": "fa:16:3e:09:83:0c", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0891ee7-fd", "ovs_interfaceid": "c0891ee7-fd99-4abf-96bd-9389e7032aab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Releasing lock "refresh_cache-6e9996e8-c5eb-42c1-b88f-d75654e160c5" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.compute.manager [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Instance network_info: |[{"id": "c0891ee7-fd99-4abf-96bd-9389e7032aab", "address": "fa:16:3e:09:83:0c", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0891ee7-fd", "ovs_interfaceid": "c0891ee7-fd99-4abf-96bd-9389e7032aab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-36f2eb5d-7453-4f05-adcd-6e508f6184da req-a478efc8-9bde-48da-91b2-f731210d098b service nova] Acquired lock "refresh_cache-6e9996e8-c5eb-42c1-b88f-d75654e160c5" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.network.neutron [req-36f2eb5d-7453-4f05-adcd-6e508f6184da req-a478efc8-9bde-48da-91b2-f731210d098b service nova] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Refreshing network info cache for port c0891ee7-fd99-4abf-96bd-9389e7032aab {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Start _get_guest_xml network_info=[{"id": "c0891ee7-fd99-4abf-96bd-9389e7032aab", "address": "fa:16:3e:09:83:0c", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0891ee7-fd", "ovs_interfaceid": "c0891ee7-fd99-4abf-96bd-9389e7032aab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 07:05:57 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:05:57 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:05:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1926053306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1926053306',id=36,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1903437f7ed4c14a0660f64a2e0c647',ramdisk_id='',reservation_id='r-p904gqch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-917311946',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:05:55Z,user_data=None,user_id='6c4c5942852b412885a5b4698552058d',uuid=6e9996e8-c5eb-42c1-b88f-d75654e160c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0891ee7-fd99-4abf-96bd-9389e7032aab", "address": "fa:16:3e:09:83:0c", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0891ee7-fd", "ovs_interfaceid": "c0891ee7-fd99-4abf-96bd-9389e7032aab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Converting VIF {"id": "c0891ee7-fd99-4abf-96bd-9389e7032aab", "address": "fa:16:3e:09:83:0c", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0891ee7-fd", "ovs_interfaceid": "c0891ee7-fd99-4abf-96bd-9389e7032aab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:83:0c,bridge_name='br-int',has_traffic_filtering=True,id=c0891ee7-fd99-4abf-96bd-9389e7032aab,network=Network(5f03b0f9-e80d-428f-b0a6-57158568e620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0891ee7-fd') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.objects.instance [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e9996e8-c5eb-42c1-b88f-d75654e160c5 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] End _get_guest_xml xml=<domain type="kvm">
Aug 09 07:05:57 user nova-compute[72809]:   <uuid>6e9996e8-c5eb-42c1-b88f-d75654e160c5</uuid>
Aug 09 07:05:57 user nova-compute[72809]:   <name>instance-00000024</name>
Aug 09 07:05:57 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 07:05:57 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 07:05:57 user nova-compute[72809]:   <metadata>
Aug 09 07:05:57 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 07:05:57 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 07:05:57 user nova-compute[72809]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1926053306</nova:name>
Aug 09 07:05:57 user nova-compute[72809]:       <nova:creationTime>2023-08-09 07:05:57</nova:creationTime>
Aug 09 07:05:57 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 07:05:57 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 07:05:57 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 07:05:57 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 07:05:57 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 07:05:57 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 07:05:57 user nova-compute[72809]:       </nova:flavor>
Aug 09 07:05:57 user nova-compute[72809]:       <nova:owner>
Aug 09 07:05:57 user nova-compute[72809]:         <nova:user uuid="6c4c5942852b412885a5b4698552058d">tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member</nova:user>
Aug 09 07:05:57 user nova-compute[72809]:         <nova:project uuid="b1903437f7ed4c14a0660f64a2e0c647">tempest-ServerBootFromVolumeStableRescueTest-917311946</nova:project>
Aug 09 07:05:57 user nova-compute[72809]:       </nova:owner>
Aug 09 07:05:57 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 07:05:57 user nova-compute[72809]:       <nova:ports>
Aug 09 07:05:57 user nova-compute[72809]:         <nova:port uuid="c0891ee7-fd99-4abf-96bd-9389e7032aab">
Aug 09 07:05:57 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 07:05:57 user nova-compute[72809]:         </nova:port>
Aug 09 07:05:57 user nova-compute[72809]:       </nova:ports>
Aug 09 07:05:57 user nova-compute[72809]:     </nova:instance>
Aug 09 07:05:57 user nova-compute[72809]:   </metadata>
Aug 09 07:05:57 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 07:05:57 user nova-compute[72809]:     <system>
Aug 09 07:05:57 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 07:05:57 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 07:05:57 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 07:05:57 user nova-compute[72809]:       <entry name="serial">6e9996e8-c5eb-42c1-b88f-d75654e160c5</entry>
Aug 09 07:05:57 user nova-compute[72809]:       <entry name="uuid">6e9996e8-c5eb-42c1-b88f-d75654e160c5</entry>
Aug 09 07:05:57 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 07:05:57 user nova-compute[72809]:     </system>
Aug 09 07:05:57 user nova-compute[72809]:   </sysinfo>
Aug 09 07:05:57 user nova-compute[72809]:   <os>
Aug 09 07:05:57 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 07:05:57 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 07:05:57 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 07:05:57 user nova-compute[72809]:   </os>
Aug 09 07:05:57 user nova-compute[72809]:   <features>
Aug 09 07:05:57 user nova-compute[72809]:     <acpi/>
Aug 09 07:05:57 user nova-compute[72809]:     <apic/>
Aug 09 07:05:57 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 07:05:57 user nova-compute[72809]:   </features>
Aug 09 07:05:57 user nova-compute[72809]:   <clock offset="utc">
Aug 09 07:05:57 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 07:05:57 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 07:05:57 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 07:05:57 user nova-compute[72809]:   </clock>
Aug 09 07:05:57 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 07:05:57 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 07:05:57 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 07:05:57 user nova-compute[72809]:   </cpu>
Aug 09 07:05:57 user nova-compute[72809]:   <devices>
Aug 09 07:05:57 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 07:05:57 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 07:05:57 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk"/>
Aug 09 07:05:57 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 07:05:57 user nova-compute[72809]:     </disk>
Aug 09 07:05:57 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 07:05:57 user nova-compute[72809]:       <mac address="fa:16:3e:09:83:0c"/>
Aug 09 07:05:57 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:05:57 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 07:05:57 user nova-compute[72809]:       <target dev="tapc0891ee7-fd"/>
Aug 09 07:05:57 user nova-compute[72809]:     </interface>
Aug 09 07:05:57 user nova-compute[72809]:     <serial type="pty">
Aug 09 07:05:57 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/console.log" append="off"/>
Aug 09 07:05:57 user nova-compute[72809]:     </serial>
Aug 09 07:05:57 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 07:05:57 user nova-compute[72809]:     <video>
Aug 09 07:05:57 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:05:57 user nova-compute[72809]:     </video>
Aug 09 07:05:57 user nova-compute[72809]:     <rng model="virtio">
Aug 09 07:05:57 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 07:05:57 user nova-compute[72809]:     </rng>
Aug 09 07:05:57 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 07:05:57 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 07:05:57 user nova-compute[72809]:       <stats period="10"/>
Aug 09 07:05:57 user nova-compute[72809]:     </memballoon>
Aug 09 07:05:57 user nova-compute[72809]:   </devices>
Aug 09 07:05:57 user nova-compute[72809]: </domain>
Aug 09 07:05:57 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:05:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1926053306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1926053306',id=36,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1903437f7ed4c14a0660f64a2e0c647',ramdisk_id='',reservation_id='r-p904gqch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-917311946',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:05:55Z,user_data=None,user_id='6c4c5942852b412885a5b4698552058d',uuid=6e9996e8-c5eb-42c1-b88f-d75654e160c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0891ee7-fd99-4abf-96bd-9389e7032aab", "address": "fa:16:3e:09:83:0c", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0891ee7-fd", "ovs_interfaceid": "c0891ee7-fd99-4abf-96bd-9389e7032aab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Converting VIF {"id": "c0891ee7-fd99-4abf-96bd-9389e7032aab", "address": "fa:16:3e:09:83:0c", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0891ee7-fd", "ovs_interfaceid": "c0891ee7-fd99-4abf-96bd-9389e7032aab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:83:0c,bridge_name='br-int',has_traffic_filtering=True,id=c0891ee7-fd99-4abf-96bd-9389e7032aab,network=Network(5f03b0f9-e80d-428f-b0a6-57158568e620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0891ee7-fd') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG os_vif [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:83:0c,bridge_name='br-int',has_traffic_filtering=True,id=c0891ee7-fd99-4abf-96bd-9389e7032aab,network=Network(5f03b0f9-e80d-428f-b0a6-57158568e620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0891ee7-fd') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0891ee7-fd, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc0891ee7-fd, col_values=(('external_ids', {'iface-id': 'c0891ee7-fd99-4abf-96bd-9389e7032aab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:83:0c', 'vm-uuid': '6e9996e8-c5eb-42c1-b88f-d75654e160c5'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:57 user nova-compute[72809]: INFO os_vif [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:83:0c,bridge_name='br-int',has_traffic_filtering=True,id=c0891ee7-fd99-4abf-96bd-9389e7032aab,network=Network(5f03b0f9-e80d-428f-b0a6-57158568e620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0891ee7-fd')
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.network.neutron [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Successfully updated port: fa550cf1-3f73-4435-a6fe-91752e664b2f {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] No VIF found with MAC fa:16:3e:09:83:0c, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "refresh_cache-b3249e5c-5657-4c08-8ada-50820d9955d4" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquired lock "refresh_cache-b3249e5c-5657-4c08-8ada-50820d9955d4" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.network.neutron [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.compute.manager [req-9257d389-815a-4ae5-be2f-f49880190a98 req-c1bf9a0f-cb9b-4fea-8f18-cda0f7d28781 service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Received event network-changed-fa550cf1-3f73-4435-a6fe-91752e664b2f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.compute.manager [req-9257d389-815a-4ae5-be2f-f49880190a98 req-c1bf9a0f-cb9b-4fea-8f18-cda0f7d28781 service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Refreshing instance network info cache due to event network-changed-fa550cf1-3f73-4435-a6fe-91752e664b2f. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9257d389-815a-4ae5-be2f-f49880190a98 req-c1bf9a0f-cb9b-4fea-8f18-cda0f7d28781 service nova] Acquiring lock "refresh_cache-b3249e5c-5657-4c08-8ada-50820d9955d4" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:05:57 user nova-compute[72809]: DEBUG nova.network.neutron [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.network.neutron [req-36f2eb5d-7453-4f05-adcd-6e508f6184da req-a478efc8-9bde-48da-91b2-f731210d098b service nova] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Updated VIF entry in instance network info cache for port c0891ee7-fd99-4abf-96bd-9389e7032aab. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.network.neutron [req-36f2eb5d-7453-4f05-adcd-6e508f6184da req-a478efc8-9bde-48da-91b2-f731210d098b service nova] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Updating instance_info_cache with network_info: [{"id": "c0891ee7-fd99-4abf-96bd-9389e7032aab", "address": "fa:16:3e:09:83:0c", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0891ee7-fd", "ovs_interfaceid": "c0891ee7-fd99-4abf-96bd-9389e7032aab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-36f2eb5d-7453-4f05-adcd-6e508f6184da req-a478efc8-9bde-48da-91b2-f731210d098b service nova] Releasing lock "refresh_cache-6e9996e8-c5eb-42c1-b88f-d75654e160c5" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.network.neutron [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Updating instance_info_cache with network_info: [{"id": "fa550cf1-3f73-4435-a6fe-91752e664b2f", "address": "fa:16:3e:06:e6:0d", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa550cf1-3f", "ovs_interfaceid": "fa550cf1-3f73-4435-a6fe-91752e664b2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Releasing lock "refresh_cache-b3249e5c-5657-4c08-8ada-50820d9955d4" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.compute.manager [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Instance network_info: |[{"id": "fa550cf1-3f73-4435-a6fe-91752e664b2f", "address": "fa:16:3e:06:e6:0d", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa550cf1-3f", "ovs_interfaceid": "fa550cf1-3f73-4435-a6fe-91752e664b2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9257d389-815a-4ae5-be2f-f49880190a98 req-c1bf9a0f-cb9b-4fea-8f18-cda0f7d28781 service nova] Acquired lock "refresh_cache-b3249e5c-5657-4c08-8ada-50820d9955d4" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.network.neutron [req-9257d389-815a-4ae5-be2f-f49880190a98 req-c1bf9a0f-cb9b-4fea-8f18-cda0f7d28781 service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Refreshing network info cache for port fa550cf1-3f73-4435-a6fe-91752e664b2f {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Start _get_guest_xml network_info=[{"id": "fa550cf1-3f73-4435-a6fe-91752e664b2f", "address": "fa:16:3e:06:e6:0d", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa550cf1-3f", "ovs_interfaceid": "fa550cf1-3f73-4435-a6fe-91752e664b2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 07:05:58 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:05:58 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:05:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-848619212',display_name='tempest-AttachVolumeNegativeTest-server-848619212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-848619212',id=37,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlndi3sIlOqciQr97foy8GZZULHEc5tO6L4aCSjXahCg7F+NdNWqmxdP//wJZjZ+LAqXp/OaXPR4GBBYk9MrvOrbkAOi2FO/O18Ml65Ifk4gymg7vwftV+tNWJj5tmvUg==',key_name='tempest-keypair-860100057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ce7c486aaca4ef89eb7e392b717e3d7',ramdisk_id='',reservation_id='r-lkn612ib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2066250801',owner_user_name='tempest-AttachVolumeNegativeTest-2066250801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:05:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f85a1f2a88fd40a48d1c4dba13f0ac09',uuid=b3249e5c-5657-4c08-8ada-50820d9955d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa550cf1-3f73-4435-a6fe-91752e664b2f", "address": "fa:16:3e:06:e6:0d", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa550cf1-3f", "ovs_interfaceid": "fa550cf1-3f73-4435-a6fe-91752e664b2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Converting VIF {"id": "fa550cf1-3f73-4435-a6fe-91752e664b2f", "address": "fa:16:3e:06:e6:0d", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa550cf1-3f", "ovs_interfaceid": "fa550cf1-3f73-4435-a6fe-91752e664b2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:e6:0d,bridge_name='br-int',has_traffic_filtering=True,id=fa550cf1-3f73-4435-a6fe-91752e664b2f,network=Network(1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa550cf1-3f') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.objects.instance [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lazy-loading 'pci_devices' on Instance uuid b3249e5c-5657-4c08-8ada-50820d9955d4 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] End _get_guest_xml xml=<domain type="kvm">
Aug 09 07:05:58 user nova-compute[72809]:   <uuid>b3249e5c-5657-4c08-8ada-50820d9955d4</uuid>
Aug 09 07:05:58 user nova-compute[72809]:   <name>instance-00000025</name>
Aug 09 07:05:58 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 07:05:58 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 07:05:58 user nova-compute[72809]:   <metadata>
Aug 09 07:05:58 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 07:05:58 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 07:05:58 user nova-compute[72809]:       <nova:name>tempest-AttachVolumeNegativeTest-server-848619212</nova:name>
Aug 09 07:05:58 user nova-compute[72809]:       <nova:creationTime>2023-08-09 07:05:58</nova:creationTime>
Aug 09 07:05:58 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 07:05:58 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 07:05:58 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 07:05:58 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 07:05:58 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 07:05:58 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 07:05:58 user nova-compute[72809]:       </nova:flavor>
Aug 09 07:05:58 user nova-compute[72809]:       <nova:owner>
Aug 09 07:05:58 user nova-compute[72809]:         <nova:user uuid="f85a1f2a88fd40a48d1c4dba13f0ac09">tempest-AttachVolumeNegativeTest-2066250801-project-member</nova:user>
Aug 09 07:05:58 user nova-compute[72809]:         <nova:project uuid="8ce7c486aaca4ef89eb7e392b717e3d7">tempest-AttachVolumeNegativeTest-2066250801</nova:project>
Aug 09 07:05:58 user nova-compute[72809]:       </nova:owner>
Aug 09 07:05:58 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 07:05:58 user nova-compute[72809]:       <nova:ports>
Aug 09 07:05:58 user nova-compute[72809]:         <nova:port uuid="fa550cf1-3f73-4435-a6fe-91752e664b2f">
Aug 09 07:05:58 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 07:05:58 user nova-compute[72809]:         </nova:port>
Aug 09 07:05:58 user nova-compute[72809]:       </nova:ports>
Aug 09 07:05:58 user nova-compute[72809]:     </nova:instance>
Aug 09 07:05:58 user nova-compute[72809]:   </metadata>
Aug 09 07:05:58 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 07:05:58 user nova-compute[72809]:     <system>
Aug 09 07:05:58 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 07:05:58 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 07:05:58 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 07:05:58 user nova-compute[72809]:       <entry name="serial">b3249e5c-5657-4c08-8ada-50820d9955d4</entry>
Aug 09 07:05:58 user nova-compute[72809]:       <entry name="uuid">b3249e5c-5657-4c08-8ada-50820d9955d4</entry>
Aug 09 07:05:58 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 07:05:58 user nova-compute[72809]:     </system>
Aug 09 07:05:58 user nova-compute[72809]:   </sysinfo>
Aug 09 07:05:58 user nova-compute[72809]:   <os>
Aug 09 07:05:58 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 07:05:58 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 07:05:58 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 07:05:58 user nova-compute[72809]:   </os>
Aug 09 07:05:58 user nova-compute[72809]:   <features>
Aug 09 07:05:58 user nova-compute[72809]:     <acpi/>
Aug 09 07:05:58 user nova-compute[72809]:     <apic/>
Aug 09 07:05:58 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 07:05:58 user nova-compute[72809]:   </features>
Aug 09 07:05:58 user nova-compute[72809]:   <clock offset="utc">
Aug 09 07:05:58 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 07:05:58 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 07:05:58 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 07:05:58 user nova-compute[72809]:   </clock>
Aug 09 07:05:58 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 07:05:58 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 07:05:58 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 07:05:58 user nova-compute[72809]:   </cpu>
Aug 09 07:05:58 user nova-compute[72809]:   <devices>
Aug 09 07:05:58 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 07:05:58 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 07:05:58 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/b3249e5c-5657-4c08-8ada-50820d9955d4/disk"/>
Aug 09 07:05:58 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 07:05:58 user nova-compute[72809]:     </disk>
Aug 09 07:05:58 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 07:05:58 user nova-compute[72809]:       <mac address="fa:16:3e:06:e6:0d"/>
Aug 09 07:05:58 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:05:58 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 07:05:58 user nova-compute[72809]:       <target dev="tapfa550cf1-3f"/>
Aug 09 07:05:58 user nova-compute[72809]:     </interface>
Aug 09 07:05:58 user nova-compute[72809]:     <serial type="pty">
Aug 09 07:05:58 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/b3249e5c-5657-4c08-8ada-50820d9955d4/console.log" append="off"/>
Aug 09 07:05:58 user nova-compute[72809]:     </serial>
Aug 09 07:05:58 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 07:05:58 user nova-compute[72809]:     <video>
Aug 09 07:05:58 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:05:58 user nova-compute[72809]:     </video>
Aug 09 07:05:58 user nova-compute[72809]:     <rng model="virtio">
Aug 09 07:05:58 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 07:05:58 user nova-compute[72809]:     </rng>
Aug 09 07:05:58 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 07:05:58 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 07:05:58 user nova-compute[72809]:       <stats period="10"/>
Aug 09 07:05:58 user nova-compute[72809]:     </memballoon>
Aug 09 07:05:58 user nova-compute[72809]:   </devices>
Aug 09 07:05:58 user nova-compute[72809]: </domain>
Aug 09 07:05:58 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:05:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-848619212',display_name='tempest-AttachVolumeNegativeTest-server-848619212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-848619212',id=37,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlndi3sIlOqciQr97foy8GZZULHEc5tO6L4aCSjXahCg7F+NdNWqmxdP//wJZjZ+LAqXp/OaXPR4GBBYk9MrvOrbkAOi2FO/O18Ml65Ifk4gymg7vwftV+tNWJj5tmvUg==',key_name='tempest-keypair-860100057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ce7c486aaca4ef89eb7e392b717e3d7',ramdisk_id='',reservation_id='r-lkn612ib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2066250801',owner_user_name='tempest-AttachVolumeNegativeTest-2066250801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:05:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f85a1f2a88fd40a48d1c4dba13f0ac09',uuid=b3249e5c-5657-4c08-8ada-50820d9955d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa550cf1-3f73-4435-a6fe-91752e664b2f", "address": "fa:16:3e:06:e6:0d", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa550cf1-3f", "ovs_interfaceid": "fa550cf1-3f73-4435-a6fe-91752e664b2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Converting VIF {"id": "fa550cf1-3f73-4435-a6fe-91752e664b2f", "address": "fa:16:3e:06:e6:0d", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa550cf1-3f", "ovs_interfaceid": "fa550cf1-3f73-4435-a6fe-91752e664b2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:e6:0d,bridge_name='br-int',has_traffic_filtering=True,id=fa550cf1-3f73-4435-a6fe-91752e664b2f,network=Network(1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa550cf1-3f') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG os_vif [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:e6:0d,bridge_name='br-int',has_traffic_filtering=True,id=fa550cf1-3f73-4435-a6fe-91752e664b2f,network=Network(1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa550cf1-3f') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa550cf1-3f, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfa550cf1-3f, col_values=(('external_ids', {'iface-id': 'fa550cf1-3f73-4435-a6fe-91752e664b2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:e6:0d', 'vm-uuid': 'b3249e5c-5657-4c08-8ada-50820d9955d4'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:58 user nova-compute[72809]: INFO os_vif [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:e6:0d,bridge_name='br-int',has_traffic_filtering=True,id=fa550cf1-3f73-4435-a6fe-91752e664b2f,network=Network(1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa550cf1-3f')
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] No VIF found with MAC fa:16:3e:06:e6:0d, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.network.neutron [req-9257d389-815a-4ae5-be2f-f49880190a98 req-c1bf9a0f-cb9b-4fea-8f18-cda0f7d28781 service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Updated VIF entry in instance network info cache for port fa550cf1-3f73-4435-a6fe-91752e664b2f. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG nova.network.neutron [req-9257d389-815a-4ae5-be2f-f49880190a98 req-c1bf9a0f-cb9b-4fea-8f18-cda0f7d28781 service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Updating instance_info_cache with network_info: [{"id": "fa550cf1-3f73-4435-a6fe-91752e664b2f", "address": "fa:16:3e:06:e6:0d", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa550cf1-3f", "ovs_interfaceid": "fa550cf1-3f73-4435-a6fe-91752e664b2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:05:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9257d389-815a-4ae5-be2f-f49880190a98 req-c1bf9a0f-cb9b-4fea-8f18-cda0f7d28781 service nova] Releasing lock "refresh_cache-b3249e5c-5657-4c08-8ada-50820d9955d4" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:05:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:05:59 user nova-compute[72809]: DEBUG nova.compute.manager [req-b2ed6c49-4bfe-491f-a081-659143c7e206 req-3202369c-4b1e-4fcb-931b-be9b5432d476 service nova] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Received event network-vif-plugged-c0891ee7-fd99-4abf-96bd-9389e7032aab {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:05:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b2ed6c49-4bfe-491f-a081-659143c7e206 req-3202369c-4b1e-4fcb-931b-be9b5432d476 service nova] Acquiring lock "6e9996e8-c5eb-42c1-b88f-d75654e160c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:05:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b2ed6c49-4bfe-491f-a081-659143c7e206 req-3202369c-4b1e-4fcb-931b-be9b5432d476 service nova] Lock "6e9996e8-c5eb-42c1-b88f-d75654e160c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:05:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b2ed6c49-4bfe-491f-a081-659143c7e206 req-3202369c-4b1e-4fcb-931b-be9b5432d476 service nova] Lock "6e9996e8-c5eb-42c1-b88f-d75654e160c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:05:59 user nova-compute[72809]: DEBUG nova.compute.manager [req-b2ed6c49-4bfe-491f-a081-659143c7e206 req-3202369c-4b1e-4fcb-931b-be9b5432d476 service nova] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] No waiting events found dispatching network-vif-plugged-c0891ee7-fd99-4abf-96bd-9389e7032aab {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:05:59 user nova-compute[72809]: WARNING nova.compute.manager [req-b2ed6c49-4bfe-491f-a081-659143c7e206 req-3202369c-4b1e-4fcb-931b-be9b5432d476 service nova] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Received unexpected event network-vif-plugged-c0891ee7-fd99-4abf-96bd-9389e7032aab for instance with vm_state building and task_state spawning.
Aug 09 07:06:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:00 user nova-compute[72809]: DEBUG nova.compute.manager [req-1f038c18-8431-4940-bc7b-af380ecdf6bc req-dca2649a-6384-4faa-b9e5-b9d2788495e4 service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Received event network-vif-plugged-fa550cf1-3f73-4435-a6fe-91752e664b2f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:06:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1f038c18-8431-4940-bc7b-af380ecdf6bc req-dca2649a-6384-4faa-b9e5-b9d2788495e4 service nova] Acquiring lock "b3249e5c-5657-4c08-8ada-50820d9955d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:06:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1f038c18-8431-4940-bc7b-af380ecdf6bc req-dca2649a-6384-4faa-b9e5-b9d2788495e4 service nova] Lock "b3249e5c-5657-4c08-8ada-50820d9955d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:06:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1f038c18-8431-4940-bc7b-af380ecdf6bc req-dca2649a-6384-4faa-b9e5-b9d2788495e4 service nova] Lock "b3249e5c-5657-4c08-8ada-50820d9955d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:06:00 user nova-compute[72809]: DEBUG nova.compute.manager [req-1f038c18-8431-4940-bc7b-af380ecdf6bc req-dca2649a-6384-4faa-b9e5-b9d2788495e4 service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] No waiting events found dispatching network-vif-plugged-fa550cf1-3f73-4435-a6fe-91752e664b2f {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:06:00 user nova-compute[72809]: WARNING nova.compute.manager [req-1f038c18-8431-4940-bc7b-af380ecdf6bc req-dca2649a-6384-4faa-b9e5-b9d2788495e4 service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Received unexpected event network-vif-plugged-fa550cf1-3f73-4435-a6fe-91752e664b2f for instance with vm_state building and task_state spawning.
Aug 09 07:06:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:01 user nova-compute[72809]: DEBUG nova.compute.manager [req-974d0ffe-4e4c-43e1-b6a9-d9ada2b029d8 req-915d3b08-6a75-4cae-8591-21fbb001117f service nova] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Received event network-vif-plugged-c0891ee7-fd99-4abf-96bd-9389e7032aab {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:06:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-974d0ffe-4e4c-43e1-b6a9-d9ada2b029d8 req-915d3b08-6a75-4cae-8591-21fbb001117f service nova] Acquiring lock "6e9996e8-c5eb-42c1-b88f-d75654e160c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:06:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-974d0ffe-4e4c-43e1-b6a9-d9ada2b029d8 req-915d3b08-6a75-4cae-8591-21fbb001117f service nova] Lock "6e9996e8-c5eb-42c1-b88f-d75654e160c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:06:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-974d0ffe-4e4c-43e1-b6a9-d9ada2b029d8 req-915d3b08-6a75-4cae-8591-21fbb001117f service nova] Lock "6e9996e8-c5eb-42c1-b88f-d75654e160c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:06:01 user nova-compute[72809]: DEBUG nova.compute.manager [req-974d0ffe-4e4c-43e1-b6a9-d9ada2b029d8 req-915d3b08-6a75-4cae-8591-21fbb001117f service nova] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] No waiting events found dispatching network-vif-plugged-c0891ee7-fd99-4abf-96bd-9389e7032aab {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:06:01 user nova-compute[72809]: WARNING nova.compute.manager [req-974d0ffe-4e4c-43e1-b6a9-d9ada2b029d8 req-915d3b08-6a75-4cae-8591-21fbb001117f service nova] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Received unexpected event network-vif-plugged-c0891ee7-fd99-4abf-96bd-9389e7032aab for instance with vm_state building and task_state spawning.
Aug 09 07:06:02 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564762.8382452, 6e9996e8-c5eb-42c1-b88f-d75654e160c5 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:06:02 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] VM Resumed (Lifecycle Event)
Aug 09 07:06:02 user nova-compute[72809]: DEBUG nova.compute.manager [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 07:06:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 07:06:02 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Instance spawned successfully.
Aug 09 07:06:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 07:06:02 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:06:02 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:06:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:06:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:06:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:06:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:06:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:06:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:06:02 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:06:02 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564762.8407059, 6e9996e8-c5eb-42c1-b88f-d75654e160c5 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:06:02 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] VM Started (Lifecycle Event)
Aug 09 07:06:02 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:06:02 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:06:02 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:06:02 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564762.9540915, b3249e5c-5657-4c08-8ada-50820d9955d4 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:06:02 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] VM Resumed (Lifecycle Event)
Aug 09 07:06:02 user nova-compute[72809]: DEBUG nova.compute.manager [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 07:06:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 07:06:02 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Instance spawned successfully.
Aug 09 07:06:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 07:06:02 user nova-compute[72809]: DEBUG nova.compute.manager [req-4acc9e18-47a4-492c-bb94-52748b3c2058 req-9ba30899-0809-4c7c-af6c-bab7c6c3ce21 service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Received event network-vif-plugged-fa550cf1-3f73-4435-a6fe-91752e664b2f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:06:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-4acc9e18-47a4-492c-bb94-52748b3c2058 req-9ba30899-0809-4c7c-af6c-bab7c6c3ce21 service nova] Acquiring lock "b3249e5c-5657-4c08-8ada-50820d9955d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:06:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-4acc9e18-47a4-492c-bb94-52748b3c2058 req-9ba30899-0809-4c7c-af6c-bab7c6c3ce21 service nova] Lock "b3249e5c-5657-4c08-8ada-50820d9955d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:06:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-4acc9e18-47a4-492c-bb94-52748b3c2058 req-9ba30899-0809-4c7c-af6c-bab7c6c3ce21 service nova] Lock "b3249e5c-5657-4c08-8ada-50820d9955d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:06:02 user nova-compute[72809]: DEBUG nova.compute.manager [req-4acc9e18-47a4-492c-bb94-52748b3c2058 req-9ba30899-0809-4c7c-af6c-bab7c6c3ce21 service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] No waiting events found dispatching network-vif-plugged-fa550cf1-3f73-4435-a6fe-91752e664b2f {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:06:02 user nova-compute[72809]: WARNING nova.compute.manager [req-4acc9e18-47a4-492c-bb94-52748b3c2058 req-9ba30899-0809-4c7c-af6c-bab7c6c3ce21 service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Received unexpected event network-vif-plugged-fa550cf1-3f73-4435-a6fe-91752e664b2f for instance with vm_state building and task_state spawning.
Aug 09 07:06:02 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:06:02 user nova-compute[72809]: INFO nova.compute.manager [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Took 7.58 seconds to spawn the instance on the hypervisor.
Aug 09 07:06:02 user nova-compute[72809]: DEBUG nova.compute.manager [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:06:03 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:06:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:06:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:06:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:06:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:06:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:06:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:06:03 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:06:03 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564762.9607053, b3249e5c-5657-4c08-8ada-50820d9955d4 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:06:03 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] VM Started (Lifecycle Event)
Aug 09 07:06:03 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:06:03 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:06:03 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:06:03 user nova-compute[72809]: INFO nova.compute.manager [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Took 6.71 seconds to spawn the instance on the hypervisor.
Aug 09 07:06:03 user nova-compute[72809]: DEBUG nova.compute.manager [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:06:03 user nova-compute[72809]: INFO nova.compute.manager [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Took 8.48 seconds to build instance.
Aug 09 07:06:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-178fcf47-22c0-4603-9834-c5c15ce81fca tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "6e9996e8-c5eb-42c1-b88f-d75654e160c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.616s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:06:03 user nova-compute[72809]: INFO nova.compute.manager [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Took 7.74 seconds to build instance.
Aug 09 07:06:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-79c57289-9393-448a-99b7-71d53b022e28 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "b3249e5c-5657-4c08-8ada-50820d9955d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.842s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:06:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:06 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-823e60f0-2901-4778-b4e6-b308fef9e07a tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "a754327a-9985-4430-af66-1d8bc82fb868" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:06:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-823e60f0-2901-4778-b4e6-b308fef9e07a tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "a754327a-9985-4430-af66-1d8bc82fb868" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:06:12 user nova-compute[72809]: DEBUG nova.compute.manager [None req-823e60f0-2901-4778-b4e6-b308fef9e07a tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Going to confirm migration 2 {{(pid=72809) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 09 07:06:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-823e60f0-2901-4778-b4e6-b308fef9e07a tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "refresh_cache-a754327a-9985-4430-af66-1d8bc82fb868" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:06:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-823e60f0-2901-4778-b4e6-b308fef9e07a tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquired lock "refresh_cache-a754327a-9985-4430-af66-1d8bc82fb868" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:06:13 user nova-compute[72809]: DEBUG nova.network.neutron [None req-823e60f0-2901-4778-b4e6-b308fef9e07a tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:06:13 user nova-compute[72809]: DEBUG nova.objects.instance [None req-823e60f0-2901-4778-b4e6-b308fef9e07a tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lazy-loading 'info_cache' on Instance uuid a754327a-9985-4430-af66-1d8bc82fb868 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:06:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:14 user nova-compute[72809]: DEBUG nova.network.neutron [None req-823e60f0-2901-4778-b4e6-b308fef9e07a tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Updating instance_info_cache with network_info: [{"id": "79d0335e-d56b-4916-9b58-c198843ed750", "address": "fa:16:3e:d4:01:03", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d0335e-d5", "ovs_interfaceid": "79d0335e-d56b-4916-9b58-c198843ed750", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:06:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-823e60f0-2901-4778-b4e6-b308fef9e07a tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Releasing lock "refresh_cache-a754327a-9985-4430-af66-1d8bc82fb868" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:06:14 user nova-compute[72809]: DEBUG nova.objects.instance [None req-823e60f0-2901-4778-b4e6-b308fef9e07a tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lazy-loading 'migration_context' on Instance uuid a754327a-9985-4430-af66-1d8bc82fb868 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:06:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-823e60f0-2901-4778-b4e6-b308fef9e07a tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:06:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-823e60f0-2901-4778-b4e6-b308fef9e07a tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:06:14 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-823e60f0-2901-4778-b4e6-b308fef9e07a tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:06:14 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-823e60f0-2901-4778-b4e6-b308fef9e07a tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:06:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-823e60f0-2901-4778-b4e6-b308fef9e07a tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.570s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:06:15 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-823e60f0-2901-4778-b4e6-b308fef9e07a tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Deleted allocation for migration e576542e-d733-40bc-8749-08b38fac6842
Aug 09 07:06:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-823e60f0-2901-4778-b4e6-b308fef9e07a tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "a754327a-9985-4430-af66-1d8bc82fb868" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 2.357s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:06:16 user nova-compute[72809]: DEBUG nova.compute.manager [req-7a8dfa1c-e814-4a1f-bbb5-9fd3c6a4ae6b req-d11d98ba-9dc6-4278-9272-cc44bc924c19 service nova] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Received event network-changed-5bd22d17-9a8a-41ce-b164-16812b74fdcd {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:06:16 user nova-compute[72809]: DEBUG nova.compute.manager [req-7a8dfa1c-e814-4a1f-bbb5-9fd3c6a4ae6b req-d11d98ba-9dc6-4278-9272-cc44bc924c19 service nova] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Refreshing instance network info cache due to event network-changed-5bd22d17-9a8a-41ce-b164-16812b74fdcd. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:06:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7a8dfa1c-e814-4a1f-bbb5-9fd3c6a4ae6b req-d11d98ba-9dc6-4278-9272-cc44bc924c19 service nova] Acquiring lock "refresh_cache-a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:06:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7a8dfa1c-e814-4a1f-bbb5-9fd3c6a4ae6b req-d11d98ba-9dc6-4278-9272-cc44bc924c19 service nova] Acquired lock "refresh_cache-a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:06:16 user nova-compute[72809]: DEBUG nova.network.neutron [req-7a8dfa1c-e814-4a1f-bbb5-9fd3c6a4ae6b req-d11d98ba-9dc6-4278-9272-cc44bc924c19 service nova] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Refreshing network info cache for port 5bd22d17-9a8a-41ce-b164-16812b74fdcd {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:06:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d8f85025-6c09-44d7-8541-185939062973 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Acquiring lock "a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:06:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d8f85025-6c09-44d7-8541-185939062973 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:06:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d8f85025-6c09-44d7-8541-185939062973 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Acquiring lock "a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:06:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d8f85025-6c09-44d7-8541-185939062973 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:06:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d8f85025-6c09-44d7-8541-185939062973 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:06:16 user nova-compute[72809]: INFO nova.compute.manager [None req-d8f85025-6c09-44d7-8541-185939062973 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Terminating instance
Aug 09 07:06:16 user nova-compute[72809]: DEBUG nova.compute.manager [None req-d8f85025-6c09-44d7-8541-185939062973 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:06:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:16 user nova-compute[72809]: DEBUG nova.network.neutron [req-7a8dfa1c-e814-4a1f-bbb5-9fd3c6a4ae6b req-d11d98ba-9dc6-4278-9272-cc44bc924c19 service nova] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Updated VIF entry in instance network info cache for port 5bd22d17-9a8a-41ce-b164-16812b74fdcd. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:06:16 user nova-compute[72809]: DEBUG nova.network.neutron [req-7a8dfa1c-e814-4a1f-bbb5-9fd3c6a4ae6b req-d11d98ba-9dc6-4278-9272-cc44bc924c19 service nova] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Updating instance_info_cache with network_info: [{"id": "5bd22d17-9a8a-41ce-b164-16812b74fdcd", "address": "fa:16:3e:d7:36:8c", "network": {"id": "aaea335c-52d5-402b-b53c-b53cc3d7385d", "bridge": "br-int", "label": "tempest-TestStampPattern-1348939935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77be39d2ba434d42bd6b08194503031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd22d17-9a", "ovs_interfaceid": "5bd22d17-9a8a-41ce-b164-16812b74fdcd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:06:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7a8dfa1c-e814-4a1f-bbb5-9fd3c6a4ae6b req-d11d98ba-9dc6-4278-9272-cc44bc924c19 service nova] Releasing lock "refresh_cache-a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:06:17 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Instance destroyed successfully.
Aug 09 07:06:17 user nova-compute[72809]: DEBUG nova.objects.instance [None req-d8f85025-6c09-44d7-8541-185939062973 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lazy-loading 'resources' on Instance uuid a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:06:17 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-d8f85025-6c09-44d7-8541-185939062973 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:03:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1789581626',display_name='tempest-TestStampPattern-server-1789581626',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1789581626',id=34,image_ref='b10b2e00-2a11-4912-8765-96119c37347f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqS/2/2VeQQ93OP20t6ISd1xMlLR9FaU7uvyMUqE2hZscqHexQxbkOj1PbmtjEvjmecnyXPp9gBYtCCngYh9dMwRjEB6Of/ZdkUz4BqrXPYRgKqiRTv44Mwop2+/V3zEQ==',key_name='tempest-TestStampPattern-1744378759',keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:03:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77be39d2ba434d42bd6b08194503031d',ramdisk_id='',reservation_id='r-eol9a3m5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='51432417-89cc-4cee-855d-c4b148e4bd37',image_min_disk='1',image_min_ram='0',image_owner_id='77be39d2ba434d42bd6b08194503031d',image_owner_project_name='tempest-TestStampPattern-1052665161',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1052665161-project-member',image_user_id='ddd99e6c6a034fffa82466ae88ea098d',owner_project_name='tempest-TestStampPattern-1052665161',owner_user_name='tempest-TestStampPattern-1052665161-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:03:30Z,user_data=None,user_id='ddd99e6c6a034fffa82466ae88ea098d',uuid=a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5bd22d17-9a8a-41ce-b164-16812b74fdcd", "address": "fa:16:3e:d7:36:8c", "network": {"id": "aaea335c-52d5-402b-b53c-b53cc3d7385d", "bridge": "br-int", "label": "tempest-TestStampPattern-1348939935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77be39d2ba434d42bd6b08194503031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd22d17-9a", "ovs_interfaceid": "5bd22d17-9a8a-41ce-b164-16812b74fdcd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:06:17 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-d8f85025-6c09-44d7-8541-185939062973 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Converting VIF {"id": "5bd22d17-9a8a-41ce-b164-16812b74fdcd", "address": "fa:16:3e:d7:36:8c", "network": {"id": "aaea335c-52d5-402b-b53c-b53cc3d7385d", "bridge": "br-int", "label": "tempest-TestStampPattern-1348939935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77be39d2ba434d42bd6b08194503031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd22d17-9a", "ovs_interfaceid": "5bd22d17-9a8a-41ce-b164-16812b74fdcd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:06:17 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-d8f85025-6c09-44d7-8541-185939062973 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:36:8c,bridge_name='br-int',has_traffic_filtering=True,id=5bd22d17-9a8a-41ce-b164-16812b74fdcd,network=Network(aaea335c-52d5-402b-b53c-b53cc3d7385d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd22d17-9a') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:06:17 user nova-compute[72809]: DEBUG os_vif [None req-d8f85025-6c09-44d7-8541-185939062973 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:36:8c,bridge_name='br-int',has_traffic_filtering=True,id=5bd22d17-9a8a-41ce-b164-16812b74fdcd,network=Network(aaea335c-52d5-402b-b53c-b53cc3d7385d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd22d17-9a') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:06:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5bd22d17-9a, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:06:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:06:17 user nova-compute[72809]: INFO os_vif [None req-d8f85025-6c09-44d7-8541-185939062973 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:36:8c,bridge_name='br-int',has_traffic_filtering=True,id=5bd22d17-9a8a-41ce-b164-16812b74fdcd,network=Network(aaea335c-52d5-402b-b53c-b53cc3d7385d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd22d17-9a')
Aug 09 07:06:17 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-d8f85025-6c09-44d7-8541-185939062973 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Deleting instance files /opt/stack/data/nova/instances/a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa_del
Aug 09 07:06:17 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-d8f85025-6c09-44d7-8541-185939062973 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Deletion of /opt/stack/data/nova/instances/a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa_del complete
Aug 09 07:06:17 user nova-compute[72809]: INFO nova.compute.manager [None req-d8f85025-6c09-44d7-8541-185939062973 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 09 07:06:17 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-d8f85025-6c09-44d7-8541-185939062973 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:06:17 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:06:17 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:06:17 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:06:17 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Took 0.54 seconds to deallocate network for instance.
Aug 09 07:06:17 user nova-compute[72809]: DEBUG nova.compute.manager [req-114373af-56ba-41dc-86f1-b72505aa9c03 req-620f227d-3630-4bb2-b692-91000e16db76 service nova] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Received event network-vif-deleted-5bd22d17-9a8a-41ce-b164-16812b74fdcd {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:06:17 user nova-compute[72809]: INFO nova.compute.manager [req-114373af-56ba-41dc-86f1-b72505aa9c03 req-620f227d-3630-4bb2-b692-91000e16db76 service nova] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Neutron deleted interface 5bd22d17-9a8a-41ce-b164-16812b74fdcd; detaching it from the instance and deleting it from the info cache
Aug 09 07:06:17 user nova-compute[72809]: DEBUG nova.network.neutron [req-114373af-56ba-41dc-86f1-b72505aa9c03 req-620f227d-3630-4bb2-b692-91000e16db76 service nova] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:06:17 user nova-compute[72809]: DEBUG nova.compute.manager [req-114373af-56ba-41dc-86f1-b72505aa9c03 req-620f227d-3630-4bb2-b692-91000e16db76 service nova] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Detach interface failed, port_id=5bd22d17-9a8a-41ce-b164-16812b74fdcd, reason: Instance a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa could not be found. {{(pid=72809) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 07:06:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d8f85025-6c09-44d7-8541-185939062973 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:06:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d8f85025-6c09-44d7-8541-185939062973 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:06:18 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-d8f85025-6c09-44d7-8541-185939062973 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:06:18 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-d8f85025-6c09-44d7-8541-185939062973 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:06:18 user nova-compute[72809]: DEBUG nova.compute.manager [req-c1abebbd-ca4e-419e-a893-7467f2055b54 req-46dc7331-00f3-4617-89a0-02aea4fdc715 service nova] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Received event network-vif-unplugged-5bd22d17-9a8a-41ce-b164-16812b74fdcd {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:06:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c1abebbd-ca4e-419e-a893-7467f2055b54 req-46dc7331-00f3-4617-89a0-02aea4fdc715 service nova] Acquiring lock "a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:06:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c1abebbd-ca4e-419e-a893-7467f2055b54 req-46dc7331-00f3-4617-89a0-02aea4fdc715 service nova] Lock "a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:06:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c1abebbd-ca4e-419e-a893-7467f2055b54 req-46dc7331-00f3-4617-89a0-02aea4fdc715 service nova] Lock "a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:06:18 user nova-compute[72809]: DEBUG nova.compute.manager [req-c1abebbd-ca4e-419e-a893-7467f2055b54 req-46dc7331-00f3-4617-89a0-02aea4fdc715 service nova] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] No waiting events found dispatching network-vif-unplugged-5bd22d17-9a8a-41ce-b164-16812b74fdcd {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:06:18 user nova-compute[72809]: WARNING nova.compute.manager [req-c1abebbd-ca4e-419e-a893-7467f2055b54 req-46dc7331-00f3-4617-89a0-02aea4fdc715 service nova] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Received unexpected event network-vif-unplugged-5bd22d17-9a8a-41ce-b164-16812b74fdcd for instance with vm_state deleted and task_state None.
Aug 09 07:06:18 user nova-compute[72809]: DEBUG nova.compute.manager [req-c1abebbd-ca4e-419e-a893-7467f2055b54 req-46dc7331-00f3-4617-89a0-02aea4fdc715 service nova] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Received event network-vif-plugged-5bd22d17-9a8a-41ce-b164-16812b74fdcd {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:06:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c1abebbd-ca4e-419e-a893-7467f2055b54 req-46dc7331-00f3-4617-89a0-02aea4fdc715 service nova] Acquiring lock "a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:06:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c1abebbd-ca4e-419e-a893-7467f2055b54 req-46dc7331-00f3-4617-89a0-02aea4fdc715 service nova] Lock "a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:06:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c1abebbd-ca4e-419e-a893-7467f2055b54 req-46dc7331-00f3-4617-89a0-02aea4fdc715 service nova] Lock "a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:06:18 user nova-compute[72809]: DEBUG nova.compute.manager [req-c1abebbd-ca4e-419e-a893-7467f2055b54 req-46dc7331-00f3-4617-89a0-02aea4fdc715 service nova] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] No waiting events found dispatching network-vif-plugged-5bd22d17-9a8a-41ce-b164-16812b74fdcd {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:06:18 user nova-compute[72809]: WARNING nova.compute.manager [req-c1abebbd-ca4e-419e-a893-7467f2055b54 req-46dc7331-00f3-4617-89a0-02aea4fdc715 service nova] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Received unexpected event network-vif-plugged-5bd22d17-9a8a-41ce-b164-16812b74fdcd for instance with vm_state deleted and task_state None.
Aug 09 07:06:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d8f85025-6c09-44d7-8541-185939062973 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:06:18 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-d8f85025-6c09-44d7-8541-185939062973 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Deleted allocations for instance a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa
Aug 09 07:06:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d8f85025-6c09-44d7-8541-185939062973 tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.082s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:06:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:20 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:32 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691564777.1552553, a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:06:32 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] VM Stopped (Lifecycle Event)
Aug 09 07:06:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-06eeede0-3167-4861-bee5-c7013aca8504 None None] [instance: a5a7c2e3-fe97-4055-bf65-9cd0b8e044aa] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:06:32 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:36 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:06:36 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 07:06:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-51432417-89cc-4cee-855d-c4b148e4bd37" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:06:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-51432417-89cc-4cee-855d-c4b148e4bd37" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:06:36 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 07:06:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:37 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Updating instance_info_cache with network_info: [{"id": "f11de67a-407a-46d8-853e-267e19d82001", "address": "fa:16:3e:a6:83:61", "network": {"id": "aaea335c-52d5-402b-b53c-b53cc3d7385d", "bridge": "br-int", "label": "tempest-TestStampPattern-1348939935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77be39d2ba434d42bd6b08194503031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11de67a-40", "ovs_interfaceid": "f11de67a-407a-46d8-853e-267e19d82001", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:06:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-51432417-89cc-4cee-855d-c4b148e4bd37" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:06:37 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 07:06:37 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:06:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:06:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:06:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:06:37 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 07:06:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:06:37 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:38 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3249e5c-5657-4c08-8ada-50820d9955d4/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3249e5c-5657-4c08-8ada-50820d9955d4/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3249e5c-5657-4c08-8ada-50820d9955d4/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3249e5c-5657-4c08-8ada-50820d9955d4/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:06:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:41 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:06:41 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:06:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=7414MB free_disk=24.988964080810547GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 07:06:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:06:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:06:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 336770eb-4f09-4134-92ef-f96039bf4fa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:06:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 1bde423f-0b73-448f-bdce-8d6af96d8fc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:06:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance bebd5a14-6272-4de1-a1a1-4fb45b867c7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:06:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 339372ed-140d-4226-ba00-2cc682214d5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:06:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 38319c37-9cc0-4e84-8415-ddcf37451daf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:06:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 51432417-89cc-4cee-855d-c4b148e4bd37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:06:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 466a8e58-5f88-4ffe-a7fd-a346003f3508 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:06:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance a754327a-9985-4430-af66-1d8bc82fb868 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:06:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 63936bb9-97de-4a87-aa29-14129104c1d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:06:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 6e9996e8-c5eb-42c1-b88f-d75654e160c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:06:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance b3249e5c-5657-4c08-8ada-50820d9955d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:06:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 07:06:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 07:06:42 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:06:42 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:06:42 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 07:06:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.495s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:06:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Acquiring lock "48f0adeb-a5e8-4f81-a534-04c702c272a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:06:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "48f0adeb-a5e8-4f81-a534-04c702c272a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:06:43 user nova-compute[72809]: DEBUG nova.compute.manager [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 07:06:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:06:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:06:43 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 07:06:43 user nova-compute[72809]: INFO nova.compute.claims [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Claim successful on node user
Aug 09 07:06:43 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:44 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:06:44 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:06:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.664s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:06:44 user nova-compute[72809]: DEBUG nova.compute.manager [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 07:06:44 user nova-compute[72809]: DEBUG nova.compute.manager [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 07:06:44 user nova-compute[72809]: DEBUG nova.network.neutron [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 07:06:44 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 07:06:44 user nova-compute[72809]: DEBUG nova.policy [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e0e9000c85ba4fa5aef9c2c2b592b950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0c708ffc744c3ab8175ad7b939e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 07:06:44 user nova-compute[72809]: DEBUG nova.compute.manager [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 07:06:44 user nova-compute[72809]: INFO nova.virt.block_device [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Booting with volume 3386be22-3bf4-4702-888c-9d3e8d2ce54a at /dev/vda
Aug 09 07:06:44 user nova-compute[72809]: DEBUG os_brick.utils [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:06:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:44 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d60f1f-ad25-4d83-8e20-5789279b9c3d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:06:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:44 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9972e451-8ebe-4263-b3b1-63639162ce27]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:06:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:44 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[908619b8-d1a5-421a-8793-8041f6dd5387]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:06:44 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[94557d87-24b0-439f-9d76-1de85f1072d4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:06:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:06:44 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 07:06:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:06:44 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 07:06:44 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15cdd68-caed-4c46-bf88-f69e4f552407]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:06:44 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 07:06:44 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 07:06:44 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 07:06:44 user nova-compute[72809]: DEBUG os_brick.utils [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:06:44 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Updating existing volume attachment record: 9c704615-82bf-4b02-816e-7779f8b46dbf {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 07:06:45 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:06:45 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:06:45 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:06:45 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:06:45 user nova-compute[72809]: DEBUG nova.network.neutron [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Successfully created port: 69cd2937-cfc9-42c1-bd26-c5debab643fc {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 07:06:45 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:06:46 user nova-compute[72809]: DEBUG nova.compute.manager [req-b8ccd054-8465-418e-a886-c12da7701389 req-8ee0e435-0dce-4e1f-b02d-4f6602a8b50c service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Received event network-changed-871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:06:46 user nova-compute[72809]: DEBUG nova.compute.manager [req-b8ccd054-8465-418e-a886-c12da7701389 req-8ee0e435-0dce-4e1f-b02d-4f6602a8b50c service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Refreshing instance network info cache due to event network-changed-871a925e-dae2-45d5-8e6d-24d429032d70. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:06:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b8ccd054-8465-418e-a886-c12da7701389 req-8ee0e435-0dce-4e1f-b02d-4f6602a8b50c service nova] Acquiring lock "refresh_cache-63936bb9-97de-4a87-aa29-14129104c1d3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:06:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b8ccd054-8465-418e-a886-c12da7701389 req-8ee0e435-0dce-4e1f-b02d-4f6602a8b50c service nova] Acquired lock "refresh_cache-63936bb9-97de-4a87-aa29-14129104c1d3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:06:46 user nova-compute[72809]: DEBUG nova.network.neutron [req-b8ccd054-8465-418e-a886-c12da7701389 req-8ee0e435-0dce-4e1f-b02d-4f6602a8b50c service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Refreshing network info cache for port 871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:06:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "63936bb9-97de-4a87-aa29-14129104c1d3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:06:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "63936bb9-97de-4a87-aa29-14129104c1d3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:06:46 user nova-compute[72809]: DEBUG nova.objects.instance [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lazy-loading 'flavor' on Instance uuid 63936bb9-97de-4a87-aa29-14129104c1d3 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:06:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "63936bb9-97de-4a87-aa29-14129104c1d3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:06:46 user nova-compute[72809]: DEBUG nova.network.neutron [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Successfully updated port: 69cd2937-cfc9-42c1-bd26-c5debab643fc {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 07:06:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Acquiring lock "refresh_cache-48f0adeb-a5e8-4f81-a534-04c702c272a3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:06:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Acquired lock "refresh_cache-48f0adeb-a5e8-4f81-a534-04c702c272a3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:06:46 user nova-compute[72809]: DEBUG nova.network.neutron [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:06:46 user nova-compute[72809]: DEBUG nova.compute.manager [req-3fead8c0-69cf-4f2e-be7c-25f467860b56 req-0b2b0582-c6b4-441f-b4b2-8f322877ca77 service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Received event network-changed-69cd2937-cfc9-42c1-bd26-c5debab643fc {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:06:46 user nova-compute[72809]: DEBUG nova.compute.manager [req-3fead8c0-69cf-4f2e-be7c-25f467860b56 req-0b2b0582-c6b4-441f-b4b2-8f322877ca77 service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Refreshing instance network info cache due to event network-changed-69cd2937-cfc9-42c1-bd26-c5debab643fc. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:06:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3fead8c0-69cf-4f2e-be7c-25f467860b56 req-0b2b0582-c6b4-441f-b4b2-8f322877ca77 service nova] Acquiring lock "refresh_cache-48f0adeb-a5e8-4f81-a534-04c702c272a3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG nova.network.neutron [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "63936bb9-97de-4a87-aa29-14129104c1d3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "63936bb9-97de-4a87-aa29-14129104c1d3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:06:47 user nova-compute[72809]: INFO nova.compute.manager [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Attaching volume a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb to /dev/vdb
Aug 09 07:06:47 user nova-compute[72809]: DEBUG os_brick.utils [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac537be-7b7d-42e6-a6e3-6637f42ba617]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG nova.network.neutron [req-b8ccd054-8465-418e-a886-c12da7701389 req-8ee0e435-0dce-4e1f-b02d-4f6602a8b50c service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Updated VIF entry in instance network info cache for port 871a925e-dae2-45d5-8e6d-24d429032d70. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG nova.network.neutron [req-b8ccd054-8465-418e-a886-c12da7701389 req-8ee0e435-0dce-4e1f-b02d-4f6602a8b50c service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Updating instance_info_cache with network_info: [{"id": "871a925e-dae2-45d5-8e6d-24d429032d70", "address": "fa:16:3e:a0:e1:1d", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871a925e-da", "ovs_interfaceid": "871a925e-dae2-45d5-8e6d-24d429032d70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[333fae22-ee02-4d73-b79f-d997cc310355]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b8ccd054-8465-418e-a886-c12da7701389 req-8ee0e435-0dce-4e1f-b02d-4f6602a8b50c service nova] Releasing lock "refresh_cache-63936bb9-97de-4a87-aa29-14129104c1d3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cdba3b-6e63-4f7f-ad75-39d827cefaaa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[8caa4018-63f4-4414-8b11-db8ae3d93443]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:06:47 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 07:06:47 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ca7f73-ad7a-44ba-a326-2306d61472a7]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG os_brick.utils [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Updating existing volume attachment record: cf814fcc-9b1f-4fcd-978e-81c23e7bad4d {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG nova.network.neutron [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Updating instance_info_cache with network_info: [{"id": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "address": "fa:16:3e:43:7d:86", "network": {"id": "2bd3fecc-598f-4b7d-a306-5b31f8e81019", "bridge": "br-int", "label": "tempest-TestShelveInstance-696590898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0c708ffc744c3ab8175ad7b939e4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd2937-cf", "ovs_interfaceid": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Releasing lock "refresh_cache-48f0adeb-a5e8-4f81-a534-04c702c272a3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG nova.compute.manager [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Instance network_info: |[{"id": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "address": "fa:16:3e:43:7d:86", "network": {"id": "2bd3fecc-598f-4b7d-a306-5b31f8e81019", "bridge": "br-int", "label": "tempest-TestShelveInstance-696590898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0c708ffc744c3ab8175ad7b939e4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd2937-cf", "ovs_interfaceid": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3fead8c0-69cf-4f2e-be7c-25f467860b56 req-0b2b0582-c6b4-441f-b4b2-8f322877ca77 service nova] Acquired lock "refresh_cache-48f0adeb-a5e8-4f81-a534-04c702c272a3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG nova.network.neutron [req-3fead8c0-69cf-4f2e-be7c-25f467860b56 req-0b2b0582-c6b4-441f-b4b2-8f322877ca77 service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Refreshing network info cache for port 69cd2937-cfc9-42c1-bd26-c5debab643fc {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG nova.network.neutron [req-3fead8c0-69cf-4f2e-be7c-25f467860b56 req-0b2b0582-c6b4-441f-b4b2-8f322877ca77 service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Updated VIF entry in instance network info cache for port 69cd2937-cfc9-42c1-bd26-c5debab643fc. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG nova.network.neutron [req-3fead8c0-69cf-4f2e-be7c-25f467860b56 req-0b2b0582-c6b4-441f-b4b2-8f322877ca77 service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Updating instance_info_cache with network_info: [{"id": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "address": "fa:16:3e:43:7d:86", "network": {"id": "2bd3fecc-598f-4b7d-a306-5b31f8e81019", "bridge": "br-int", "label": "tempest-TestShelveInstance-696590898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0c708ffc744c3ab8175ad7b939e4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd2937-cf", "ovs_interfaceid": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:06:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3fead8c0-69cf-4f2e-be7c-25f467860b56 req-0b2b0582-c6b4-441f-b4b2-8f322877ca77 service nova] Releasing lock "refresh_cache-48f0adeb-a5e8-4f81-a534-04c702c272a3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:06:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:49 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:06:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dJceuFZi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:06:55 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:06:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:06:55 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:06:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:06:55 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 07:06:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3450724-b97d-41d1-9c2e-66d512bd693a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 07:06:55 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2717aab-3788-42f2-8eb2-dad9f241aee8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb] added
Aug 09 07:06:55 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47f3a42-b64a-4632-8fb7-38b86cb98e76]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[13719292-9510-4a3d-8e15-26073393988d]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dJceuFZi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dJceuFZi" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58d1eb7-10e5-4980-9159-3de32cf0d3c8]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dJceuFZi'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d53380-d564-495c-9429-de97447480a2]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[749f39a9-6c62-49c0-903e-ca3b83cc7f16]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:06:55 user nova-compute[72809]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:06:55 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:06:55 user nova-compute[72809]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:06:55 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7c9938-431f-462c-9c75-25b6aaf89db3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb, portal: 172.16.0.220,3260]
Aug 09 07:06:55 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb, portal: 172.16.0.220,3260] successful.
Aug 09 07:06:55 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e88695-5936-46c7-87a0-cc97b24dbdfe]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef71841-9fcd-4f15-91a0-3b5e08ec7df6]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:06:55 user nova-compute[72809]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:06:55 user nova-compute[72809]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)
Aug 09 07:06:55 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:06:55 user nova-compute[72809]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:06:55 user nova-compute[72809]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)
Aug 09 07:06:55 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 07:06:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:56 user nova-compute[72809]: DEBUG nova.compute.manager [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 07:06:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 07:06:56 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Creating image(s)
Aug 09 07:06:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Did not create local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 07:06:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Ensure instance console log exists: /opt/stack/data/nova/instances/48f0adeb-a5e8-4f81-a534-04c702c272a3/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 07:06:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:06:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:06:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:06:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Start _get_guest_xml network_info=[{"id": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "address": "fa:16:3e:43:7d:86", "network": {"id": "2bd3fecc-598f-4b7d-a306-5b31f8e81019", "bridge": "br-int", "label": "tempest-TestShelveInstance-696590898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0c708ffc744c3ab8175ad7b939e4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd2937-cf", "ovs_interfaceid": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsWoEVyQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '48f0adeb-a5e8-4f81-a534-04c702c272a3', 'attached_at': '', 'detached_at': '', 'volume_id': '3386be22-3bf4-4702-888c-9d3e8d2ce54a', 'serial': '3386be22-3bf4-4702-888c-9d3e8d2ce54a'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'boot_index': 0, 'attachment_id': '9c704615-82bf-4b02-816e-7779f8b46dbf', 'volume_type': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 07:06:56 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:56 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72d6547-8979-4447-bfa8-75c10b01198a]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:06:56 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:06:56 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dJceuFZi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 07:06:56 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:06:56 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:06:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 07:06:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 07:06:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 07:06:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 07:06:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 07:06:56 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 07:06:56 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 07:06:56 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 07:06:56 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 07:06:56 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 07:06:56 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 07:06:56 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 07:06:56 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 07:06:56 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 07:06:56 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 07:06:56 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 07:06:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 07:06:56 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsWoEVyQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:06:56 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:06:56 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '26337633865353262', 'path': '/dev/sdd'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337633865353262', 'path': '/dev/sdd'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.959s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:06:57 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:06:57 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:06:57 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG nova.objects.instance [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lazy-loading 'flavor' on Instance uuid 63936bb9-97de-4a87-aa29-14129104c1d3 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efd7332-f523-429b-9fa0-08080d5f2e81]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 07:06:57 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 07:06:57 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:06:57 user nova-compute[72809]:   <source dev="/dev/sdd"/>
Aug 09 07:06:57 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:06:57 user nova-compute[72809]:   <serial>a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb</serial>
Aug 09 07:06:57 user nova-compute[72809]: </disk>
Aug 09 07:06:57 user nova-compute[72809]:  {{(pid=72809) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[915a7e3d-89e7-4be4-966e-4cc147ef118b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a] added
Aug 09 07:06:57 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[1434994f-9e1c-45bb-925f-e33df7d01cd3]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69b471d-ca33-4eed-a320-44ddeca82de3]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DsWoEVyQ {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DsWoEVyQ" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e330730-70f1-4d04-8da4-33fd42733404]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DsWoEVyQ'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbab11c6-b4c1-4814-828a-dea0f4552afc]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad22d5e-8733-45ff-8ea6-4e1579e8cd6a]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:06:57 user nova-compute[72809]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:06:57 user nova-compute[72809]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)
Aug 09 07:06:57 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:06:57 user nova-compute[72809]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:06:57 user nova-compute[72809]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)
Aug 09 07:06:57 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e73f560-e8f5-49bc-94f7-c657fd994507]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a, portal: 172.16.0.220,3260]
Aug 09 07:06:57 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a, portal: 172.16.0.220,3260] successful.
Aug 09 07:06:57 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdff938b-c36b-401a-b168-5834443eda38]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2294f98-bb60-46f7-8aa9-4649c953618e]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:06:57 user nova-compute[72809]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:06:57 user nova-compute[72809]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)
Aug 09 07:06:57 user nova-compute[72809]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a (non-flash)
Aug 09 07:06:57 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:06:57 user nova-compute[72809]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:06:57 user nova-compute[72809]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)
Aug 09 07:06:57 user nova-compute[72809]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a (non-flash)
Aug 09 07:06:57 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d057f09-1dba-4238-8bb7-124bd4177b82]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsWoEVyQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] No VIF found with MAC fa:16:3e:a0:e1:1d, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:06:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7325a123-4787-465e-bec1-7f827178733c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "63936bb9-97de-4a87-aa29-14129104c1d3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.595s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:06:58 user nova-compute[72809]: INFO nova.compute.manager [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Rescuing
Aug 09 07:06:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "refresh_cache-63936bb9-97de-4a87-aa29-14129104c1d3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:06:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquired lock "refresh_cache-63936bb9-97de-4a87-aa29-14129104c1d3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:06:58 user nova-compute[72809]: DEBUG nova.network.neutron [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:06:58 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:06:58 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] <== connect_volume: return (2286ms) {'type': 'block', 'scsi_wwn': '23932396532313232', 'path': '/dev/sde'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:06:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932396532313232', 'path': '/dev/sde'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 07:06:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:06:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1995239041',display_name='tempest-TestShelveInstance-server-1995239041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1995239041',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNltj5AhfdReKC+XXSY6ejv8Ie2lm2YSrdkcUJXL7q6V25F5DxWfy2C7Pk7FV62dJX0Li1dF/73C3Hzfrynk0pBWPWkfYCaD3NMi4Kd0GOmpueQ4DMju5iODY6Pa9axjOQ==',key_name='tempest-TestShelveInstance-1236424892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b0c708ffc744c3ab8175ad7b939e4e3',ramdisk_id='',reservation_id='r-1lnz0lx6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1139600942',owner_user_name='tempest-TestShelveInstance-1139600942-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:06:45Z,user_data=None,user_id='e0e9000c85ba4fa5aef9c2c2b592b950',uuid=48f0adeb-a5e8-4f81-a534-04c702c272a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "address": "fa:16:3e:43:7d:86", "network": {"id": "2bd3fecc-598f-4b7d-a306-5b31f8e81019", "bridge": "br-int", "label": "tempest-TestShelveInstance-696590898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0c708ffc744c3ab8175ad7b939e4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd2937-cf", "ovs_interfaceid": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 07:06:58 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Converting VIF {"id": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "address": "fa:16:3e:43:7d:86", "network": {"id": "2bd3fecc-598f-4b7d-a306-5b31f8e81019", "bridge": "br-int", "label": "tempest-TestShelveInstance-696590898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0c708ffc744c3ab8175ad7b939e4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd2937-cf", "ovs_interfaceid": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:06:58 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:7d:86,bridge_name='br-int',has_traffic_filtering=True,id=69cd2937-cfc9-42c1-bd26-c5debab643fc,network=Network(2bd3fecc-598f-4b7d-a306-5b31f8e81019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69cd2937-cf') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:06:58 user nova-compute[72809]: DEBUG nova.objects.instance [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lazy-loading 'pci_devices' on Instance uuid 48f0adeb-a5e8-4f81-a534-04c702c272a3 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:06:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] End _get_guest_xml xml=<domain type="kvm">
Aug 09 07:06:58 user nova-compute[72809]:   <uuid>48f0adeb-a5e8-4f81-a534-04c702c272a3</uuid>
Aug 09 07:06:58 user nova-compute[72809]:   <name>instance-00000026</name>
Aug 09 07:06:58 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 07:06:58 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 07:06:58 user nova-compute[72809]:   <metadata>
Aug 09 07:06:58 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 07:06:58 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 07:06:58 user nova-compute[72809]:       <nova:name>tempest-TestShelveInstance-server-1995239041</nova:name>
Aug 09 07:06:58 user nova-compute[72809]:       <nova:creationTime>2023-08-09 07:06:56</nova:creationTime>
Aug 09 07:06:58 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 07:06:58 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 07:06:58 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 07:06:58 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 07:06:58 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 07:06:58 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 07:06:58 user nova-compute[72809]:       </nova:flavor>
Aug 09 07:06:58 user nova-compute[72809]:       <nova:owner>
Aug 09 07:06:58 user nova-compute[72809]:         <nova:user uuid="e0e9000c85ba4fa5aef9c2c2b592b950">tempest-TestShelveInstance-1139600942-project-member</nova:user>
Aug 09 07:06:58 user nova-compute[72809]:         <nova:project uuid="4b0c708ffc744c3ab8175ad7b939e4e3">tempest-TestShelveInstance-1139600942</nova:project>
Aug 09 07:06:58 user nova-compute[72809]:       </nova:owner>
Aug 09 07:06:58 user nova-compute[72809]:       <nova:ports>
Aug 09 07:06:58 user nova-compute[72809]:         <nova:port uuid="69cd2937-cfc9-42c1-bd26-c5debab643fc">
Aug 09 07:06:58 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 07:06:58 user nova-compute[72809]:         </nova:port>
Aug 09 07:06:58 user nova-compute[72809]:       </nova:ports>
Aug 09 07:06:58 user nova-compute[72809]:     </nova:instance>
Aug 09 07:06:58 user nova-compute[72809]:   </metadata>
Aug 09 07:06:58 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 07:06:58 user nova-compute[72809]:     <system>
Aug 09 07:06:58 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 07:06:58 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 07:06:58 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 07:06:58 user nova-compute[72809]:       <entry name="serial">48f0adeb-a5e8-4f81-a534-04c702c272a3</entry>
Aug 09 07:06:58 user nova-compute[72809]:       <entry name="uuid">48f0adeb-a5e8-4f81-a534-04c702c272a3</entry>
Aug 09 07:06:58 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 07:06:58 user nova-compute[72809]:     </system>
Aug 09 07:06:58 user nova-compute[72809]:   </sysinfo>
Aug 09 07:06:58 user nova-compute[72809]:   <os>
Aug 09 07:06:58 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 07:06:58 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 07:06:58 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 07:06:58 user nova-compute[72809]:   </os>
Aug 09 07:06:58 user nova-compute[72809]:   <features>
Aug 09 07:06:58 user nova-compute[72809]:     <acpi/>
Aug 09 07:06:58 user nova-compute[72809]:     <apic/>
Aug 09 07:06:58 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 07:06:58 user nova-compute[72809]:   </features>
Aug 09 07:06:58 user nova-compute[72809]:   <clock offset="utc">
Aug 09 07:06:58 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 07:06:58 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 07:06:58 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 07:06:58 user nova-compute[72809]:   </clock>
Aug 09 07:06:58 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 07:06:58 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 07:06:58 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 07:06:58 user nova-compute[72809]:   </cpu>
Aug 09 07:06:58 user nova-compute[72809]:   <devices>
Aug 09 07:06:58 user nova-compute[72809]:     <disk type="block" device="disk">
Aug 09 07:06:58 user nova-compute[72809]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:06:58 user nova-compute[72809]:       <source dev="/dev/sde"/>
Aug 09 07:06:58 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 07:06:58 user nova-compute[72809]:       <serial>3386be22-3bf4-4702-888c-9d3e8d2ce54a</serial>
Aug 09 07:06:58 user nova-compute[72809]:     </disk>
Aug 09 07:06:58 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 07:06:58 user nova-compute[72809]:       <mac address="fa:16:3e:43:7d:86"/>
Aug 09 07:06:58 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:06:58 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 07:06:58 user nova-compute[72809]:       <target dev="tap69cd2937-cf"/>
Aug 09 07:06:58 user nova-compute[72809]:     </interface>
Aug 09 07:06:58 user nova-compute[72809]:     <serial type="pty">
Aug 09 07:06:58 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/48f0adeb-a5e8-4f81-a534-04c702c272a3/console.log" append="off"/>
Aug 09 07:06:58 user nova-compute[72809]:     </serial>
Aug 09 07:06:58 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 07:06:58 user nova-compute[72809]:     <video>
Aug 09 07:06:58 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:06:58 user nova-compute[72809]:     </video>
Aug 09 07:06:58 user nova-compute[72809]:     <rng model="virtio">
Aug 09 07:06:58 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 07:06:58 user nova-compute[72809]:     </rng>
Aug 09 07:06:58 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 07:06:58 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 07:06:58 user nova-compute[72809]:       <stats period="10"/>
Aug 09 07:06:58 user nova-compute[72809]:     </memballoon>
Aug 09 07:06:58 user nova-compute[72809]:   </devices>
Aug 09 07:06:58 user nova-compute[72809]: </domain>
Aug 09 07:06:58 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 07:06:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:06:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1995239041',display_name='tempest-TestShelveInstance-server-1995239041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1995239041',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNltj5AhfdReKC+XXSY6ejv8Ie2lm2YSrdkcUJXL7q6V25F5DxWfy2C7Pk7FV62dJX0Li1dF/73C3Hzfrynk0pBWPWkfYCaD3NMi4Kd0GOmpueQ4DMju5iODY6Pa9axjOQ==',key_name='tempest-TestShelveInstance-1236424892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b0c708ffc744c3ab8175ad7b939e4e3',ramdisk_id='',reservation_id='r-1lnz0lx6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1139600942',owner_user_name='tempest-TestShelveInstance-1139600942-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:06:45Z,user_data=None,user_id='e0e9000c85ba4fa5aef9c2c2b592b950',uuid=48f0adeb-a5e8-4f81-a534-04c702c272a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "address": "fa:16:3e:43:7d:86", "network": {"id": "2bd3fecc-598f-4b7d-a306-5b31f8e81019", "bridge": "br-int", "label": "tempest-TestShelveInstance-696590898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0c708ffc744c3ab8175ad7b939e4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd2937-cf", "ovs_interfaceid": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 07:06:58 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Converting VIF {"id": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "address": "fa:16:3e:43:7d:86", "network": {"id": "2bd3fecc-598f-4b7d-a306-5b31f8e81019", "bridge": "br-int", "label": "tempest-TestShelveInstance-696590898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0c708ffc744c3ab8175ad7b939e4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd2937-cf", "ovs_interfaceid": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:06:58 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:7d:86,bridge_name='br-int',has_traffic_filtering=True,id=69cd2937-cfc9-42c1-bd26-c5debab643fc,network=Network(2bd3fecc-598f-4b7d-a306-5b31f8e81019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69cd2937-cf') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:06:58 user nova-compute[72809]: DEBUG os_vif [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:7d:86,bridge_name='br-int',has_traffic_filtering=True,id=69cd2937-cfc9-42c1-bd26-c5debab643fc,network=Network(2bd3fecc-598f-4b7d-a306-5b31f8e81019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69cd2937-cf') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 07:06:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:06:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 07:06:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69cd2937-cf, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:06:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap69cd2937-cf, col_values=(('external_ids', {'iface-id': '69cd2937-cfc9-42c1-bd26-c5debab643fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:7d:86', 'vm-uuid': '48f0adeb-a5e8-4f81-a534-04c702c272a3'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:06:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:06:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:58 user nova-compute[72809]: INFO os_vif [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:7d:86,bridge_name='br-int',has_traffic_filtering=True,id=69cd2937-cfc9-42c1-bd26-c5debab643fc,network=Network(2bd3fecc-598f-4b7d-a306-5b31f8e81019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69cd2937-cf')
Aug 09 07:06:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:06:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] No VIF found with MAC fa:16:3e:43:7d:86, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:06:58 user nova-compute[72809]: DEBUG nova.network.neutron [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Updating instance_info_cache with network_info: [{"id": "871a925e-dae2-45d5-8e6d-24d429032d70", "address": "fa:16:3e:a0:e1:1d", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871a925e-da", "ovs_interfaceid": "871a925e-dae2-45d5-8e6d-24d429032d70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:06:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Releasing lock "refresh_cache-63936bb9-97de-4a87-aa29-14129104c1d3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:06:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:59 user nova-compute[72809]: DEBUG nova.compute.manager [req-fbbacdbe-9f0d-487d-b368-3878d124e5e8 req-ad71667b-8841-432a-a3c9-30141b3c40d5 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Received event network-vif-unplugged-871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:06:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-fbbacdbe-9f0d-487d-b368-3878d124e5e8 req-ad71667b-8841-432a-a3c9-30141b3c40d5 service nova] Acquiring lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:06:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-fbbacdbe-9f0d-487d-b368-3878d124e5e8 req-ad71667b-8841-432a-a3c9-30141b3c40d5 service nova] Lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:06:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-fbbacdbe-9f0d-487d-b368-3878d124e5e8 req-ad71667b-8841-432a-a3c9-30141b3c40d5 service nova] Lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:06:59 user nova-compute[72809]: DEBUG nova.compute.manager [req-fbbacdbe-9f0d-487d-b368-3878d124e5e8 req-ad71667b-8841-432a-a3c9-30141b3c40d5 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] No waiting events found dispatching network-vif-unplugged-871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:06:59 user nova-compute[72809]: WARNING nova.compute.manager [req-fbbacdbe-9f0d-487d-b368-3878d124e5e8 req-ad71667b-8841-432a-a3c9-30141b3c40d5 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Received unexpected event network-vif-unplugged-871a925e-dae2-45d5-8e6d-24d429032d70 for instance with vm_state active and task_state rescuing.
Aug 09 07:06:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:06:59 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Instance destroyed successfully.
Aug 09 07:06:59 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Attempting rescue
Aug 09 07:06:59 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72809) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 07:06:59 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Instance directory exists: not creating {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 07:06:59 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Creating image(s)
Aug 09 07:06:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "/opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:06:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "/opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:06:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "/opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:06:59 user nova-compute[72809]: DEBUG nova.objects.instance [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lazy-loading 'trusted_certs' on Instance uuid 63936bb9-97de-4a87-aa29-14129104c1d3 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:06:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:06:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:06:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:06:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.148s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:06:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk.rescue {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk.rescue" returned: 0 in 0.054s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG nova.objects.instance [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lazy-loading 'migration_context' on Instance uuid 63936bb9-97de-4a87-aa29-14129104c1d3 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Start _get_guest_xml network_info=[{"id": "871a925e-dae2-45d5-8e6d-24d429032d70", "address": "fa:16:3e:a0:e1:1d", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "vif_mac": "fa:16:3e:a0:e1:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871a925e-da", "ovs_interfaceid": "871a925e-dae2-45d5-8e6d-24d429032d70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG nova.objects.instance [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lazy-loading 'resources' on Instance uuid 63936bb9-97de-4a87-aa29-14129104c1d3 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG nova.objects.instance [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lazy-loading 'numa_topology' on Instance uuid 63936bb9-97de-4a87-aa29-14129104c1d3 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:07:00 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:07:00 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:07:00 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG nova.objects.instance [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lazy-loading 'vcpu_model' on Instance uuid 63936bb9-97de-4a87-aa29-14129104c1d3 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:04:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1556535521',display_name='tempest-ServerRescueNegativeTestJSON-server-1556535521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1556535521',id=35,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHeoIs5ATCyUGa031aHbazVkBN/+n/Z8VWoRm/Wus5x5A8l851hJVnTTm9YA2bIXyG0hvdO+4f6Xok23XdDFN+F0ZS83bBZmztR4TmBSoz2mlXYe3ZeHSAukj28ybVZyQ==',key_name='tempest-keypair-1071783678',keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:05:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e75b8536be334abba712e1c6f6886cdf',ramdisk_id='',reservation_id='r-mngut0hx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1153742012',owner_user_name='tempest-ServerRescueNegativeTestJSON-1153742012-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:05:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='740071d735364ce5b0e6a7bb0dbdffe3',uuid=63936bb9-97de-4a87-aa29-14129104c1d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "871a925e-dae2-45d5-8e6d-24d429032d70", "address": "fa:16:3e:a0:e1:1d", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "vif_mac": "fa:16:3e:a0:e1:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871a925e-da", "ovs_interfaceid": "871a925e-dae2-45d5-8e6d-24d429032d70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Converting VIF {"id": "871a925e-dae2-45d5-8e6d-24d429032d70", "address": "fa:16:3e:a0:e1:1d", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "vif_mac": "fa:16:3e:a0:e1:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871a925e-da", "ovs_interfaceid": "871a925e-dae2-45d5-8e6d-24d429032d70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:e1:1d,bridge_name='br-int',has_traffic_filtering=True,id=871a925e-dae2-45d5-8e6d-24d429032d70,network=Network(fb9ae39b-117a-4cca-8080-683f63e8a318),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap871a925e-da') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG nova.objects.instance [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lazy-loading 'pci_devices' on Instance uuid 63936bb9-97de-4a87-aa29-14129104c1d3 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] End _get_guest_xml xml=<domain type="kvm">
Aug 09 07:07:00 user nova-compute[72809]:   <uuid>63936bb9-97de-4a87-aa29-14129104c1d3</uuid>
Aug 09 07:07:00 user nova-compute[72809]:   <name>instance-00000023</name>
Aug 09 07:07:00 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 07:07:00 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 07:07:00 user nova-compute[72809]:   <metadata>
Aug 09 07:07:00 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 07:07:00 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 07:07:00 user nova-compute[72809]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1556535521</nova:name>
Aug 09 07:07:00 user nova-compute[72809]:       <nova:creationTime>2023-08-09 07:07:00</nova:creationTime>
Aug 09 07:07:00 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 07:07:00 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 07:07:00 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 07:07:00 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 07:07:00 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 07:07:00 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 07:07:00 user nova-compute[72809]:       </nova:flavor>
Aug 09 07:07:00 user nova-compute[72809]:       <nova:owner>
Aug 09 07:07:00 user nova-compute[72809]:         <nova:user uuid="740071d735364ce5b0e6a7bb0dbdffe3">tempest-ServerRescueNegativeTestJSON-1153742012-project-member</nova:user>
Aug 09 07:07:00 user nova-compute[72809]:         <nova:project uuid="e75b8536be334abba712e1c6f6886cdf">tempest-ServerRescueNegativeTestJSON-1153742012</nova:project>
Aug 09 07:07:00 user nova-compute[72809]:       </nova:owner>
Aug 09 07:07:00 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 07:07:00 user nova-compute[72809]:       <nova:ports>
Aug 09 07:07:00 user nova-compute[72809]:         <nova:port uuid="871a925e-dae2-45d5-8e6d-24d429032d70">
Aug 09 07:07:00 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 07:07:00 user nova-compute[72809]:         </nova:port>
Aug 09 07:07:00 user nova-compute[72809]:       </nova:ports>
Aug 09 07:07:00 user nova-compute[72809]:     </nova:instance>
Aug 09 07:07:00 user nova-compute[72809]:   </metadata>
Aug 09 07:07:00 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 07:07:00 user nova-compute[72809]:     <system>
Aug 09 07:07:00 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 07:07:00 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 07:07:00 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 07:07:00 user nova-compute[72809]:       <entry name="serial">63936bb9-97de-4a87-aa29-14129104c1d3</entry>
Aug 09 07:07:00 user nova-compute[72809]:       <entry name="uuid">63936bb9-97de-4a87-aa29-14129104c1d3</entry>
Aug 09 07:07:00 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 07:07:00 user nova-compute[72809]:     </system>
Aug 09 07:07:00 user nova-compute[72809]:   </sysinfo>
Aug 09 07:07:00 user nova-compute[72809]:   <os>
Aug 09 07:07:00 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 07:07:00 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 07:07:00 user nova-compute[72809]:   </os>
Aug 09 07:07:00 user nova-compute[72809]:   <features>
Aug 09 07:07:00 user nova-compute[72809]:     <acpi/>
Aug 09 07:07:00 user nova-compute[72809]:     <apic/>
Aug 09 07:07:00 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 07:07:00 user nova-compute[72809]:   </features>
Aug 09 07:07:00 user nova-compute[72809]:   <clock offset="utc">
Aug 09 07:07:00 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 07:07:00 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 07:07:00 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 07:07:00 user nova-compute[72809]:   </clock>
Aug 09 07:07:00 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 07:07:00 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 07:07:00 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 07:07:00 user nova-compute[72809]:   </cpu>
Aug 09 07:07:00 user nova-compute[72809]:   <devices>
Aug 09 07:07:00 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 07:07:00 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 07:07:00 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk.rescue"/>
Aug 09 07:07:00 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 07:07:00 user nova-compute[72809]:     </disk>
Aug 09 07:07:00 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 07:07:00 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 07:07:00 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk"/>
Aug 09 07:07:00 user nova-compute[72809]:       <target dev="vdb" bus="virtio"/>
Aug 09 07:07:00 user nova-compute[72809]:     </disk>
Aug 09 07:07:00 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 07:07:00 user nova-compute[72809]:       <mac address="fa:16:3e:a0:e1:1d"/>
Aug 09 07:07:00 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:07:00 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 07:07:00 user nova-compute[72809]:       <target dev="tap871a925e-da"/>
Aug 09 07:07:00 user nova-compute[72809]:     </interface>
Aug 09 07:07:00 user nova-compute[72809]:     <serial type="pty">
Aug 09 07:07:00 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/console.log" append="off"/>
Aug 09 07:07:00 user nova-compute[72809]:     </serial>
Aug 09 07:07:00 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 07:07:00 user nova-compute[72809]:     <video>
Aug 09 07:07:00 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:07:00 user nova-compute[72809]:     </video>
Aug 09 07:07:00 user nova-compute[72809]:     <rng model="virtio">
Aug 09 07:07:00 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 07:07:00 user nova-compute[72809]:     </rng>
Aug 09 07:07:00 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 07:07:00 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 07:07:00 user nova-compute[72809]:       <stats period="10"/>
Aug 09 07:07:00 user nova-compute[72809]:     </memballoon>
Aug 09 07:07:00 user nova-compute[72809]:   </devices>
Aug 09 07:07:00 user nova-compute[72809]: </domain>
Aug 09 07:07:00 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 07:07:00 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Instance destroyed successfully.
Aug 09 07:07:00 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] No VIF found with MAC fa:16:3e:a0:e1:1d, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG nova.compute.manager [req-c2f25f4f-da26-4cf7-b5a1-c509fd456d2e req-612a2d5e-772d-4591-a56f-34157577442c service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Received event network-vif-plugged-69cd2937-cfc9-42c1-bd26-c5debab643fc {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c2f25f4f-da26-4cf7-b5a1-c509fd456d2e req-612a2d5e-772d-4591-a56f-34157577442c service nova] Acquiring lock "48f0adeb-a5e8-4f81-a534-04c702c272a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c2f25f4f-da26-4cf7-b5a1-c509fd456d2e req-612a2d5e-772d-4591-a56f-34157577442c service nova] Lock "48f0adeb-a5e8-4f81-a534-04c702c272a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c2f25f4f-da26-4cf7-b5a1-c509fd456d2e req-612a2d5e-772d-4591-a56f-34157577442c service nova] Lock "48f0adeb-a5e8-4f81-a534-04c702c272a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG nova.compute.manager [req-c2f25f4f-da26-4cf7-b5a1-c509fd456d2e req-612a2d5e-772d-4591-a56f-34157577442c service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] No waiting events found dispatching network-vif-plugged-69cd2937-cfc9-42c1-bd26-c5debab643fc {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:07:00 user nova-compute[72809]: WARNING nova.compute.manager [req-c2f25f4f-da26-4cf7-b5a1-c509fd456d2e req-612a2d5e-772d-4591-a56f-34157577442c service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Received unexpected event network-vif-plugged-69cd2937-cfc9-42c1-bd26-c5debab643fc for instance with vm_state building and task_state spawning.
Aug 09 07:07:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:01 user nova-compute[72809]: DEBUG nova.compute.manager [req-2132f279-90b3-4bf8-9ac7-b1e1dc074388 req-ab1f839e-85f9-4abc-80a0-75c33c8132aa service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Received event network-vif-plugged-871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:07:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2132f279-90b3-4bf8-9ac7-b1e1dc074388 req-ab1f839e-85f9-4abc-80a0-75c33c8132aa service nova] Acquiring lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:07:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2132f279-90b3-4bf8-9ac7-b1e1dc074388 req-ab1f839e-85f9-4abc-80a0-75c33c8132aa service nova] Lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:07:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2132f279-90b3-4bf8-9ac7-b1e1dc074388 req-ab1f839e-85f9-4abc-80a0-75c33c8132aa service nova] Lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:07:01 user nova-compute[72809]: DEBUG nova.compute.manager [req-2132f279-90b3-4bf8-9ac7-b1e1dc074388 req-ab1f839e-85f9-4abc-80a0-75c33c8132aa service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] No waiting events found dispatching network-vif-plugged-871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:07:01 user nova-compute[72809]: WARNING nova.compute.manager [req-2132f279-90b3-4bf8-9ac7-b1e1dc074388 req-ab1f839e-85f9-4abc-80a0-75c33c8132aa service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Received unexpected event network-vif-plugged-871a925e-dae2-45d5-8e6d-24d429032d70 for instance with vm_state active and task_state rescuing.
Aug 09 07:07:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:02 user nova-compute[72809]: DEBUG nova.compute.manager [req-3ea069ce-14d0-4dab-8805-e07503a344fa req-ad4bb988-d567-4628-8929-8c6e28e209ba service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Received event network-vif-plugged-69cd2937-cfc9-42c1-bd26-c5debab643fc {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:07:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3ea069ce-14d0-4dab-8805-e07503a344fa req-ad4bb988-d567-4628-8929-8c6e28e209ba service nova] Acquiring lock "48f0adeb-a5e8-4f81-a534-04c702c272a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:07:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3ea069ce-14d0-4dab-8805-e07503a344fa req-ad4bb988-d567-4628-8929-8c6e28e209ba service nova] Lock "48f0adeb-a5e8-4f81-a534-04c702c272a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:07:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3ea069ce-14d0-4dab-8805-e07503a344fa req-ad4bb988-d567-4628-8929-8c6e28e209ba service nova] Lock "48f0adeb-a5e8-4f81-a534-04c702c272a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:07:02 user nova-compute[72809]: DEBUG nova.compute.manager [req-3ea069ce-14d0-4dab-8805-e07503a344fa req-ad4bb988-d567-4628-8929-8c6e28e209ba service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] No waiting events found dispatching network-vif-plugged-69cd2937-cfc9-42c1-bd26-c5debab643fc {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:07:02 user nova-compute[72809]: WARNING nova.compute.manager [req-3ea069ce-14d0-4dab-8805-e07503a344fa req-ad4bb988-d567-4628-8929-8c6e28e209ba service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Received unexpected event network-vif-plugged-69cd2937-cfc9-42c1-bd26-c5debab643fc for instance with vm_state building and task_state spawning.
Aug 09 07:07:03 user nova-compute[72809]: DEBUG nova.compute.manager [req-04830812-95bd-429f-9093-3ddffe910ec5 req-3387fd70-ecff-42ac-87b4-d7371cc2ccf0 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Received event network-vif-plugged-871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:07:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-04830812-95bd-429f-9093-3ddffe910ec5 req-3387fd70-ecff-42ac-87b4-d7371cc2ccf0 service nova] Acquiring lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:07:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-04830812-95bd-429f-9093-3ddffe910ec5 req-3387fd70-ecff-42ac-87b4-d7371cc2ccf0 service nova] Lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:07:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-04830812-95bd-429f-9093-3ddffe910ec5 req-3387fd70-ecff-42ac-87b4-d7371cc2ccf0 service nova] Lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:07:03 user nova-compute[72809]: DEBUG nova.compute.manager [req-04830812-95bd-429f-9093-3ddffe910ec5 req-3387fd70-ecff-42ac-87b4-d7371cc2ccf0 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] No waiting events found dispatching network-vif-plugged-871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:07:03 user nova-compute[72809]: WARNING nova.compute.manager [req-04830812-95bd-429f-9093-3ddffe910ec5 req-3387fd70-ecff-42ac-87b4-d7371cc2ccf0 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Received unexpected event network-vif-plugged-871a925e-dae2-45d5-8e6d-24d429032d70 for instance with vm_state active and task_state rescuing.
Aug 09 07:07:03 user nova-compute[72809]: DEBUG nova.compute.manager [req-04830812-95bd-429f-9093-3ddffe910ec5 req-3387fd70-ecff-42ac-87b4-d7371cc2ccf0 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Received event network-vif-plugged-871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:07:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-04830812-95bd-429f-9093-3ddffe910ec5 req-3387fd70-ecff-42ac-87b4-d7371cc2ccf0 service nova] Acquiring lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:07:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-04830812-95bd-429f-9093-3ddffe910ec5 req-3387fd70-ecff-42ac-87b4-d7371cc2ccf0 service nova] Lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:07:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-04830812-95bd-429f-9093-3ddffe910ec5 req-3387fd70-ecff-42ac-87b4-d7371cc2ccf0 service nova] Lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:07:03 user nova-compute[72809]: DEBUG nova.compute.manager [req-04830812-95bd-429f-9093-3ddffe910ec5 req-3387fd70-ecff-42ac-87b4-d7371cc2ccf0 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] No waiting events found dispatching network-vif-plugged-871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:07:03 user nova-compute[72809]: WARNING nova.compute.manager [req-04830812-95bd-429f-9093-3ddffe910ec5 req-3387fd70-ecff-42ac-87b4-d7371cc2ccf0 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Received unexpected event network-vif-plugged-871a925e-dae2-45d5-8e6d-24d429032d70 for instance with vm_state active and task_state rescuing.
Aug 09 07:07:03 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564823.4106293, 48f0adeb-a5e8-4f81-a534-04c702c272a3 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:07:03 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] VM Resumed (Lifecycle Event)
Aug 09 07:07:03 user nova-compute[72809]: DEBUG nova.compute.manager [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 07:07:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 07:07:03 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Instance spawned successfully.
Aug 09 07:07:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 07:07:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:03 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:07:03 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:07:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:07:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:07:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:07:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:07:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:07:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:07:03 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:07:03 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564823.414561, 48f0adeb-a5e8-4f81-a534-04c702c272a3 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:07:03 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] VM Started (Lifecycle Event)
Aug 09 07:07:03 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:07:03 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:07:03 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:07:03 user nova-compute[72809]: INFO nova.compute.manager [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Took 7.52 seconds to spawn the instance on the hypervisor.
Aug 09 07:07:03 user nova-compute[72809]: DEBUG nova.compute.manager [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:07:03 user nova-compute[72809]: INFO nova.compute.manager [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Took 20.06 seconds to build instance.
Aug 09 07:07:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0255876c-4f24-4b49-a5f6-c6ed9bff9879 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "48f0adeb-a5e8-4f81-a534-04c702c272a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.242s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:07:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:04 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Removed pending event for 63936bb9-97de-4a87-aa29-14129104c1d3 due to event {{(pid=72809) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 07:07:04 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564824.0380027, 63936bb9-97de-4a87-aa29-14129104c1d3 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:07:04 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] VM Resumed (Lifecycle Event)
Aug 09 07:07:04 user nova-compute[72809]: DEBUG nova.compute.manager [None req-f5627a9e-97d4-4152-b1c7-2ac3238732f6 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:07:04 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:07:04 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:07:04 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564824.0393295, 63936bb9-97de-4a87-aa29-14129104c1d3 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:07:04 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] VM Started (Lifecycle Event)
Aug 09 07:07:04 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:07:04 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:07:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:07:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:07:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72809) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 07:07:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:07:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:07:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:17 user nova-compute[72809]: DEBUG nova.compute.manager [req-49a3a78a-753a-4fed-b1d0-b6d2be4789fe req-0e32df75-ac49-4e51-af8e-9114ad91c685 service nova] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Received event network-changed-f11de67a-407a-46d8-853e-267e19d82001 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:07:17 user nova-compute[72809]: DEBUG nova.compute.manager [req-49a3a78a-753a-4fed-b1d0-b6d2be4789fe req-0e32df75-ac49-4e51-af8e-9114ad91c685 service nova] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Refreshing instance network info cache due to event network-changed-f11de67a-407a-46d8-853e-267e19d82001. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:07:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-49a3a78a-753a-4fed-b1d0-b6d2be4789fe req-0e32df75-ac49-4e51-af8e-9114ad91c685 service nova] Acquiring lock "refresh_cache-51432417-89cc-4cee-855d-c4b148e4bd37" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:07:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-49a3a78a-753a-4fed-b1d0-b6d2be4789fe req-0e32df75-ac49-4e51-af8e-9114ad91c685 service nova] Acquired lock "refresh_cache-51432417-89cc-4cee-855d-c4b148e4bd37" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:07:17 user nova-compute[72809]: DEBUG nova.network.neutron [req-49a3a78a-753a-4fed-b1d0-b6d2be4789fe req-0e32df75-ac49-4e51-af8e-9114ad91c685 service nova] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Refreshing network info cache for port f11de67a-407a-46d8-853e-267e19d82001 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:07:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0c22913b-dd20-43de-a8e0-e179c105503c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Acquiring lock "51432417-89cc-4cee-855d-c4b148e4bd37" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:07:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0c22913b-dd20-43de-a8e0-e179c105503c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "51432417-89cc-4cee-855d-c4b148e4bd37" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:07:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0c22913b-dd20-43de-a8e0-e179c105503c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Acquiring lock "51432417-89cc-4cee-855d-c4b148e4bd37-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:07:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0c22913b-dd20-43de-a8e0-e179c105503c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "51432417-89cc-4cee-855d-c4b148e4bd37-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:07:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0c22913b-dd20-43de-a8e0-e179c105503c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "51432417-89cc-4cee-855d-c4b148e4bd37-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:07:18 user nova-compute[72809]: INFO nova.compute.manager [None req-0c22913b-dd20-43de-a8e0-e179c105503c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Terminating instance
Aug 09 07:07:18 user nova-compute[72809]: DEBUG nova.compute.manager [None req-0c22913b-dd20-43de-a8e0-e179c105503c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:07:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:18 user nova-compute[72809]: DEBUG nova.compute.manager [req-43e75e75-0bac-443d-9a33-3ab4e0a9a73a req-1a3e2f07-347b-4daa-a60c-19b157b543d2 service nova] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Received event network-vif-unplugged-f11de67a-407a-46d8-853e-267e19d82001 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:07:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-43e75e75-0bac-443d-9a33-3ab4e0a9a73a req-1a3e2f07-347b-4daa-a60c-19b157b543d2 service nova] Acquiring lock "51432417-89cc-4cee-855d-c4b148e4bd37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:07:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-43e75e75-0bac-443d-9a33-3ab4e0a9a73a req-1a3e2f07-347b-4daa-a60c-19b157b543d2 service nova] Lock "51432417-89cc-4cee-855d-c4b148e4bd37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:07:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-43e75e75-0bac-443d-9a33-3ab4e0a9a73a req-1a3e2f07-347b-4daa-a60c-19b157b543d2 service nova] Lock "51432417-89cc-4cee-855d-c4b148e4bd37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:07:18 user nova-compute[72809]: DEBUG nova.compute.manager [req-43e75e75-0bac-443d-9a33-3ab4e0a9a73a req-1a3e2f07-347b-4daa-a60c-19b157b543d2 service nova] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] No waiting events found dispatching network-vif-unplugged-f11de67a-407a-46d8-853e-267e19d82001 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:07:18 user nova-compute[72809]: DEBUG nova.compute.manager [req-43e75e75-0bac-443d-9a33-3ab4e0a9a73a req-1a3e2f07-347b-4daa-a60c-19b157b543d2 service nova] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Received event network-vif-unplugged-f11de67a-407a-46d8-853e-267e19d82001 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:07:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:18 user nova-compute[72809]: DEBUG nova.network.neutron [req-49a3a78a-753a-4fed-b1d0-b6d2be4789fe req-0e32df75-ac49-4e51-af8e-9114ad91c685 service nova] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Updated VIF entry in instance network info cache for port f11de67a-407a-46d8-853e-267e19d82001. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:07:18 user nova-compute[72809]: DEBUG nova.network.neutron [req-49a3a78a-753a-4fed-b1d0-b6d2be4789fe req-0e32df75-ac49-4e51-af8e-9114ad91c685 service nova] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Updating instance_info_cache with network_info: [{"id": "f11de67a-407a-46d8-853e-267e19d82001", "address": "fa:16:3e:a6:83:61", "network": {"id": "aaea335c-52d5-402b-b53c-b53cc3d7385d", "bridge": "br-int", "label": "tempest-TestStampPattern-1348939935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77be39d2ba434d42bd6b08194503031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11de67a-40", "ovs_interfaceid": "f11de67a-407a-46d8-853e-267e19d82001", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:07:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-49a3a78a-753a-4fed-b1d0-b6d2be4789fe req-0e32df75-ac49-4e51-af8e-9114ad91c685 service nova] Releasing lock "refresh_cache-51432417-89cc-4cee-855d-c4b148e4bd37" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:07:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:18 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Instance destroyed successfully.
Aug 09 07:07:18 user nova-compute[72809]: DEBUG nova.objects.instance [None req-0c22913b-dd20-43de-a8e0-e179c105503c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lazy-loading 'resources' on Instance uuid 51432417-89cc-4cee-855d-c4b148e4bd37 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:07:18 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-0c22913b-dd20-43de-a8e0-e179c105503c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:00:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-58730234',display_name='tempest-TestStampPattern-server-58730234',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-58730234',id=28,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqS/2/2VeQQ93OP20t6ISd1xMlLR9FaU7uvyMUqE2hZscqHexQxbkOj1PbmtjEvjmecnyXPp9gBYtCCngYh9dMwRjEB6Of/ZdkUz4BqrXPYRgKqiRTv44Mwop2+/V3zEQ==',key_name='tempest-TestStampPattern-1744378759',keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:00:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77be39d2ba434d42bd6b08194503031d',ramdisk_id='',reservation_id='r-ct3mvjcp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1052665161',owner_user_name='tempest-TestStampPattern-1052665161-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:03:16Z,user_data=None,user_id='ddd99e6c6a034fffa82466ae88ea098d',uuid=51432417-89cc-4cee-855d-c4b148e4bd37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f11de67a-407a-46d8-853e-267e19d82001", "address": "fa:16:3e:a6:83:61", "network": {"id": "aaea335c-52d5-402b-b53c-b53cc3d7385d", "bridge": "br-int", "label": "tempest-TestStampPattern-1348939935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77be39d2ba434d42bd6b08194503031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11de67a-40", "ovs_interfaceid": "f11de67a-407a-46d8-853e-267e19d82001", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:07:18 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-0c22913b-dd20-43de-a8e0-e179c105503c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Converting VIF {"id": "f11de67a-407a-46d8-853e-267e19d82001", "address": "fa:16:3e:a6:83:61", "network": {"id": "aaea335c-52d5-402b-b53c-b53cc3d7385d", "bridge": "br-int", "label": "tempest-TestStampPattern-1348939935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77be39d2ba434d42bd6b08194503031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11de67a-40", "ovs_interfaceid": "f11de67a-407a-46d8-853e-267e19d82001", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:07:18 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-0c22913b-dd20-43de-a8e0-e179c105503c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:83:61,bridge_name='br-int',has_traffic_filtering=True,id=f11de67a-407a-46d8-853e-267e19d82001,network=Network(aaea335c-52d5-402b-b53c-b53cc3d7385d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11de67a-40') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:07:18 user nova-compute[72809]: DEBUG os_vif [None req-0c22913b-dd20-43de-a8e0-e179c105503c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:83:61,bridge_name='br-int',has_traffic_filtering=True,id=f11de67a-407a-46d8-853e-267e19d82001,network=Network(aaea335c-52d5-402b-b53c-b53cc3d7385d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11de67a-40') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:07:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf11de67a-40, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:07:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:07:18 user nova-compute[72809]: INFO os_vif [None req-0c22913b-dd20-43de-a8e0-e179c105503c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:83:61,bridge_name='br-int',has_traffic_filtering=True,id=f11de67a-407a-46d8-853e-267e19d82001,network=Network(aaea335c-52d5-402b-b53c-b53cc3d7385d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11de67a-40')
Aug 09 07:07:18 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-0c22913b-dd20-43de-a8e0-e179c105503c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Deleting instance files /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37_del
Aug 09 07:07:18 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-0c22913b-dd20-43de-a8e0-e179c105503c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Deletion of /opt/stack/data/nova/instances/51432417-89cc-4cee-855d-c4b148e4bd37_del complete
Aug 09 07:07:19 user nova-compute[72809]: INFO nova.compute.manager [None req-0c22913b-dd20-43de-a8e0-e179c105503c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 09 07:07:19 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-0c22913b-dd20-43de-a8e0-e179c105503c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:07:19 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:07:19 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:07:19 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:07:19 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Took 0.60 seconds to deallocate network for instance.
Aug 09 07:07:19 user nova-compute[72809]: DEBUG nova.compute.manager [req-ecd4ebac-1d85-4237-9f9e-2d4e5a525688 req-6402a437-ee20-43e2-958b-057dc939376b service nova] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Received event network-vif-deleted-f11de67a-407a-46d8-853e-267e19d82001 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:07:19 user nova-compute[72809]: INFO nova.compute.manager [req-ecd4ebac-1d85-4237-9f9e-2d4e5a525688 req-6402a437-ee20-43e2-958b-057dc939376b service nova] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Neutron deleted interface f11de67a-407a-46d8-853e-267e19d82001; detaching it from the instance and deleting it from the info cache
Aug 09 07:07:19 user nova-compute[72809]: DEBUG nova.network.neutron [req-ecd4ebac-1d85-4237-9f9e-2d4e5a525688 req-6402a437-ee20-43e2-958b-057dc939376b service nova] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:07:19 user nova-compute[72809]: DEBUG nova.compute.manager [req-ecd4ebac-1d85-4237-9f9e-2d4e5a525688 req-6402a437-ee20-43e2-958b-057dc939376b service nova] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Detach interface failed, port_id=f11de67a-407a-46d8-853e-267e19d82001, reason: Instance 51432417-89cc-4cee-855d-c4b148e4bd37 could not be found. {{(pid=72809) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 07:07:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0c22913b-dd20-43de-a8e0-e179c105503c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:07:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0c22913b-dd20-43de-a8e0-e179c105503c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:07:19 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-0c22913b-dd20-43de-a8e0-e179c105503c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:07:20 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-0c22913b-dd20-43de-a8e0-e179c105503c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:07:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0c22913b-dd20-43de-a8e0-e179c105503c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:07:20 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-0c22913b-dd20-43de-a8e0-e179c105503c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Deleted allocations for instance 51432417-89cc-4cee-855d-c4b148e4bd37
Aug 09 07:07:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0c22913b-dd20-43de-a8e0-e179c105503c tempest-TestStampPattern-1052665161 tempest-TestStampPattern-1052665161-project-member] Lock "51432417-89cc-4cee-855d-c4b148e4bd37" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.091s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:07:20 user nova-compute[72809]: DEBUG nova.compute.manager [req-698e8b7c-e0a4-45aa-aaf0-2132827ab3ad req-48e116f7-7e5f-42b1-84df-c63c7b544388 service nova] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Received event network-vif-plugged-f11de67a-407a-46d8-853e-267e19d82001 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:07:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-698e8b7c-e0a4-45aa-aaf0-2132827ab3ad req-48e116f7-7e5f-42b1-84df-c63c7b544388 service nova] Acquiring lock "51432417-89cc-4cee-855d-c4b148e4bd37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:07:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-698e8b7c-e0a4-45aa-aaf0-2132827ab3ad req-48e116f7-7e5f-42b1-84df-c63c7b544388 service nova] Lock "51432417-89cc-4cee-855d-c4b148e4bd37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:07:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-698e8b7c-e0a4-45aa-aaf0-2132827ab3ad req-48e116f7-7e5f-42b1-84df-c63c7b544388 service nova] Lock "51432417-89cc-4cee-855d-c4b148e4bd37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:07:20 user nova-compute[72809]: DEBUG nova.compute.manager [req-698e8b7c-e0a4-45aa-aaf0-2132827ab3ad req-48e116f7-7e5f-42b1-84df-c63c7b544388 service nova] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] No waiting events found dispatching network-vif-plugged-f11de67a-407a-46d8-853e-267e19d82001 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:07:20 user nova-compute[72809]: WARNING nova.compute.manager [req-698e8b7c-e0a4-45aa-aaf0-2132827ab3ad req-48e116f7-7e5f-42b1-84df-c63c7b544388 service nova] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Received unexpected event network-vif-plugged-f11de67a-407a-46d8-853e-267e19d82001 for instance with vm_state deleted and task_state None.
Aug 09 07:07:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3cea9276-7e31-4164-a361-6272131c9e60 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Acquiring lock "38319c37-9cc0-4e84-8415-ddcf37451daf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:07:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3cea9276-7e31-4164-a361-6272131c9e60 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lock "38319c37-9cc0-4e84-8415-ddcf37451daf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:07:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3cea9276-7e31-4164-a361-6272131c9e60 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Acquiring lock "38319c37-9cc0-4e84-8415-ddcf37451daf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:07:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3cea9276-7e31-4164-a361-6272131c9e60 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lock "38319c37-9cc0-4e84-8415-ddcf37451daf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:07:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3cea9276-7e31-4164-a361-6272131c9e60 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lock "38319c37-9cc0-4e84-8415-ddcf37451daf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:07:27 user nova-compute[72809]: INFO nova.compute.manager [None req-3cea9276-7e31-4164-a361-6272131c9e60 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Terminating instance
Aug 09 07:07:27 user nova-compute[72809]: DEBUG nova.compute.manager [None req-3cea9276-7e31-4164-a361-6272131c9e60 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:07:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:27 user nova-compute[72809]: DEBUG nova.compute.manager [req-130228df-ba47-4f5d-a25b-af18518e0daa req-3aabe595-0d14-4b91-9ffc-34c4ee289889 service nova] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Received event network-vif-unplugged-1b035fe4-63e9-43eb-9cd1-c7daa830c393 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:07:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-130228df-ba47-4f5d-a25b-af18518e0daa req-3aabe595-0d14-4b91-9ffc-34c4ee289889 service nova] Acquiring lock "38319c37-9cc0-4e84-8415-ddcf37451daf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:07:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-130228df-ba47-4f5d-a25b-af18518e0daa req-3aabe595-0d14-4b91-9ffc-34c4ee289889 service nova] Lock "38319c37-9cc0-4e84-8415-ddcf37451daf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:07:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-130228df-ba47-4f5d-a25b-af18518e0daa req-3aabe595-0d14-4b91-9ffc-34c4ee289889 service nova] Lock "38319c37-9cc0-4e84-8415-ddcf37451daf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:07:27 user nova-compute[72809]: DEBUG nova.compute.manager [req-130228df-ba47-4f5d-a25b-af18518e0daa req-3aabe595-0d14-4b91-9ffc-34c4ee289889 service nova] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] No waiting events found dispatching network-vif-unplugged-1b035fe4-63e9-43eb-9cd1-c7daa830c393 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:07:27 user nova-compute[72809]: DEBUG nova.compute.manager [req-130228df-ba47-4f5d-a25b-af18518e0daa req-3aabe595-0d14-4b91-9ffc-34c4ee289889 service nova] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Received event network-vif-unplugged-1b035fe4-63e9-43eb-9cd1-c7daa830c393 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:07:28 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Instance destroyed successfully.
Aug 09 07:07:28 user nova-compute[72809]: DEBUG nova.objects.instance [None req-3cea9276-7e31-4164-a361-6272131c9e60 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lazy-loading 'resources' on Instance uuid 38319c37-9cc0-4e84-8415-ddcf37451daf {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:07:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-3cea9276-7e31-4164-a361-6272131c9e60 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:58:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-626121031',display_name='tempest-ServersNegativeTestJSON-server-626121031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-626121031',id=25,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:58:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='adb54b76021d41c3b047dcad448441d0',ramdisk_id='',reservation_id='r-k69wf00n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-169525689',owner_user_name='tempest-ServersNegativeTestJSON-169525689-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:58:41Z,user_data=None,user_id='9dc41dc12f02418eba58bfce4128b26d',uuid=38319c37-9cc0-4e84-8415-ddcf37451daf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b035fe4-63e9-43eb-9cd1-c7daa830c393", "address": "fa:16:3e:6f:5e:56", "network": {"id": "957d253a-5f0b-4a0d-89e0-5a4ee590929b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1432478722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb54b76021d41c3b047dcad448441d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b035fe4-63", "ovs_interfaceid": "1b035fe4-63e9-43eb-9cd1-c7daa830c393", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:07:28 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-3cea9276-7e31-4164-a361-6272131c9e60 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Converting VIF {"id": "1b035fe4-63e9-43eb-9cd1-c7daa830c393", "address": "fa:16:3e:6f:5e:56", "network": {"id": "957d253a-5f0b-4a0d-89e0-5a4ee590929b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1432478722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb54b76021d41c3b047dcad448441d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b035fe4-63", "ovs_interfaceid": "1b035fe4-63e9-43eb-9cd1-c7daa830c393", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:07:28 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-3cea9276-7e31-4164-a361-6272131c9e60 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:5e:56,bridge_name='br-int',has_traffic_filtering=True,id=1b035fe4-63e9-43eb-9cd1-c7daa830c393,network=Network(957d253a-5f0b-4a0d-89e0-5a4ee590929b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b035fe4-63') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:07:28 user nova-compute[72809]: DEBUG os_vif [None req-3cea9276-7e31-4164-a361-6272131c9e60 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:5e:56,bridge_name='br-int',has_traffic_filtering=True,id=1b035fe4-63e9-43eb-9cd1-c7daa830c393,network=Network(957d253a-5f0b-4a0d-89e0-5a4ee590929b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b035fe4-63') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:07:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b035fe4-63, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:07:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:28 user nova-compute[72809]: INFO os_vif [None req-3cea9276-7e31-4164-a361-6272131c9e60 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:5e:56,bridge_name='br-int',has_traffic_filtering=True,id=1b035fe4-63e9-43eb-9cd1-c7daa830c393,network=Network(957d253a-5f0b-4a0d-89e0-5a4ee590929b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b035fe4-63')
Aug 09 07:07:28 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-3cea9276-7e31-4164-a361-6272131c9e60 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Deleting instance files /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf_del
Aug 09 07:07:28 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-3cea9276-7e31-4164-a361-6272131c9e60 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Deletion of /opt/stack/data/nova/instances/38319c37-9cc0-4e84-8415-ddcf37451daf_del complete
Aug 09 07:07:28 user nova-compute[72809]: INFO nova.compute.manager [None req-3cea9276-7e31-4164-a361-6272131c9e60 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 09 07:07:28 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-3cea9276-7e31-4164-a361-6272131c9e60 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:07:28 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:07:28 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:07:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:29 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:07:29 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Took 0.62 seconds to deallocate network for instance.
Aug 09 07:07:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-b2ccaad9-8eba-482a-b1d1-a1ea4b101836 req-1865012d-c431-4f16-835e-7ae3559c68db service nova] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Received event network-vif-deleted-1b035fe4-63e9-43eb-9cd1-c7daa830c393 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:07:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3cea9276-7e31-4164-a361-6272131c9e60 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:07:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3cea9276-7e31-4164-a361-6272131c9e60 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:07:29 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-3cea9276-7e31-4164-a361-6272131c9e60 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:07:29 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-3cea9276-7e31-4164-a361-6272131c9e60 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:07:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3cea9276-7e31-4164-a361-6272131c9e60 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:07:29 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-3cea9276-7e31-4164-a361-6272131c9e60 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Deleted allocations for instance 38319c37-9cc0-4e84-8415-ddcf37451daf
Aug 09 07:07:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3cea9276-7e31-4164-a361-6272131c9e60 tempest-ServersNegativeTestJSON-169525689 tempest-ServersNegativeTestJSON-169525689-project-member] Lock "38319c37-9cc0-4e84-8415-ddcf37451daf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.028s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:07:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-0cf2113f-c87a-430c-98ff-2aa9a76a8670 req-0335f834-6a1c-497d-96d8-5cb7a067928c service nova] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Received event network-vif-plugged-1b035fe4-63e9-43eb-9cd1-c7daa830c393 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:07:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0cf2113f-c87a-430c-98ff-2aa9a76a8670 req-0335f834-6a1c-497d-96d8-5cb7a067928c service nova] Acquiring lock "38319c37-9cc0-4e84-8415-ddcf37451daf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:07:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0cf2113f-c87a-430c-98ff-2aa9a76a8670 req-0335f834-6a1c-497d-96d8-5cb7a067928c service nova] Lock "38319c37-9cc0-4e84-8415-ddcf37451daf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:07:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0cf2113f-c87a-430c-98ff-2aa9a76a8670 req-0335f834-6a1c-497d-96d8-5cb7a067928c service nova] Lock "38319c37-9cc0-4e84-8415-ddcf37451daf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:07:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-0cf2113f-c87a-430c-98ff-2aa9a76a8670 req-0335f834-6a1c-497d-96d8-5cb7a067928c service nova] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] No waiting events found dispatching network-vif-plugged-1b035fe4-63e9-43eb-9cd1-c7daa830c393 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:07:29 user nova-compute[72809]: WARNING nova.compute.manager [req-0cf2113f-c87a-430c-98ff-2aa9a76a8670 req-0335f834-6a1c-497d-96d8-5cb7a067928c service nova] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Received unexpected event network-vif-plugged-1b035fe4-63e9-43eb-9cd1-c7daa830c393 for instance with vm_state deleted and task_state None.
Aug 09 07:07:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:33 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691564838.8820748, 51432417-89cc-4cee-855d-c4b148e4bd37 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:07:33 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] VM Stopped (Lifecycle Event)
Aug 09 07:07:33 user nova-compute[72809]: DEBUG nova.compute.manager [None req-d3d38ac7-6f66-4fc9-b3ee-57ab779f2da6 None None] [instance: 51432417-89cc-4cee-855d-c4b148e4bd37] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:07:36 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:07:36 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 07:07:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-466a8e58-5f88-4ffe-a7fd-a346003f3508" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:07:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-466a8e58-5f88-4ffe-a7fd-a346003f3508" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:07:36 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 07:07:37 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Updating instance_info_cache with network_info: [{"id": "8a95ff1b-0686-455d-977c-cedac8be3930", "address": "fa:16:3e:42:8d:bd", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a95ff1b-06", "ovs_interfaceid": "8a95ff1b-0686-455d-977c-cedac8be3930", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:07:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-466a8e58-5f88-4ffe-a7fd-a346003f3508" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:07:37 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 07:07:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:39 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:07:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:07:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:07:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:07:39 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 07:07:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:07:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:07:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:07:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:07:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:07:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:07:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:07:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:07:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:07:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:07:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:07:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:07:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:07:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:07:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:07:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:07:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:07:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:07:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:07:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:07:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:07:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3249e5c-5657-4c08-8ada-50820d9955d4/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:07:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3249e5c-5657-4c08-8ada-50820d9955d4/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:07:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3249e5c-5657-4c08-8ada-50820d9955d4/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:07:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3249e5c-5657-4c08-8ada-50820d9955d4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:07:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:07:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:07:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:07:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:07:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:07:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:07:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:07:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:07:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:07:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:07:42 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk (vdb) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:07:42 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:07:42 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:07:42 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=7424MB free_disk=25.121578216552734GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 07:07:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:07:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:07:42 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 336770eb-4f09-4134-92ef-f96039bf4fa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:07:42 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 1bde423f-0b73-448f-bdce-8d6af96d8fc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:07:42 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance bebd5a14-6272-4de1-a1a1-4fb45b867c7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:07:42 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 339372ed-140d-4226-ba00-2cc682214d5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:07:42 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 466a8e58-5f88-4ffe-a7fd-a346003f3508 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:07:42 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance a754327a-9985-4430-af66-1d8bc82fb868 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:07:42 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 63936bb9-97de-4a87-aa29-14129104c1d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:07:42 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 6e9996e8-c5eb-42c1-b88f-d75654e160c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:07:42 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance b3249e5c-5657-4c08-8ada-50820d9955d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:07:42 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 48f0adeb-a5e8-4f81-a534-04c702c272a3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:07:42 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 07:07:42 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 07:07:43 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:07:43 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:07:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 07:07:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.505s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:07:43 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691564848.4167666, 38319c37-9cc0-4e84-8415-ddcf37451daf => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:07:43 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] VM Stopped (Lifecycle Event)
Aug 09 07:07:43 user nova-compute[72809]: DEBUG nova.compute.manager [None req-c5b86f24-16b2-4342-81b8-b9b8f9808e2d None None] [instance: 38319c37-9cc0-4e84-8415-ddcf37451daf] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:07:43 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:07:44 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:07:44 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:07:44 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:07:44 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:07:45 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:07:45 user nova-compute[72809]: DEBUG nova.compute.manager [None req-76048cd7-9259-4b81-a99d-6e27f59553f6 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:07:45 user nova-compute[72809]: INFO nova.compute.manager [None req-76048cd7-9259-4b81-a99d-6e27f59553f6 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] instance snapshotting
Aug 09 07:07:45 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-76048cd7-9259-4b81-a99d-6e27f59553f6 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Beginning live snapshot process
Aug 09 07:07:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-76048cd7-9259-4b81-a99d-6e27f59553f6 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json -f qcow2 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:07:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-76048cd7-9259-4b81-a99d-6e27f59553f6 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json -f qcow2" returned: 0 in 0.142s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:07:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-76048cd7-9259-4b81-a99d-6e27f59553f6 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json -f qcow2 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:07:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-76048cd7-9259-4b81-a99d-6e27f59553f6 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json -f qcow2" returned: 0 in 0.134s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:07:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-76048cd7-9259-4b81-a99d-6e27f59553f6 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:07:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-76048cd7-9259-4b81-a99d-6e27f59553f6 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.141s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:07:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-76048cd7-9259-4b81-a99d-6e27f59553f6 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpiagrydtl/2b04d63faa6f40ffbd46e6b5db6269f1.delta 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:07:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-76048cd7-9259-4b81-a99d-6e27f59553f6 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpiagrydtl/2b04d63faa6f40ffbd46e6b5db6269f1.delta 1073741824" returned: 0 in 0.061s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:07:46 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-76048cd7-9259-4b81-a99d-6e27f59553f6 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 07:07:47 user nova-compute[72809]: DEBUG nova.compute.manager [req-e062e581-a698-4216-ba2b-13f5986f5599 req-3b20ac3c-bc4a-4b4c-8387-6fe04432ab59 service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Received event network-changed-fa550cf1-3f73-4435-a6fe-91752e664b2f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:07:47 user nova-compute[72809]: DEBUG nova.compute.manager [req-e062e581-a698-4216-ba2b-13f5986f5599 req-3b20ac3c-bc4a-4b4c-8387-6fe04432ab59 service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Refreshing instance network info cache due to event network-changed-fa550cf1-3f73-4435-a6fe-91752e664b2f. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:07:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e062e581-a698-4216-ba2b-13f5986f5599 req-3b20ac3c-bc4a-4b4c-8387-6fe04432ab59 service nova] Acquiring lock "refresh_cache-b3249e5c-5657-4c08-8ada-50820d9955d4" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:07:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e062e581-a698-4216-ba2b-13f5986f5599 req-3b20ac3c-bc4a-4b4c-8387-6fe04432ab59 service nova] Acquired lock "refresh_cache-b3249e5c-5657-4c08-8ada-50820d9955d4" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:07:47 user nova-compute[72809]: DEBUG nova.network.neutron [req-e062e581-a698-4216-ba2b-13f5986f5599 req-3b20ac3c-bc4a-4b4c-8387-6fe04432ab59 service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Refreshing network info cache for port fa550cf1-3f73-4435-a6fe-91752e664b2f {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:07:47 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-76048cd7-9259-4b81-a99d-6e27f59553f6 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72809) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 07:07:47 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-76048cd7-9259-4b81-a99d-6e27f59553f6 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72809) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 07:07:47 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-76048cd7-9259-4b81-a99d-6e27f59553f6 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 07:07:47 user nova-compute[72809]: DEBUG nova.privsep.utils [None req-76048cd7-9259-4b81-a99d-6e27f59553f6 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72809) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 07:07:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-76048cd7-9259-4b81-a99d-6e27f59553f6 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpiagrydtl/2b04d63faa6f40ffbd46e6b5db6269f1.delta /opt/stack/data/nova/instances/snapshots/tmpiagrydtl/2b04d63faa6f40ffbd46e6b5db6269f1 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:07:47 user nova-compute[72809]: DEBUG nova.network.neutron [req-e062e581-a698-4216-ba2b-13f5986f5599 req-3b20ac3c-bc4a-4b4c-8387-6fe04432ab59 service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Updated VIF entry in instance network info cache for port fa550cf1-3f73-4435-a6fe-91752e664b2f. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:07:47 user nova-compute[72809]: DEBUG nova.network.neutron [req-e062e581-a698-4216-ba2b-13f5986f5599 req-3b20ac3c-bc4a-4b4c-8387-6fe04432ab59 service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Updating instance_info_cache with network_info: [{"id": "fa550cf1-3f73-4435-a6fe-91752e664b2f", "address": "fa:16:3e:06:e6:0d", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa550cf1-3f", "ovs_interfaceid": "fa550cf1-3f73-4435-a6fe-91752e664b2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:07:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e062e581-a698-4216-ba2b-13f5986f5599 req-3b20ac3c-bc4a-4b4c-8387-6fe04432ab59 service nova] Releasing lock "refresh_cache-b3249e5c-5657-4c08-8ada-50820d9955d4" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:07:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-76048cd7-9259-4b81-a99d-6e27f59553f6 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpiagrydtl/2b04d63faa6f40ffbd46e6b5db6269f1.delta /opt/stack/data/nova/instances/snapshots/tmpiagrydtl/2b04d63faa6f40ffbd46e6b5db6269f1" returned: 0 in 0.589s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:07:48 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-76048cd7-9259-4b81-a99d-6e27f59553f6 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Snapshot extracted, beginning image upload
Aug 09 07:07:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:49 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:07:49 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:07:49 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 07:07:51 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-76048cd7-9259-4b81-a99d-6e27f59553f6 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Snapshot image upload complete
Aug 09 07:07:51 user nova-compute[72809]: INFO nova.compute.manager [None req-76048cd7-9259-4b81-a99d-6e27f59553f6 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Took 5.20 seconds to snapshot the instance on the hypervisor.
Aug 09 07:07:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "b3249e5c-5657-4c08-8ada-50820d9955d4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:07:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "b3249e5c-5657-4c08-8ada-50820d9955d4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:07:51 user nova-compute[72809]: DEBUG nova.objects.instance [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lazy-loading 'flavor' on Instance uuid b3249e5c-5657-4c08-8ada-50820d9955d4 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:07:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "b3249e5c-5657-4c08-8ada-50820d9955d4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:07:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "b3249e5c-5657-4c08-8ada-50820d9955d4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:07:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "b3249e5c-5657-4c08-8ada-50820d9955d4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:07:51 user nova-compute[72809]: INFO nova.compute.manager [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Attaching volume 48ee4a7e-ba48-4426-96d7-e682e919d2a9 to /dev/vdb
Aug 09 07:07:51 user nova-compute[72809]: DEBUG os_brick.utils [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:07:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:07:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:07:51 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58f4e2d-8b52-43e5-8648-9c16ad42faa3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:07:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:07:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:07:51 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cdd7ec-25c8-4c10-910c-10a15903cb59]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:07:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:07:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:07:51 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a97fba9-b77f-40f1-98fa-2ae3032537d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:07:51 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d253ce-9cba-48ed-bd7e-d7a124d85c9f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:07:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:07:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:07:51 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 07:07:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:07:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:07:51 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 07:07:51 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0929fc2e-19f7-4bd3-923a-a8a911f38010]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:07:51 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 07:07:51 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 07:07:51 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 07:07:51 user nova-compute[72809]: DEBUG os_brick.utils [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:07:51 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Updating existing volume attachment record: 050828bb-b972-4a67-853d-f0623c1e6651 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 07:07:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:07:59 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 07:07:59 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qBlYMeko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:07:59 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:07:59 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:07:59 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:07:59 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:07:59 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:07:59 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:07:59 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 07:07:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9 -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:07:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:07:59 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[29385ce7-d52d-4d11-a950-1079b47e2fb0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:07:59 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 07:07:59 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:07:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:07:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:07:59 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8fdec6-2c34-4e94-bbbc-836d121b617d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:07:59 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9] added
Aug 09 07:07:59 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:07:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[167c96b7-633e-43c4-96da-13ce52cacc3a]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[00816158-1598-4dc0-8af9-c4d0a1e83543]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qBlYMeko {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qBlYMeko" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4baec03a-6c35-4831-94bc-7d5eba113b6f]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qBlYMeko'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.115s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4056c9e4-80ca-49bf-bec8-0e8fe57839f7]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4e3646-18b8-4d90-a1d2-3bb31f47cd30]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:08:00 user nova-compute[72809]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:08:00 user nova-compute[72809]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)
Aug 09 07:08:00 user nova-compute[72809]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a (non-flash)
Aug 09 07:08:00 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:08:00 user nova-compute[72809]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:08:00 user nova-compute[72809]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)
Aug 09 07:08:00 user nova-compute[72809]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a (non-flash)
Aug 09 07:08:00 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9 -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d88f28-a681-408c-bf2f-c9628697cef9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9, portal: 172.16.0.220,3260]
Aug 09 07:08:00 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9, portal: 172.16.0.220,3260] successful.
Aug 09 07:08:00 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd61ff5-9162-4a68-86e0-455b158ad54a]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[255ff331-1c50-404c-b970-2bdf73ee8c7d]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:08:00 user nova-compute[72809]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:08:00 user nova-compute[72809]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)
Aug 09 07:08:00 user nova-compute[72809]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a (non-flash)
Aug 09 07:08:00 user nova-compute[72809]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9 (non-flash)
Aug 09 07:08:00 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:08:00 user nova-compute[72809]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:08:00 user nova-compute[72809]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)
Aug 09 07:08:00 user nova-compute[72809]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a (non-flash)
Aug 09 07:08:00 user nova-compute[72809]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9 (non-flash)
Aug 09 07:08:00 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.423s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] HCTL ('37', '-', '-', 0) found on session 40 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33c89c2-abe5-48d8-a7dc-539b4ec0f89b]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Searching for a device in session 40 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:08:00 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qBlYMeko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 07:08:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.458s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:08:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] <== connect_volume: return (1461ms) {'type': 'block', 'scsi_wwn': '26437363031306166', 'path': '/dev/sdf'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:08:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437363031306166', 'path': '/dev/sdf'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 07:08:01 user nova-compute[72809]: DEBUG nova.objects.instance [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lazy-loading 'flavor' on Instance uuid b3249e5c-5657-4c08-8ada-50820d9955d4 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:08:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 07:08:01 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:08:01 user nova-compute[72809]:   <source dev="/dev/sdf"/>
Aug 09 07:08:01 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:08:01 user nova-compute[72809]:   <serial>48ee4a7e-ba48-4426-96d7-e682e919d2a9</serial>
Aug 09 07:08:01 user nova-compute[72809]: </disk>
Aug 09 07:08:01 user nova-compute[72809]:  {{(pid=72809) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 07:08:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:08:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:08:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] No VIF found with MAC fa:16:3e:06:e6:0d, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:08:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4aa47236-255a-4e61-9c7f-d988bd54da2f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "b3249e5c-5657-4c08-8ada-50820d9955d4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.780s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:08:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "b3249e5c-5657-4c08-8ada-50820d9955d4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:08:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "b3249e5c-5657-4c08-8ada-50820d9955d4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:08:02 user nova-compute[72809]: INFO nova.compute.manager [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Detaching volume 48ee4a7e-ba48-4426-96d7-e682e919d2a9
Aug 09 07:08:02 user nova-compute[72809]: INFO nova.virt.block_device [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Attempting to driver detach volume 48ee4a7e-ba48-4426-96d7-e682e919d2a9 from mountpoint /dev/vdb
Aug 09 07:08:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Attempting to detach device vdb from instance b3249e5c-5657-4c08-8ada-50820d9955d4 from the persistent domain config. {{(pid=72809) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 07:08:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:08:02 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:08:02 user nova-compute[72809]:   <source dev="/dev/sdf"/>
Aug 09 07:08:02 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:08:02 user nova-compute[72809]:   <serial>48ee4a7e-ba48-4426-96d7-e682e919d2a9</serial>
Aug 09 07:08:02 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 07:08:02 user nova-compute[72809]: </disk>
Aug 09 07:08:02 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:08:02 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Successfully detached device vdb from instance b3249e5c-5657-4c08-8ada-50820d9955d4 from the persistent domain config.
Aug 09 07:08:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b3249e5c-5657-4c08-8ada-50820d9955d4 from the live domain config. {{(pid=72809) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 07:08:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:08:02 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:08:02 user nova-compute[72809]:   <source dev="/dev/sdf"/>
Aug 09 07:08:02 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:08:02 user nova-compute[72809]:   <serial>48ee4a7e-ba48-4426-96d7-e682e919d2a9</serial>
Aug 09 07:08:02 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 07:08:02 user nova-compute[72809]: </disk>
Aug 09 07:08:02 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Received event <DeviceRemovedEvent: 1691564883.0001667, b3249e5c-5657-4c08-8ada-50820d9955d4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72809) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b3249e5c-5657-4c08-8ada-50820d9955d4 {{(pid=72809) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 07:08:03 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Successfully detached device vdb from instance b3249e5c-5657-4c08-8ada-50820d9955d4 from the live domain config.
Aug 09 07:08:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qBlYMeko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:08:03 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:08:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c41243e-b486-4ff8-9d3e-6641450aac5c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a9d77f-f2ee-47e6-a281-b8a73046f229]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:08:03 user nova-compute[72809]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:08:03 user nova-compute[72809]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)
Aug 09 07:08:03 user nova-compute[72809]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a (non-flash)
Aug 09 07:08:03 user nova-compute[72809]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9 (non-flash)
Aug 09 07:08:03 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:08:03 user nova-compute[72809]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:08:03 user nova-compute[72809]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)
Aug 09 07:08:03 user nova-compute[72809]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a (non-flash)
Aug 09 07:08:03 user nova-compute[72809]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9 (non-flash)
Aug 09 07:08:03 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc15861e200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9'): ({'sdf'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Removing single pathed devices sdf {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b5a97c-e555-47f1-b48d-b2d5af0b8494]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce99eeb-dd74-42de-b10e-9dfc754394e7]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Flushing IO for device /dev/sdf {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b16e12-c44b-4afc-bd87-ddc7ff4c1580]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf5c7fd-c213-4ec7-952f-748ea0ce665b]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] SCSI volumes sdf have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b285bc2d-0a28-41a1-b338-615023e0639a]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9 -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[083fe462-b9f2-4f61-80bd-dcd133c835a5]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9, portal: 172.16.0.220,3260]
Aug 09 07:08:03 user nova-compute[72809]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9, portal: 172.16.0.220,3260] successful.
Aug 09 07:08:03 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9 -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48ee4a7e-ba48-4426-96d7-e682e919d2a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec9a7c0-52d7-4dab-b05d-b1e2329978db]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] <== disconnect_volume: return (292ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:04 user nova-compute[72809]: INFO nova.compute.manager [None req-7f39973d-ddd7-4783-adf0-cdec332e5141 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Get console output
Aug 09 07:08:04 user nova-compute[72809]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 09 07:08:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:09 user nova-compute[72809]: DEBUG nova.objects.instance [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lazy-loading 'flavor' on Instance uuid b3249e5c-5657-4c08-8ada-50820d9955d4 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:08:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-be3e8042-56be-4196-8773-4a2ee1f0dca4 tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "b3249e5c-5657-4c08-8ada-50820d9955d4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.901s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:08:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:21 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:08:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72809) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 07:08:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:08:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:08:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:36 user nova-compute[72809]: DEBUG nova.compute.manager [req-2938e606-0f2a-4fff-8946-a981b3a2231f req-8cfbfec8-1de6-4ec4-8dae-a1b6941fd3f5 service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Received event network-changed-69cd2937-cfc9-42c1-bd26-c5debab643fc {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:08:36 user nova-compute[72809]: DEBUG nova.compute.manager [req-2938e606-0f2a-4fff-8946-a981b3a2231f req-8cfbfec8-1de6-4ec4-8dae-a1b6941fd3f5 service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Refreshing instance network info cache due to event network-changed-69cd2937-cfc9-42c1-bd26-c5debab643fc. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:08:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2938e606-0f2a-4fff-8946-a981b3a2231f req-8cfbfec8-1de6-4ec4-8dae-a1b6941fd3f5 service nova] Acquiring lock "refresh_cache-48f0adeb-a5e8-4f81-a534-04c702c272a3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:08:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2938e606-0f2a-4fff-8946-a981b3a2231f req-8cfbfec8-1de6-4ec4-8dae-a1b6941fd3f5 service nova] Acquired lock "refresh_cache-48f0adeb-a5e8-4f81-a534-04c702c272a3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:08:36 user nova-compute[72809]: DEBUG nova.network.neutron [req-2938e606-0f2a-4fff-8946-a981b3a2231f req-8cfbfec8-1de6-4ec4-8dae-a1b6941fd3f5 service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Refreshing network info cache for port 69cd2937-cfc9-42c1-bd26-c5debab643fc {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:08:36 user nova-compute[72809]: DEBUG nova.network.neutron [req-2938e606-0f2a-4fff-8946-a981b3a2231f req-8cfbfec8-1de6-4ec4-8dae-a1b6941fd3f5 service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Updated VIF entry in instance network info cache for port 69cd2937-cfc9-42c1-bd26-c5debab643fc. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:08:36 user nova-compute[72809]: DEBUG nova.network.neutron [req-2938e606-0f2a-4fff-8946-a981b3a2231f req-8cfbfec8-1de6-4ec4-8dae-a1b6941fd3f5 service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Updating instance_info_cache with network_info: [{"id": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "address": "fa:16:3e:43:7d:86", "network": {"id": "2bd3fecc-598f-4b7d-a306-5b31f8e81019", "bridge": "br-int", "label": "tempest-TestShelveInstance-696590898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0c708ffc744c3ab8175ad7b939e4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd2937-cf", "ovs_interfaceid": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:08:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2938e606-0f2a-4fff-8946-a981b3a2231f req-8cfbfec8-1de6-4ec4-8dae-a1b6941fd3f5 service nova] Releasing lock "refresh_cache-48f0adeb-a5e8-4f81-a534-04c702c272a3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:08:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Acquiring lock "48f0adeb-a5e8-4f81-a534-04c702c272a3" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:08:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "48f0adeb-a5e8-4f81-a534-04c702c272a3" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:08:36 user nova-compute[72809]: INFO nova.compute.manager [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Shelve offloading
Aug 09 07:08:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:37 user nova-compute[72809]: DEBUG nova.compute.manager [req-61957085-90f0-44a1-80f7-d39ea2ec6af7 req-6261e6b1-b914-4bcd-976e-ac453d79b8b7 service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Received event network-vif-unplugged-69cd2937-cfc9-42c1-bd26-c5debab643fc {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:08:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-61957085-90f0-44a1-80f7-d39ea2ec6af7 req-6261e6b1-b914-4bcd-976e-ac453d79b8b7 service nova] Acquiring lock "48f0adeb-a5e8-4f81-a534-04c702c272a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:08:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-61957085-90f0-44a1-80f7-d39ea2ec6af7 req-6261e6b1-b914-4bcd-976e-ac453d79b8b7 service nova] Lock "48f0adeb-a5e8-4f81-a534-04c702c272a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:08:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-61957085-90f0-44a1-80f7-d39ea2ec6af7 req-6261e6b1-b914-4bcd-976e-ac453d79b8b7 service nova] Lock "48f0adeb-a5e8-4f81-a534-04c702c272a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:08:37 user nova-compute[72809]: DEBUG nova.compute.manager [req-61957085-90f0-44a1-80f7-d39ea2ec6af7 req-6261e6b1-b914-4bcd-976e-ac453d79b8b7 service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] No waiting events found dispatching network-vif-unplugged-69cd2937-cfc9-42c1-bd26-c5debab643fc {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:08:37 user nova-compute[72809]: WARNING nova.compute.manager [req-61957085-90f0-44a1-80f7-d39ea2ec6af7 req-6261e6b1-b914-4bcd-976e-ac453d79b8b7 service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Received unexpected event network-vif-unplugged-69cd2937-cfc9-42c1-bd26-c5debab643fc for instance with vm_state active and task_state shelving.
Aug 09 07:08:37 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Instance destroyed successfully.
Aug 09 07:08:37 user nova-compute[72809]: DEBUG nova.compute.manager [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:08:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Acquiring lock "refresh_cache-48f0adeb-a5e8-4f81-a534-04c702c272a3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:08:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Acquired lock "refresh_cache-48f0adeb-a5e8-4f81-a534-04c702c272a3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:08:37 user nova-compute[72809]: DEBUG nova.network.neutron [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:08:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:38 user nova-compute[72809]: DEBUG nova.network.neutron [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Updating instance_info_cache with network_info: [{"id": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "address": "fa:16:3e:43:7d:86", "network": {"id": "2bd3fecc-598f-4b7d-a306-5b31f8e81019", "bridge": "br-int", "label": "tempest-TestShelveInstance-696590898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0c708ffc744c3ab8175ad7b939e4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd2937-cf", "ovs_interfaceid": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:08:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Releasing lock "refresh_cache-48f0adeb-a5e8-4f81-a534-04c702c272a3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:08:38 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:08:38 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 07:08:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-336770eb-4f09-4134-92ef-f96039bf4fa9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:08:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-336770eb-4f09-4134-92ef-f96039bf4fa9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:08:38 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 07:08:39 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Instance destroyed successfully.
Aug 09 07:08:39 user nova-compute[72809]: DEBUG nova.objects.instance [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lazy-loading 'resources' on Instance uuid 48f0adeb-a5e8-4f81-a534-04c702c272a3 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:06:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1995239041',display_name='tempest-TestShelveInstance-server-1995239041',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1995239041',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNltj5AhfdReKC+XXSY6ejv8Ie2lm2YSrdkcUJXL7q6V25F5DxWfy2C7Pk7FV62dJX0Li1dF/73C3Hzfrynk0pBWPWkfYCaD3NMi4Kd0GOmpueQ4DMju5iODY6Pa9axjOQ==',key_name='tempest-TestShelveInstance-1236424892',keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:07:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b0c708ffc744c3ab8175ad7b939e4e3',ramdisk_id='',reservation_id='r-1lnz0lx6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1139600942',owner_user_name='tempest-TestShelveInstance-1139600942-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:07:04Z,user_data=None,user_id='e0e9000c85ba4fa5aef9c2c2b592b950',uuid=48f0adeb-a5e8-4f81-a534-04c702c272a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "address": "fa:16:3e:43:7d:86", "network": {"id": "2bd3fecc-598f-4b7d-a306-5b31f8e81019", "bridge": "br-int", "label": "tempest-TestShelveInstance-696590898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0c708ffc744c3ab8175ad7b939e4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd2937-cf", "ovs_interfaceid": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Converting VIF {"id": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "address": "fa:16:3e:43:7d:86", "network": {"id": "2bd3fecc-598f-4b7d-a306-5b31f8e81019", "bridge": "br-int", "label": "tempest-TestShelveInstance-696590898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0c708ffc744c3ab8175ad7b939e4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd2937-cf", "ovs_interfaceid": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:7d:86,bridge_name='br-int',has_traffic_filtering=True,id=69cd2937-cfc9-42c1-bd26-c5debab643fc,network=Network(2bd3fecc-598f-4b7d-a306-5b31f8e81019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69cd2937-cf') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG os_vif [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:7d:86,bridge_name='br-int',has_traffic_filtering=True,id=69cd2937-cfc9-42c1-bd26-c5debab643fc,network=Network(2bd3fecc-598f-4b7d-a306-5b31f8e81019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69cd2937-cf') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69cd2937-cf, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:08:39 user nova-compute[72809]: INFO os_vif [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:7d:86,bridge_name='br-int',has_traffic_filtering=True,id=69cd2937-cfc9-42c1-bd26-c5debab643fc,network=Network(2bd3fecc-598f-4b7d-a306-5b31f8e81019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69cd2937-cf')
Aug 09 07:08:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsWoEVyQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:08:39 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:08:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[455f54d6-b8ea-4d78-9539-68d03929ab6f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22007f1-be24-4112-a927-5b6bace3c945]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:08:39 user nova-compute[72809]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:08:39 user nova-compute[72809]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)
Aug 09 07:08:39 user nova-compute[72809]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a (non-flash)
Aug 09 07:08:39 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:08:39 user nova-compute[72809]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:08:39 user nova-compute[72809]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)
Aug 09 07:08:39 user nova-compute[72809]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a (non-flash)
Aug 09 07:08:39 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc1386cd1b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a'): ({'sde'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Removing single pathed devices sde {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76e3c59-c75b-49c3-a499-45304e2dff7e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1d9516-bd1c-41a1-b74d-097e4bb0a171]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Flushing IO for device /dev/sde {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b328993-54ea-4c7b-9700-7bd3dde89225]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e471dd-2bf8-43bf-a3fc-36944303724d]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] SCSI volumes sde have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG nova.compute.manager [req-e82a9333-d7b0-47c5-8037-97321b6aac69 req-82e96d30-a9e3-421b-89ba-d8e2d50d4d0b service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Received event network-vif-plugged-69cd2937-cfc9-42c1-bd26-c5debab643fc {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e82a9333-d7b0-47c5-8037-97321b6aac69 req-82e96d30-a9e3-421b-89ba-d8e2d50d4d0b service nova] Acquiring lock "48f0adeb-a5e8-4f81-a534-04c702c272a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e82a9333-d7b0-47c5-8037-97321b6aac69 req-82e96d30-a9e3-421b-89ba-d8e2d50d4d0b service nova] Lock "48f0adeb-a5e8-4f81-a534-04c702c272a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e82a9333-d7b0-47c5-8037-97321b6aac69 req-82e96d30-a9e3-421b-89ba-d8e2d50d4d0b service nova] Lock "48f0adeb-a5e8-4f81-a534-04c702c272a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG nova.compute.manager [req-e82a9333-d7b0-47c5-8037-97321b6aac69 req-82e96d30-a9e3-421b-89ba-d8e2d50d4d0b service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] No waiting events found dispatching network-vif-plugged-69cd2937-cfc9-42c1-bd26-c5debab643fc {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:08:39 user nova-compute[72809]: WARNING nova.compute.manager [req-e82a9333-d7b0-47c5-8037-97321b6aac69 req-82e96d30-a9e3-421b-89ba-d8e2d50d4d0b service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Received unexpected event network-vif-plugged-69cd2937-cfc9-42c1-bd26-c5debab643fc for instance with vm_state active and task_state shelving.
Aug 09 07:08:39 user nova-compute[72809]: DEBUG nova.compute.manager [req-e82a9333-d7b0-47c5-8037-97321b6aac69 req-82e96d30-a9e3-421b-89ba-d8e2d50d4d0b service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Received event network-changed-69cd2937-cfc9-42c1-bd26-c5debab643fc {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG nova.compute.manager [req-e82a9333-d7b0-47c5-8037-97321b6aac69 req-82e96d30-a9e3-421b-89ba-d8e2d50d4d0b service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Refreshing instance network info cache due to event network-changed-69cd2937-cfc9-42c1-bd26-c5debab643fc. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e82a9333-d7b0-47c5-8037-97321b6aac69 req-82e96d30-a9e3-421b-89ba-d8e2d50d4d0b service nova] Acquiring lock "refresh_cache-48f0adeb-a5e8-4f81-a534-04c702c272a3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e82a9333-d7b0-47c5-8037-97321b6aac69 req-82e96d30-a9e3-421b-89ba-d8e2d50d4d0b service nova] Acquired lock "refresh_cache-48f0adeb-a5e8-4f81-a534-04c702c272a3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG nova.network.neutron [req-e82a9333-d7b0-47c5-8037-97321b6aac69 req-82e96d30-a9e3-421b-89ba-d8e2d50d4d0b service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Refreshing network info cache for port 69cd2937-cfc9-42c1-bd26-c5debab643fc {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[04770c74-106a-46a8-b2ab-828cfdc2085e]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[8013de5f-f6c0-491e-953b-266d6d1cec10]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a, portal: 172.16.0.220,3260]
Aug 09 07:08:39 user nova-compute[72809]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a, portal: 172.16.0.220,3260] successful.
Aug 09 07:08:39 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c600bd29-1f9f-40e3-b11b-9e9d4cd264a3]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] <== disconnect_volume: return (340ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:08:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:08:39 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Deleting instance files /opt/stack/data/nova/instances/48f0adeb-a5e8-4f81-a534-04c702c272a3_del
Aug 09 07:08:39 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Deletion of /opt/stack/data/nova/instances/48f0adeb-a5e8-4f81-a534-04c702c272a3_del complete
Aug 09 07:08:40 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Updating instance_info_cache with network_info: [{"id": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "address": "fa:16:3e:b9:56:8d", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac68313-9d", "ovs_interfaceid": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:08:40 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-336770eb-4f09-4134-92ef-f96039bf4fa9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:08:40 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 07:08:40 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:08:40 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:08:40 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:08:40 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:08:40 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 07:08:40 user nova-compute[72809]: DEBUG nova.network.neutron [req-e82a9333-d7b0-47c5-8037-97321b6aac69 req-82e96d30-a9e3-421b-89ba-d8e2d50d4d0b service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Updated VIF entry in instance network info cache for port 69cd2937-cfc9-42c1-bd26-c5debab643fc. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:08:40 user nova-compute[72809]: DEBUG nova.network.neutron [req-e82a9333-d7b0-47c5-8037-97321b6aac69 req-82e96d30-a9e3-421b-89ba-d8e2d50d4d0b service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Updating instance_info_cache with network_info: [{"id": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "address": "fa:16:3e:43:7d:86", "network": {"id": "2bd3fecc-598f-4b7d-a306-5b31f8e81019", "bridge": null, "label": "tempest-TestShelveInstance-696590898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0c708ffc744c3ab8175ad7b939e4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap69cd2937-cf", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:08:40 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e82a9333-d7b0-47c5-8037-97321b6aac69 req-82e96d30-a9e3-421b-89ba-d8e2d50d4d0b service nova] Releasing lock "refresh_cache-48f0adeb-a5e8-4f81-a534-04c702c272a3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:08:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:08:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3249e5c-5657-4c08-8ada-50820d9955d4/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3249e5c-5657-4c08-8ada-50820d9955d4/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3249e5c-5657-4c08-8ada-50820d9955d4/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3249e5c-5657-4c08-8ada-50820d9955d4/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:42 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:08:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:08:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:08:42 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk (vdb) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:08:43 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:08:43 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:08:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=7744MB free_disk=25.060832977294922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 07:08:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:08:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:08:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 336770eb-4f09-4134-92ef-f96039bf4fa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:08:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 1bde423f-0b73-448f-bdce-8d6af96d8fc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:08:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance bebd5a14-6272-4de1-a1a1-4fb45b867c7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:08:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 339372ed-140d-4226-ba00-2cc682214d5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:08:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 466a8e58-5f88-4ffe-a7fd-a346003f3508 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:08:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance a754327a-9985-4430-af66-1d8bc82fb868 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:08:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 63936bb9-97de-4a87-aa29-14129104c1d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:08:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 6e9996e8-c5eb-42c1-b88f-d75654e160c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:08:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance b3249e5c-5657-4c08-8ada-50820d9955d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:08:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 48f0adeb-a5e8-4f81-a534-04c702c272a3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:08:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 07:08:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 07:08:43 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:08:43 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:08:43 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 07:08:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.449s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:08:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:44 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:08:44 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Deleted allocations for instance 48f0adeb-a5e8-4f81-a534-04c702c272a3
Aug 09 07:08:44 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:08:44 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:08:44 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:08:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:08:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:08:44 user nova-compute[72809]: DEBUG nova.objects.instance [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lazy-loading 'numa_topology' on Instance uuid 48f0adeb-a5e8-4f81-a534-04c702c272a3 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:08:45 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:08:45 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:08:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:08:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-409a209f-89b7-4cd3-ad84-d924e980a223 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "48f0adeb-a5e8-4f81-a534-04c702c272a3" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 8.144s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:08:45 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:08:49 user nova-compute[72809]: INFO nova.compute.manager [None req-f2cb406c-de16-4b27-97b2-1eb42e53531c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Unrescuing
Aug 09 07:08:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f2cb406c-de16-4b27-97b2-1eb42e53531c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "refresh_cache-63936bb9-97de-4a87-aa29-14129104c1d3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:08:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f2cb406c-de16-4b27-97b2-1eb42e53531c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquired lock "refresh_cache-63936bb9-97de-4a87-aa29-14129104c1d3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:08:49 user nova-compute[72809]: DEBUG nova.network.neutron [None req-f2cb406c-de16-4b27-97b2-1eb42e53531c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:08:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:08:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72809) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 07:08:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:08:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:08:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:49 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:08:49 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 07:08:49 user nova-compute[72809]: DEBUG nova.network.neutron [None req-f2cb406c-de16-4b27-97b2-1eb42e53531c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Updating instance_info_cache with network_info: [{"id": "871a925e-dae2-45d5-8e6d-24d429032d70", "address": "fa:16:3e:a0:e1:1d", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871a925e-da", "ovs_interfaceid": "871a925e-dae2-45d5-8e6d-24d429032d70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:08:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-f2cb406c-de16-4b27-97b2-1eb42e53531c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Releasing lock "refresh_cache-63936bb9-97de-4a87-aa29-14129104c1d3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:08:49 user nova-compute[72809]: DEBUG nova.objects.instance [None req-f2cb406c-de16-4b27-97b2-1eb42e53531c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lazy-loading 'flavor' on Instance uuid 63936bb9-97de-4a87-aa29-14129104c1d3 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:08:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:50 user nova-compute[72809]: DEBUG nova.compute.manager [req-a21c4339-6c36-4e3e-b484-b66ff3cc917d req-9c3ad8fd-0318-4c15-bab7-4701d00042d9 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Received event network-vif-unplugged-871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:08:50 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a21c4339-6c36-4e3e-b484-b66ff3cc917d req-9c3ad8fd-0318-4c15-bab7-4701d00042d9 service nova] Acquiring lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:08:50 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a21c4339-6c36-4e3e-b484-b66ff3cc917d req-9c3ad8fd-0318-4c15-bab7-4701d00042d9 service nova] Lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:08:50 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a21c4339-6c36-4e3e-b484-b66ff3cc917d req-9c3ad8fd-0318-4c15-bab7-4701d00042d9 service nova] Lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:08:50 user nova-compute[72809]: DEBUG nova.compute.manager [req-a21c4339-6c36-4e3e-b484-b66ff3cc917d req-9c3ad8fd-0318-4c15-bab7-4701d00042d9 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] No waiting events found dispatching network-vif-unplugged-871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:08:50 user nova-compute[72809]: WARNING nova.compute.manager [req-a21c4339-6c36-4e3e-b484-b66ff3cc917d req-9c3ad8fd-0318-4c15-bab7-4701d00042d9 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Received unexpected event network-vif-unplugged-871a925e-dae2-45d5-8e6d-24d429032d70 for instance with vm_state rescued and task_state unrescuing.
Aug 09 07:08:50 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:50 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:50 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Instance destroyed successfully.
Aug 09 07:08:51 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:08:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:52 user nova-compute[72809]: DEBUG nova.compute.manager [req-1d593c2b-1ad5-48cb-9fd5-b07ceebe1020 req-f0ae3b68-8371-494d-b57d-c2fcec910c05 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Received event network-vif-plugged-871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:08:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1d593c2b-1ad5-48cb-9fd5-b07ceebe1020 req-f0ae3b68-8371-494d-b57d-c2fcec910c05 service nova] Acquiring lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:08:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1d593c2b-1ad5-48cb-9fd5-b07ceebe1020 req-f0ae3b68-8371-494d-b57d-c2fcec910c05 service nova] Lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:08:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1d593c2b-1ad5-48cb-9fd5-b07ceebe1020 req-f0ae3b68-8371-494d-b57d-c2fcec910c05 service nova] Lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:08:52 user nova-compute[72809]: DEBUG nova.compute.manager [req-1d593c2b-1ad5-48cb-9fd5-b07ceebe1020 req-f0ae3b68-8371-494d-b57d-c2fcec910c05 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] No waiting events found dispatching network-vif-plugged-871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:08:52 user nova-compute[72809]: WARNING nova.compute.manager [req-1d593c2b-1ad5-48cb-9fd5-b07ceebe1020 req-f0ae3b68-8371-494d-b57d-c2fcec910c05 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Received unexpected event network-vif-plugged-871a925e-dae2-45d5-8e6d-24d429032d70 for instance with vm_state rescued and task_state unrescuing.
Aug 09 07:08:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:52 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691564917.8195333, 48f0adeb-a5e8-4f81-a534-04c702c272a3 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:08:52 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] VM Stopped (Lifecycle Event)
Aug 09 07:08:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-55482eab-1b1f-4bda-9c14-9fe9a4abe47f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "b3249e5c-5657-4c08-8ada-50820d9955d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:08:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-55482eab-1b1f-4bda-9c14-9fe9a4abe47f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "b3249e5c-5657-4c08-8ada-50820d9955d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:08:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-55482eab-1b1f-4bda-9c14-9fe9a4abe47f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "b3249e5c-5657-4c08-8ada-50820d9955d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:08:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-55482eab-1b1f-4bda-9c14-9fe9a4abe47f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "b3249e5c-5657-4c08-8ada-50820d9955d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:08:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-55482eab-1b1f-4bda-9c14-9fe9a4abe47f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "b3249e5c-5657-4c08-8ada-50820d9955d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:08:52 user nova-compute[72809]: INFO nova.compute.manager [None req-55482eab-1b1f-4bda-9c14-9fe9a4abe47f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Terminating instance
Aug 09 07:08:52 user nova-compute[72809]: DEBUG nova.compute.manager [None req-55482eab-1b1f-4bda-9c14-9fe9a4abe47f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:08:52 user nova-compute[72809]: DEBUG nova.compute.manager [None req-2ed9ae81-f723-455c-84e9-7b96f5fb914d None None] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:08:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:53 user nova-compute[72809]: DEBUG nova.compute.manager [req-e1d38997-b570-45e0-bebe-cdf8b19ae812 req-87651f86-bcf9-421a-9fc9-4fd2aa70f2c7 service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Received event network-vif-unplugged-fa550cf1-3f73-4435-a6fe-91752e664b2f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:08:53 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e1d38997-b570-45e0-bebe-cdf8b19ae812 req-87651f86-bcf9-421a-9fc9-4fd2aa70f2c7 service nova] Acquiring lock "b3249e5c-5657-4c08-8ada-50820d9955d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:08:53 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e1d38997-b570-45e0-bebe-cdf8b19ae812 req-87651f86-bcf9-421a-9fc9-4fd2aa70f2c7 service nova] Lock "b3249e5c-5657-4c08-8ada-50820d9955d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:08:53 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e1d38997-b570-45e0-bebe-cdf8b19ae812 req-87651f86-bcf9-421a-9fc9-4fd2aa70f2c7 service nova] Lock "b3249e5c-5657-4c08-8ada-50820d9955d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:08:53 user nova-compute[72809]: DEBUG nova.compute.manager [req-e1d38997-b570-45e0-bebe-cdf8b19ae812 req-87651f86-bcf9-421a-9fc9-4fd2aa70f2c7 service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] No waiting events found dispatching network-vif-unplugged-fa550cf1-3f73-4435-a6fe-91752e664b2f {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:08:53 user nova-compute[72809]: DEBUG nova.compute.manager [req-e1d38997-b570-45e0-bebe-cdf8b19ae812 req-87651f86-bcf9-421a-9fc9-4fd2aa70f2c7 service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Received event network-vif-unplugged-fa550cf1-3f73-4435-a6fe-91752e664b2f for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:08:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:53 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Instance destroyed successfully.
Aug 09 07:08:53 user nova-compute[72809]: DEBUG nova.objects.instance [None req-55482eab-1b1f-4bda-9c14-9fe9a4abe47f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lazy-loading 'resources' on Instance uuid b3249e5c-5657-4c08-8ada-50820d9955d4 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:08:53 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-55482eab-1b1f-4bda-9c14-9fe9a4abe47f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:05:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-848619212',display_name='tempest-AttachVolumeNegativeTest-server-848619212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-848619212',id=37,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlndi3sIlOqciQr97foy8GZZULHEc5tO6L4aCSjXahCg7F+NdNWqmxdP//wJZjZ+LAqXp/OaXPR4GBBYk9MrvOrbkAOi2FO/O18Ml65Ifk4gymg7vwftV+tNWJj5tmvUg==',key_name='tempest-keypair-860100057',keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:06:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ce7c486aaca4ef89eb7e392b717e3d7',ramdisk_id='',reservation_id='r-lkn612ib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2066250801',owner_user_name='tempest-AttachVolumeNegativeTest-2066250801-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:06:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f85a1f2a88fd40a48d1c4dba13f0ac09',uuid=b3249e5c-5657-4c08-8ada-50820d9955d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa550cf1-3f73-4435-a6fe-91752e664b2f", "address": "fa:16:3e:06:e6:0d", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa550cf1-3f", "ovs_interfaceid": "fa550cf1-3f73-4435-a6fe-91752e664b2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:08:53 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-55482eab-1b1f-4bda-9c14-9fe9a4abe47f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Converting VIF {"id": "fa550cf1-3f73-4435-a6fe-91752e664b2f", "address": "fa:16:3e:06:e6:0d", "network": {"id": "1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-831628997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce7c486aaca4ef89eb7e392b717e3d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa550cf1-3f", "ovs_interfaceid": "fa550cf1-3f73-4435-a6fe-91752e664b2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:08:53 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-55482eab-1b1f-4bda-9c14-9fe9a4abe47f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:e6:0d,bridge_name='br-int',has_traffic_filtering=True,id=fa550cf1-3f73-4435-a6fe-91752e664b2f,network=Network(1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa550cf1-3f') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:08:53 user nova-compute[72809]: DEBUG os_vif [None req-55482eab-1b1f-4bda-9c14-9fe9a4abe47f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:e6:0d,bridge_name='br-int',has_traffic_filtering=True,id=fa550cf1-3f73-4435-a6fe-91752e664b2f,network=Network(1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa550cf1-3f') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:08:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa550cf1-3f, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:08:53 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:08:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:08:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:53 user nova-compute[72809]: INFO os_vif [None req-55482eab-1b1f-4bda-9c14-9fe9a4abe47f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:e6:0d,bridge_name='br-int',has_traffic_filtering=True,id=fa550cf1-3f73-4435-a6fe-91752e664b2f,network=Network(1fd075fa-fb2e-4ea2-a6bd-b6f286bebefd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa550cf1-3f')
Aug 09 07:08:53 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-55482eab-1b1f-4bda-9c14-9fe9a4abe47f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Deleting instance files /opt/stack/data/nova/instances/b3249e5c-5657-4c08-8ada-50820d9955d4_del
Aug 09 07:08:53 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-55482eab-1b1f-4bda-9c14-9fe9a4abe47f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Deletion of /opt/stack/data/nova/instances/b3249e5c-5657-4c08-8ada-50820d9955d4_del complete
Aug 09 07:08:53 user nova-compute[72809]: INFO nova.compute.manager [None req-55482eab-1b1f-4bda-9c14-9fe9a4abe47f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 09 07:08:53 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-55482eab-1b1f-4bda-9c14-9fe9a4abe47f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:08:53 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:08:53 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:08:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "01292d41-c87f-4ab0-8638-4aca44608f91" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:08:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "01292d41-c87f-4ab0-8638-4aca44608f91" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:08:54 user nova-compute[72809]: DEBUG nova.compute.manager [req-cfd80161-6dba-4c02-9fb2-74dd1ba2140a req-57fd45ac-e24d-4ec8-bbe7-f565a3c36768 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Received event network-vif-plugged-871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:08:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-cfd80161-6dba-4c02-9fb2-74dd1ba2140a req-57fd45ac-e24d-4ec8-bbe7-f565a3c36768 service nova] Acquiring lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:08:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-cfd80161-6dba-4c02-9fb2-74dd1ba2140a req-57fd45ac-e24d-4ec8-bbe7-f565a3c36768 service nova] Lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:08:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-cfd80161-6dba-4c02-9fb2-74dd1ba2140a req-57fd45ac-e24d-4ec8-bbe7-f565a3c36768 service nova] Lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:08:54 user nova-compute[72809]: DEBUG nova.compute.manager [req-cfd80161-6dba-4c02-9fb2-74dd1ba2140a req-57fd45ac-e24d-4ec8-bbe7-f565a3c36768 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] No waiting events found dispatching network-vif-plugged-871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:08:54 user nova-compute[72809]: WARNING nova.compute.manager [req-cfd80161-6dba-4c02-9fb2-74dd1ba2140a req-57fd45ac-e24d-4ec8-bbe7-f565a3c36768 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Received unexpected event network-vif-plugged-871a925e-dae2-45d5-8e6d-24d429032d70 for instance with vm_state rescued and task_state unrescuing.
Aug 09 07:08:54 user nova-compute[72809]: DEBUG nova.compute.manager [req-cfd80161-6dba-4c02-9fb2-74dd1ba2140a req-57fd45ac-e24d-4ec8-bbe7-f565a3c36768 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Received event network-vif-plugged-871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:08:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-cfd80161-6dba-4c02-9fb2-74dd1ba2140a req-57fd45ac-e24d-4ec8-bbe7-f565a3c36768 service nova] Acquiring lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:08:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-cfd80161-6dba-4c02-9fb2-74dd1ba2140a req-57fd45ac-e24d-4ec8-bbe7-f565a3c36768 service nova] Lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:08:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-cfd80161-6dba-4c02-9fb2-74dd1ba2140a req-57fd45ac-e24d-4ec8-bbe7-f565a3c36768 service nova] Lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:08:54 user nova-compute[72809]: DEBUG nova.compute.manager [req-cfd80161-6dba-4c02-9fb2-74dd1ba2140a req-57fd45ac-e24d-4ec8-bbe7-f565a3c36768 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] No waiting events found dispatching network-vif-plugged-871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:08:54 user nova-compute[72809]: WARNING nova.compute.manager [req-cfd80161-6dba-4c02-9fb2-74dd1ba2140a req-57fd45ac-e24d-4ec8-bbe7-f565a3c36768 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Received unexpected event network-vif-plugged-871a925e-dae2-45d5-8e6d-24d429032d70 for instance with vm_state rescued and task_state unrescuing.
Aug 09 07:08:54 user nova-compute[72809]: DEBUG nova.compute.manager [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 07:08:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:08:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:08:54 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 07:08:54 user nova-compute[72809]: INFO nova.compute.claims [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Claim successful on node user
Aug 09 07:08:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:54 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Removed pending event for 63936bb9-97de-4a87-aa29-14129104c1d3 due to event {{(pid=72809) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 07:08:54 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564934.4972646, 63936bb9-97de-4a87-aa29-14129104c1d3 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:08:54 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] VM Resumed (Lifecycle Event)
Aug 09 07:08:54 user nova-compute[72809]: DEBUG nova.compute.manager [None req-f2cb406c-de16-4b27-97b2-1eb42e53531c tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:08:54 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:08:54 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:08:54 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 07:08:54 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564934.505701, 63936bb9-97de-4a87-aa29-14129104c1d3 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:08:54 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] VM Started (Lifecycle Event)
Aug 09 07:08:54 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:08:54 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:08:54 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:08:54 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:08:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.623s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:08:54 user nova-compute[72809]: DEBUG nova.compute.manager [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 07:08:55 user nova-compute[72809]: DEBUG nova.compute.manager [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 07:08:55 user nova-compute[72809]: DEBUG nova.network.neutron [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 07:08:55 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 07:08:55 user nova-compute[72809]: DEBUG nova.compute.manager [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 07:08:55 user nova-compute[72809]: INFO nova.virt.block_device [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Booting with volume-backed-image ba0d3e02-2e8a-403f-97cd-a9787534aa58 at /dev/vda
Aug 09 07:08:55 user nova-compute[72809]: DEBUG nova.policy [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c4c5942852b412885a5b4698552058d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1903437f7ed4c14a0660f64a2e0c647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 07:08:55 user nova-compute[72809]: DEBUG nova.compute.manager [req-f41ca579-5ec4-4224-93b4-605c80f70382 req-356114ce-d837-4436-b4e4-f67f24c0b18b service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Received event network-vif-plugged-fa550cf1-3f73-4435-a6fe-91752e664b2f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:08:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f41ca579-5ec4-4224-93b4-605c80f70382 req-356114ce-d837-4436-b4e4-f67f24c0b18b service nova] Acquiring lock "b3249e5c-5657-4c08-8ada-50820d9955d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:08:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f41ca579-5ec4-4224-93b4-605c80f70382 req-356114ce-d837-4436-b4e4-f67f24c0b18b service nova] Lock "b3249e5c-5657-4c08-8ada-50820d9955d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:08:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f41ca579-5ec4-4224-93b4-605c80f70382 req-356114ce-d837-4436-b4e4-f67f24c0b18b service nova] Lock "b3249e5c-5657-4c08-8ada-50820d9955d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:08:55 user nova-compute[72809]: DEBUG nova.compute.manager [req-f41ca579-5ec4-4224-93b4-605c80f70382 req-356114ce-d837-4436-b4e4-f67f24c0b18b service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] No waiting events found dispatching network-vif-plugged-fa550cf1-3f73-4435-a6fe-91752e664b2f {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:08:55 user nova-compute[72809]: WARNING nova.compute.manager [req-f41ca579-5ec4-4224-93b4-605c80f70382 req-356114ce-d837-4436-b4e4-f67f24c0b18b service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Received unexpected event network-vif-plugged-fa550cf1-3f73-4435-a6fe-91752e664b2f for instance with vm_state active and task_state deleting.
Aug 09 07:08:55 user nova-compute[72809]: DEBUG nova.compute.manager [req-f41ca579-5ec4-4224-93b4-605c80f70382 req-356114ce-d837-4436-b4e4-f67f24c0b18b service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Received event network-vif-plugged-fa550cf1-3f73-4435-a6fe-91752e664b2f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:08:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f41ca579-5ec4-4224-93b4-605c80f70382 req-356114ce-d837-4436-b4e4-f67f24c0b18b service nova] Acquiring lock "b3249e5c-5657-4c08-8ada-50820d9955d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:08:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f41ca579-5ec4-4224-93b4-605c80f70382 req-356114ce-d837-4436-b4e4-f67f24c0b18b service nova] Lock "b3249e5c-5657-4c08-8ada-50820d9955d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:08:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f41ca579-5ec4-4224-93b4-605c80f70382 req-356114ce-d837-4436-b4e4-f67f24c0b18b service nova] Lock "b3249e5c-5657-4c08-8ada-50820d9955d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:08:55 user nova-compute[72809]: DEBUG nova.compute.manager [req-f41ca579-5ec4-4224-93b4-605c80f70382 req-356114ce-d837-4436-b4e4-f67f24c0b18b service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] No waiting events found dispatching network-vif-plugged-fa550cf1-3f73-4435-a6fe-91752e664b2f {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:08:55 user nova-compute[72809]: WARNING nova.compute.manager [req-f41ca579-5ec4-4224-93b4-605c80f70382 req-356114ce-d837-4436-b4e4-f67f24c0b18b service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Received unexpected event network-vif-plugged-fa550cf1-3f73-4435-a6fe-91752e664b2f for instance with vm_state active and task_state deleting.
Aug 09 07:08:55 user nova-compute[72809]: DEBUG nova.compute.manager [req-f41ca579-5ec4-4224-93b4-605c80f70382 req-356114ce-d837-4436-b4e4-f67f24c0b18b service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Received event network-vif-plugged-fa550cf1-3f73-4435-a6fe-91752e664b2f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:08:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f41ca579-5ec4-4224-93b4-605c80f70382 req-356114ce-d837-4436-b4e4-f67f24c0b18b service nova] Acquiring lock "b3249e5c-5657-4c08-8ada-50820d9955d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:08:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f41ca579-5ec4-4224-93b4-605c80f70382 req-356114ce-d837-4436-b4e4-f67f24c0b18b service nova] Lock "b3249e5c-5657-4c08-8ada-50820d9955d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:08:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f41ca579-5ec4-4224-93b4-605c80f70382 req-356114ce-d837-4436-b4e4-f67f24c0b18b service nova] Lock "b3249e5c-5657-4c08-8ada-50820d9955d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:08:55 user nova-compute[72809]: DEBUG nova.compute.manager [req-f41ca579-5ec4-4224-93b4-605c80f70382 req-356114ce-d837-4436-b4e4-f67f24c0b18b service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] No waiting events found dispatching network-vif-plugged-fa550cf1-3f73-4435-a6fe-91752e664b2f {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:08:55 user nova-compute[72809]: WARNING nova.compute.manager [req-f41ca579-5ec4-4224-93b4-605c80f70382 req-356114ce-d837-4436-b4e4-f67f24c0b18b service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Received unexpected event network-vif-plugged-fa550cf1-3f73-4435-a6fe-91752e664b2f for instance with vm_state active and task_state deleting.
Aug 09 07:08:55 user nova-compute[72809]: DEBUG nova.compute.manager [req-f41ca579-5ec4-4224-93b4-605c80f70382 req-356114ce-d837-4436-b4e4-f67f24c0b18b service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Received event network-vif-unplugged-fa550cf1-3f73-4435-a6fe-91752e664b2f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:08:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f41ca579-5ec4-4224-93b4-605c80f70382 req-356114ce-d837-4436-b4e4-f67f24c0b18b service nova] Acquiring lock "b3249e5c-5657-4c08-8ada-50820d9955d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:08:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f41ca579-5ec4-4224-93b4-605c80f70382 req-356114ce-d837-4436-b4e4-f67f24c0b18b service nova] Lock "b3249e5c-5657-4c08-8ada-50820d9955d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:08:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f41ca579-5ec4-4224-93b4-605c80f70382 req-356114ce-d837-4436-b4e4-f67f24c0b18b service nova] Lock "b3249e5c-5657-4c08-8ada-50820d9955d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:08:55 user nova-compute[72809]: DEBUG nova.compute.manager [req-f41ca579-5ec4-4224-93b4-605c80f70382 req-356114ce-d837-4436-b4e4-f67f24c0b18b service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] No waiting events found dispatching network-vif-unplugged-fa550cf1-3f73-4435-a6fe-91752e664b2f {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:08:55 user nova-compute[72809]: DEBUG nova.compute.manager [req-f41ca579-5ec4-4224-93b4-605c80f70382 req-356114ce-d837-4436-b4e4-f67f24c0b18b service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Received event network-vif-unplugged-fa550cf1-3f73-4435-a6fe-91752e664b2f for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:08:55 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:08:55 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Took 1.78 seconds to deallocate network for instance.
Aug 09 07:08:55 user nova-compute[72809]: DEBUG nova.compute.manager [req-8a05dcb2-be3d-49c3-b6dd-98daae83c810 req-b41933aa-2e05-45a5-a443-42f986079271 service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Received event network-vif-deleted-fa550cf1-3f73-4435-a6fe-91752e664b2f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:08:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-55482eab-1b1f-4bda-9c14-9fe9a4abe47f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:08:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-55482eab-1b1f-4bda-9c14-9fe9a4abe47f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:08:56 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-55482eab-1b1f-4bda-9c14-9fe9a4abe47f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:08:56 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-55482eab-1b1f-4bda-9c14-9fe9a4abe47f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:08:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-55482eab-1b1f-4bda-9c14-9fe9a4abe47f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:08:56 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:56 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-55482eab-1b1f-4bda-9c14-9fe9a4abe47f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Deleted allocations for instance b3249e5c-5657-4c08-8ada-50820d9955d4
Aug 09 07:08:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-55482eab-1b1f-4bda-9c14-9fe9a4abe47f tempest-AttachVolumeNegativeTest-2066250801 tempest-AttachVolumeNegativeTest-2066250801-project-member] Lock "b3249e5c-5657-4c08-8ada-50820d9955d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.416s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:08:56 user nova-compute[72809]: DEBUG nova.network.neutron [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Successfully created port: 61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 07:08:57 user nova-compute[72809]: DEBUG nova.compute.manager [req-31350ea3-6574-409b-ba7d-fe09076e3873 req-bfaad9de-2ea5-44b8-ad11-66f36e81b783 service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Received event network-vif-plugged-fa550cf1-3f73-4435-a6fe-91752e664b2f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:08:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-31350ea3-6574-409b-ba7d-fe09076e3873 req-bfaad9de-2ea5-44b8-ad11-66f36e81b783 service nova] Acquiring lock "b3249e5c-5657-4c08-8ada-50820d9955d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:08:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-31350ea3-6574-409b-ba7d-fe09076e3873 req-bfaad9de-2ea5-44b8-ad11-66f36e81b783 service nova] Lock "b3249e5c-5657-4c08-8ada-50820d9955d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:08:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-31350ea3-6574-409b-ba7d-fe09076e3873 req-bfaad9de-2ea5-44b8-ad11-66f36e81b783 service nova] Lock "b3249e5c-5657-4c08-8ada-50820d9955d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:08:57 user nova-compute[72809]: DEBUG nova.compute.manager [req-31350ea3-6574-409b-ba7d-fe09076e3873 req-bfaad9de-2ea5-44b8-ad11-66f36e81b783 service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] No waiting events found dispatching network-vif-plugged-fa550cf1-3f73-4435-a6fe-91752e664b2f {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:08:57 user nova-compute[72809]: WARNING nova.compute.manager [req-31350ea3-6574-409b-ba7d-fe09076e3873 req-bfaad9de-2ea5-44b8-ad11-66f36e81b783 service nova] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Received unexpected event network-vif-plugged-fa550cf1-3f73-4435-a6fe-91752e664b2f for instance with vm_state deleted and task_state None.
Aug 09 07:08:57 user nova-compute[72809]: DEBUG nova.network.neutron [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Successfully updated port: 61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 07:08:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "refresh_cache-01292d41-c87f-4ab0-8638-4aca44608f91" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:08:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquired lock "refresh_cache-01292d41-c87f-4ab0-8638-4aca44608f91" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:08:58 user nova-compute[72809]: DEBUG nova.network.neutron [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:08:58 user nova-compute[72809]: DEBUG nova.network.neutron [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 07:08:58 user nova-compute[72809]: DEBUG nova.network.neutron [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Updating instance_info_cache with network_info: [{"id": "61cbb890-9a23-4b5a-903c-33d4a8c6e689", "address": "fa:16:3e:a4:4b:39", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cbb890-9a", "ovs_interfaceid": "61cbb890-9a23-4b5a-903c-33d4a8c6e689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:08:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Releasing lock "refresh_cache-01292d41-c87f-4ab0-8638-4aca44608f91" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:08:58 user nova-compute[72809]: DEBUG nova.compute.manager [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Instance network_info: |[{"id": "61cbb890-9a23-4b5a-903c-33d4a8c6e689", "address": "fa:16:3e:a4:4b:39", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cbb890-9a", "ovs_interfaceid": "61cbb890-9a23-4b5a-903c-33d4a8c6e689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 07:08:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:08:59 user nova-compute[72809]: DEBUG nova.compute.manager [req-497c1022-1627-4d39-805f-21a62438917f req-4119ed24-dc90-4362-b6b5-44890ad659ac service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received event network-changed-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:08:59 user nova-compute[72809]: DEBUG nova.compute.manager [req-497c1022-1627-4d39-805f-21a62438917f req-4119ed24-dc90-4362-b6b5-44890ad659ac service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Refreshing instance network info cache due to event network-changed-61cbb890-9a23-4b5a-903c-33d4a8c6e689. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:08:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-497c1022-1627-4d39-805f-21a62438917f req-4119ed24-dc90-4362-b6b5-44890ad659ac service nova] Acquiring lock "refresh_cache-01292d41-c87f-4ab0-8638-4aca44608f91" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:08:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-497c1022-1627-4d39-805f-21a62438917f req-4119ed24-dc90-4362-b6b5-44890ad659ac service nova] Acquired lock "refresh_cache-01292d41-c87f-4ab0-8638-4aca44608f91" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:08:59 user nova-compute[72809]: DEBUG nova.network.neutron [req-497c1022-1627-4d39-805f-21a62438917f req-4119ed24-dc90-4362-b6b5-44890ad659ac service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Refreshing network info cache for port 61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:09:00 user nova-compute[72809]: DEBUG nova.network.neutron [req-497c1022-1627-4d39-805f-21a62438917f req-4119ed24-dc90-4362-b6b5-44890ad659ac service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Updated VIF entry in instance network info cache for port 61cbb890-9a23-4b5a-903c-33d4a8c6e689. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:09:00 user nova-compute[72809]: DEBUG nova.network.neutron [req-497c1022-1627-4d39-805f-21a62438917f req-4119ed24-dc90-4362-b6b5-44890ad659ac service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Updating instance_info_cache with network_info: [{"id": "61cbb890-9a23-4b5a-903c-33d4a8c6e689", "address": "fa:16:3e:a4:4b:39", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cbb890-9a", "ovs_interfaceid": "61cbb890-9a23-4b5a-903c-33d4a8c6e689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:09:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-497c1022-1627-4d39-805f-21a62438917f req-4119ed24-dc90-4362-b6b5-44890ad659ac service nova] Releasing lock "refresh_cache-01292d41-c87f-4ab0-8638-4aca44608f91" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:09:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "a754327a-9985-4430-af66-1d8bc82fb868" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "a754327a-9985-4430-af66-1d8bc82fb868" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "a754327a-9985-4430-af66-1d8bc82fb868-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "a754327a-9985-4430-af66-1d8bc82fb868-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "a754327a-9985-4430-af66-1d8bc82fb868-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:09:05 user nova-compute[72809]: INFO nova.compute.manager [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Terminating instance
Aug 09 07:09:05 user nova-compute[72809]: DEBUG nova.compute.manager [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG nova.compute.manager [req-15aa9d8f-df79-4298-98ff-aaf349cb97de req-2b942441-e6bf-43c8-9383-2075130107e0 service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Received event network-vif-unplugged-79d0335e-d56b-4916-9b58-c198843ed750 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-15aa9d8f-df79-4298-98ff-aaf349cb97de req-2b942441-e6bf-43c8-9383-2075130107e0 service nova] Acquiring lock "a754327a-9985-4430-af66-1d8bc82fb868-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-15aa9d8f-df79-4298-98ff-aaf349cb97de req-2b942441-e6bf-43c8-9383-2075130107e0 service nova] Lock "a754327a-9985-4430-af66-1d8bc82fb868-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-15aa9d8f-df79-4298-98ff-aaf349cb97de req-2b942441-e6bf-43c8-9383-2075130107e0 service nova] Lock "a754327a-9985-4430-af66-1d8bc82fb868-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG nova.compute.manager [req-15aa9d8f-df79-4298-98ff-aaf349cb97de req-2b942441-e6bf-43c8-9383-2075130107e0 service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] No waiting events found dispatching network-vif-unplugged-79d0335e-d56b-4916-9b58-c198843ed750 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG nova.compute.manager [req-15aa9d8f-df79-4298-98ff-aaf349cb97de req-2b942441-e6bf-43c8-9383-2075130107e0 service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Received event network-vif-unplugged-79d0335e-d56b-4916-9b58-c198843ed750 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:05 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Instance destroyed successfully.
Aug 09 07:09:05 user nova-compute[72809]: DEBUG nova.objects.instance [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lazy-loading 'resources' on Instance uuid a754327a-9985-4430-af66-1d8bc82fb868 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:02:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1201311549',display_name='tempest-ServerActionsTestOtherA-server-1201311549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1201311549',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCouL5r1ONNNh4MEm1cE7q85fOqyiHXG74zUMePb7Qx7FM94grlflWjrtC3jQ2LeCgVBOqUmmFTQqcvNJ0pbLdMAdhZ4dM0vJEiMtEgevMXZ2oGhFPDEpbVyaR20DJopHw==',key_name='tempest-keypair-888098152',keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:04:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6da97330281c4d0eba99e485db051973',ramdisk_id='',reservation_id='r-jua86bod',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-118844208',owner_user_name='tempest-ServerActionsTestOtherA-118844208-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:06:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10e067d2b5b7459cadf50b1ed89a8864',uuid=a754327a-9985-4430-af66-1d8bc82fb868,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79d0335e-d56b-4916-9b58-c198843ed750", "address": "fa:16:3e:d4:01:03", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d0335e-d5", "ovs_interfaceid": "79d0335e-d56b-4916-9b58-c198843ed750", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Converting VIF {"id": "79d0335e-d56b-4916-9b58-c198843ed750", "address": "fa:16:3e:d4:01:03", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d0335e-d5", "ovs_interfaceid": "79d0335e-d56b-4916-9b58-c198843ed750", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:01:03,bridge_name='br-int',has_traffic_filtering=True,id=79d0335e-d56b-4916-9b58-c198843ed750,network=Network(0e68e18b-480a-4b6c-b194-39ba1099a4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d0335e-d5') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG os_vif [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:01:03,bridge_name='br-int',has_traffic_filtering=True,id=79d0335e-d56b-4916-9b58-c198843ed750,network=Network(0e68e18b-480a-4b6c-b194-39ba1099a4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d0335e-d5') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79d0335e-d5, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:09:05 user nova-compute[72809]: INFO os_vif [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:01:03,bridge_name='br-int',has_traffic_filtering=True,id=79d0335e-d56b-4916-9b58-c198843ed750,network=Network(0e68e18b-480a-4b6c-b194-39ba1099a4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d0335e-d5')
Aug 09 07:09:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YNXuUTFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:09:05 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:09:05 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1d7936-36c6-41b4-9f5c-4137d32b34e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[60dda178-68a6-4684-89d9-9cb98b12907f]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:09:05 user nova-compute[72809]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:09:05 user nova-compute[72809]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)
Aug 09 07:09:05 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:09:05 user nova-compute[72809]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 (non-flash)
Aug 09 07:09:05 user nova-compute[72809]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)
Aug 09 07:09:05 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc15864df30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059'): ({'sdc'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Removing single pathed devices sdc {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:09:05 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[76597535-a87d-4ef6-a2f3-ddff0de59a9b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b5ff01-c8b3-4694-890a-b351b7a7b2c1]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Flushing IO for device /dev/sdc {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6689dcb3-03cc-4687-a6cf-22f4a0c03d97]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd19cb2-78f5-4efc-9e51-f90b45fad058]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] SCSI volumes sdc have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_5f2d33e8', '/dev/disk/by-id/scsi-23130313138663865', '/dev/disk/by-id/scsi-1SCST_BIO5f2d33e8-10118f8ebf507a12') {{(pid=83900) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[03080119-142e-47da-94df-474444e0cc37]: (4, None) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfa8524-6c5b-46d3-a55c-bd692bf56289]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a2e7fd-dbed-4be3-9e5f-a572508ee341]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059, portal: 172.16.0.220,3260]
Aug 09 07:09:06 user nova-compute[72809]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059, portal: 172.16.0.220,3260] successful.
Aug 09 07:09:06 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG os_brick.utils [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1cadbe9-56c6-4639-a5d6-898730c79059 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fec7964-5c4b-44e7-a1db-435fde13ae20]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] <== disconnect_volume: return (326ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:09:06 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Deleting instance files /opt/stack/data/nova/instances/a754327a-9985-4430-af66-1d8bc82fb868_del
Aug 09 07:09:06 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Deletion of /opt/stack/data/nova/instances/a754327a-9985-4430-af66-1d8bc82fb868_del complete
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c02341e-5342-4d2b-a6ac-81aac5467bde]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f88fb7-c09c-4ad0-9b16-f80f98454ba5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[94077023-f991-4645-9b55-54c4e1e7d149]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aae6648-0803-4c41-853b-9d6fbb75ff0f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:06 user nova-compute[72809]: INFO nova.compute.manager [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Took 1.30 seconds to destroy the instance on the hypervisor.
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: a754327a-9985-4430-af66-1d8bc82fb868] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:09:06 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c584bd3-b3d7-42d3-979c-250e7e187242]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG os_brick.utils [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Updating existing volume attachment record: 43376476-9631-4ba5-89a8-89367890d671 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Acquiring lock "b527d58f-3171-4d22-980a-545824bf9523" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Lock "b527d58f-3171-4d22-980a-545824bf9523" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG nova.compute.manager [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:09:06 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 07:09:06 user nova-compute[72809]: INFO nova.compute.claims [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Claim successful on node user
Aug 09 07:09:07 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:09:07 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:09:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.570s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:09:07 user nova-compute[72809]: DEBUG nova.compute.manager [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 07:09:07 user nova-compute[72809]: DEBUG nova.compute.manager [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 07:09:07 user nova-compute[72809]: DEBUG nova.network.neutron [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 07:09:07 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 07:09:07 user nova-compute[72809]: DEBUG nova.compute.manager [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 07:09:07 user nova-compute[72809]: DEBUG nova.policy [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eb9efc3d272d42b78637687f7ba0b049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b8bf162c4714e328a7c3a28f173b665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 07:09:07 user nova-compute[72809]: DEBUG nova.compute.manager [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 07:09:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 07:09:07 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Creating image(s)
Aug 09 07:09:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Acquiring lock "/opt/stack/data/nova/instances/b527d58f-3171-4d22-980a-545824bf9523/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:09:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Lock "/opt/stack/data/nova/instances/b527d58f-3171-4d22-980a-545824bf9523/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:09:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Lock "/opt/stack/data/nova/instances/b527d58f-3171-4d22-980a-545824bf9523/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.042s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:09:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:07 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:09:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-86f6ebe6-a712-4ca6-a01a-b600e9797c9b req-77b79b81-f8f2-4dd9-8625-eff93e19ef11 service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Received event network-vif-deleted-79d0335e-d56b-4916-9b58-c198843ed750 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:09:07 user nova-compute[72809]: INFO nova.compute.manager [req-86f6ebe6-a712-4ca6-a01a-b600e9797c9b req-77b79b81-f8f2-4dd9-8625-eff93e19ef11 service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Neutron deleted interface 79d0335e-d56b-4916-9b58-c198843ed750; detaching it from the instance and deleting it from the info cache
Aug 09 07:09:07 user nova-compute[72809]: DEBUG nova.network.neutron [req-86f6ebe6-a712-4ca6-a01a-b600e9797c9b req-77b79b81-f8f2-4dd9-8625-eff93e19ef11 service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:09:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-1a0b6404-0658-44cf-b53b-f61cbfdd3d21 req-8b0af828-99bd-4bab-892d-02ba2f7ec3e3 service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Received event network-vif-plugged-79d0335e-d56b-4916-9b58-c198843ed750 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:09:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1a0b6404-0658-44cf-b53b-f61cbfdd3d21 req-8b0af828-99bd-4bab-892d-02ba2f7ec3e3 service nova] Acquiring lock "a754327a-9985-4430-af66-1d8bc82fb868-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:09:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1a0b6404-0658-44cf-b53b-f61cbfdd3d21 req-8b0af828-99bd-4bab-892d-02ba2f7ec3e3 service nova] Lock "a754327a-9985-4430-af66-1d8bc82fb868-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:09:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1a0b6404-0658-44cf-b53b-f61cbfdd3d21 req-8b0af828-99bd-4bab-892d-02ba2f7ec3e3 service nova] Lock "a754327a-9985-4430-af66-1d8bc82fb868-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:09:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-1a0b6404-0658-44cf-b53b-f61cbfdd3d21 req-8b0af828-99bd-4bab-892d-02ba2f7ec3e3 service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] No waiting events found dispatching network-vif-plugged-79d0335e-d56b-4916-9b58-c198843ed750 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:09:07 user nova-compute[72809]: WARNING nova.compute.manager [req-1a0b6404-0658-44cf-b53b-f61cbfdd3d21 req-8b0af828-99bd-4bab-892d-02ba2f7ec3e3 service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Received unexpected event network-vif-plugged-79d0335e-d56b-4916-9b58-c198843ed750 for instance with vm_state active and task_state deleting.
Aug 09 07:09:07 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Took 1.14 seconds to deallocate network for instance.
Aug 09 07:09:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-86f6ebe6-a712-4ca6-a01a-b600e9797c9b req-77b79b81-f8f2-4dd9-8625-eff93e19ef11 service nova] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Detach interface failed, port_id=79d0335e-d56b-4916-9b58-c198843ed750, reason: Instance a754327a-9985-4430-af66-1d8bc82fb868 could not be found. {{(pid=72809) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 07:09:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.189s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:09:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:09:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.165s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/b527d58f-3171-4d22-980a-545824bf9523/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/b527d58f-3171-4d22-980a-545824bf9523/disk 1073741824" returned: 0 in 0.050s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:09:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.170s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:08 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b527d58f-3171-4d22-980a-545824bf9523/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 07:09:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b527d58f-3171-4d22-980a-545824bf9523/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:08 user nova-compute[72809]: DEBUG nova.network.neutron [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Successfully created port: 1045e820-7f44-40cf-aff9-7e0370014a21 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 07:09:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b527d58f-3171-4d22-980a-545824bf9523/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:08 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Cannot resize image /opt/stack/data/nova/instances/b527d58f-3171-4d22-980a-545824bf9523/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 07:09:08 user nova-compute[72809]: DEBUG nova.objects.instance [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Lazy-loading 'migration_context' on Instance uuid b527d58f-3171-4d22-980a-545824bf9523 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:09:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 07:09:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Ensure instance console log exists: /opt/stack/data/nova/instances/b527d58f-3171-4d22-980a-545824bf9523/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 07:09:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:09:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:09:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:09:08 user nova-compute[72809]: INFO nova.compute.manager [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Took 0.86 seconds to detach 1 volumes for instance.
Aug 09 07:09:08 user nova-compute[72809]: DEBUG nova.compute.manager [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Deleting volume: f1cadbe9-56c6-4639-a5d6-898730c79059 {{(pid=72809) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 07:09:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:09:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:09:08 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691564933.6437118, b3249e5c-5657-4c08-8ada-50820d9955d4 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:09:08 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] VM Stopped (Lifecycle Event)
Aug 09 07:09:08 user nova-compute[72809]: DEBUG nova.compute.manager [None req-3433e3d2-98cf-4da8-8fe5-ff56c6a7e7b1 None None] [instance: b3249e5c-5657-4c08-8ada-50820d9955d4] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:09:08 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:09:08 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:09:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:09:08 user nova-compute[72809]: DEBUG nova.network.neutron [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Successfully updated port: 1045e820-7f44-40cf-aff9-7e0370014a21 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 07:09:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Acquiring lock "refresh_cache-b527d58f-3171-4d22-980a-545824bf9523" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:09:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Acquired lock "refresh_cache-b527d58f-3171-4d22-980a-545824bf9523" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:09:08 user nova-compute[72809]: DEBUG nova.network.neutron [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:09:08 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Deleted allocations for instance a754327a-9985-4430-af66-1d8bc82fb868
Aug 09 07:09:09 user nova-compute[72809]: DEBUG nova.network.neutron [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-e60c98fd-906f-4ae2-99f8-8388b9d3711e tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "a754327a-9985-4430-af66-1d8bc82fb868" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.973s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG nova.network.neutron [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Updating instance_info_cache with network_info: [{"id": "1045e820-7f44-40cf-aff9-7e0370014a21", "address": "fa:16:3e:3d:5b:8f", "network": {"id": "c573f3b4-05de-465c-b5b2-7e842a7ca92d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-427174675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b8bf162c4714e328a7c3a28f173b665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1045e820-7f", "ovs_interfaceid": "1045e820-7f44-40cf-aff9-7e0370014a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Releasing lock "refresh_cache-b527d58f-3171-4d22-980a-545824bf9523" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG nova.compute.manager [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Instance network_info: |[{"id": "1045e820-7f44-40cf-aff9-7e0370014a21", "address": "fa:16:3e:3d:5b:8f", "network": {"id": "c573f3b4-05de-465c-b5b2-7e842a7ca92d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-427174675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b8bf162c4714e328a7c3a28f173b665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1045e820-7f", "ovs_interfaceid": "1045e820-7f44-40cf-aff9-7e0370014a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Start _get_guest_xml network_info=[{"id": "1045e820-7f44-40cf-aff9-7e0370014a21", "address": "fa:16:3e:3d:5b:8f", "network": {"id": "c573f3b4-05de-465c-b5b2-7e842a7ca92d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-427174675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b8bf162c4714e328a7c3a28f173b665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1045e820-7f", "ovs_interfaceid": "1045e820-7f44-40cf-aff9-7e0370014a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 07:09:09 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:09:09 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:09:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:09:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1267805680',display_name='tempest-VolumesActionsTest-instance-1267805680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1267805680',id=40,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b8bf162c4714e328a7c3a28f173b665',ramdisk_id='',reservation_id='r-kdu7oufb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-289766275',owner_user_name='tempest-VolumesActionsTest-289766275-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:09:07Z,user_data=None,user_id='eb9efc3d272d42b78637687f7ba0b049',uuid=b527d58f-3171-4d22-980a-545824bf9523,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1045e820-7f44-40cf-aff9-7e0370014a21", "address": "fa:16:3e:3d:5b:8f", "network": {"id": "c573f3b4-05de-465c-b5b2-7e842a7ca92d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-427174675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b8bf162c4714e328a7c3a28f173b665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1045e820-7f", "ovs_interfaceid": "1045e820-7f44-40cf-aff9-7e0370014a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Converting VIF {"id": "1045e820-7f44-40cf-aff9-7e0370014a21", "address": "fa:16:3e:3d:5b:8f", "network": {"id": "c573f3b4-05de-465c-b5b2-7e842a7ca92d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-427174675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b8bf162c4714e328a7c3a28f173b665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1045e820-7f", "ovs_interfaceid": "1045e820-7f44-40cf-aff9-7e0370014a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:5b:8f,bridge_name='br-int',has_traffic_filtering=True,id=1045e820-7f44-40cf-aff9-7e0370014a21,network=Network(c573f3b4-05de-465c-b5b2-7e842a7ca92d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1045e820-7f') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG nova.objects.instance [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Lazy-loading 'pci_devices' on Instance uuid b527d58f-3171-4d22-980a-545824bf9523 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] End _get_guest_xml xml=<domain type="kvm">
Aug 09 07:09:09 user nova-compute[72809]:   <uuid>b527d58f-3171-4d22-980a-545824bf9523</uuid>
Aug 09 07:09:09 user nova-compute[72809]:   <name>instance-00000028</name>
Aug 09 07:09:09 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 07:09:09 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 07:09:09 user nova-compute[72809]:   <metadata>
Aug 09 07:09:09 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 07:09:09 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 07:09:09 user nova-compute[72809]:       <nova:name>tempest-VolumesActionsTest-instance-1267805680</nova:name>
Aug 09 07:09:09 user nova-compute[72809]:       <nova:creationTime>2023-08-09 07:09:09</nova:creationTime>
Aug 09 07:09:09 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 07:09:09 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 07:09:09 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 07:09:09 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 07:09:09 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 07:09:09 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 07:09:09 user nova-compute[72809]:       </nova:flavor>
Aug 09 07:09:09 user nova-compute[72809]:       <nova:owner>
Aug 09 07:09:09 user nova-compute[72809]:         <nova:user uuid="eb9efc3d272d42b78637687f7ba0b049">tempest-VolumesActionsTest-289766275-project-member</nova:user>
Aug 09 07:09:09 user nova-compute[72809]:         <nova:project uuid="7b8bf162c4714e328a7c3a28f173b665">tempest-VolumesActionsTest-289766275</nova:project>
Aug 09 07:09:09 user nova-compute[72809]:       </nova:owner>
Aug 09 07:09:09 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 07:09:09 user nova-compute[72809]:       <nova:ports>
Aug 09 07:09:09 user nova-compute[72809]:         <nova:port uuid="1045e820-7f44-40cf-aff9-7e0370014a21">
Aug 09 07:09:09 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 07:09:09 user nova-compute[72809]:         </nova:port>
Aug 09 07:09:09 user nova-compute[72809]:       </nova:ports>
Aug 09 07:09:09 user nova-compute[72809]:     </nova:instance>
Aug 09 07:09:09 user nova-compute[72809]:   </metadata>
Aug 09 07:09:09 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 07:09:09 user nova-compute[72809]:     <system>
Aug 09 07:09:09 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 07:09:09 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 07:09:09 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 07:09:09 user nova-compute[72809]:       <entry name="serial">b527d58f-3171-4d22-980a-545824bf9523</entry>
Aug 09 07:09:09 user nova-compute[72809]:       <entry name="uuid">b527d58f-3171-4d22-980a-545824bf9523</entry>
Aug 09 07:09:09 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 07:09:09 user nova-compute[72809]:     </system>
Aug 09 07:09:09 user nova-compute[72809]:   </sysinfo>
Aug 09 07:09:09 user nova-compute[72809]:   <os>
Aug 09 07:09:09 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 07:09:09 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 07:09:09 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 07:09:09 user nova-compute[72809]:   </os>
Aug 09 07:09:09 user nova-compute[72809]:   <features>
Aug 09 07:09:09 user nova-compute[72809]:     <acpi/>
Aug 09 07:09:09 user nova-compute[72809]:     <apic/>
Aug 09 07:09:09 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 07:09:09 user nova-compute[72809]:   </features>
Aug 09 07:09:09 user nova-compute[72809]:   <clock offset="utc">
Aug 09 07:09:09 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 07:09:09 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 07:09:09 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 07:09:09 user nova-compute[72809]:   </clock>
Aug 09 07:09:09 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 07:09:09 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 07:09:09 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 07:09:09 user nova-compute[72809]:   </cpu>
Aug 09 07:09:09 user nova-compute[72809]:   <devices>
Aug 09 07:09:09 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 07:09:09 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 07:09:09 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/b527d58f-3171-4d22-980a-545824bf9523/disk"/>
Aug 09 07:09:09 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 07:09:09 user nova-compute[72809]:     </disk>
Aug 09 07:09:09 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 07:09:09 user nova-compute[72809]:       <mac address="fa:16:3e:3d:5b:8f"/>
Aug 09 07:09:09 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:09:09 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 07:09:09 user nova-compute[72809]:       <target dev="tap1045e820-7f"/>
Aug 09 07:09:09 user nova-compute[72809]:     </interface>
Aug 09 07:09:09 user nova-compute[72809]:     <serial type="pty">
Aug 09 07:09:09 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/b527d58f-3171-4d22-980a-545824bf9523/console.log" append="off"/>
Aug 09 07:09:09 user nova-compute[72809]:     </serial>
Aug 09 07:09:09 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 07:09:09 user nova-compute[72809]:     <video>
Aug 09 07:09:09 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:09:09 user nova-compute[72809]:     </video>
Aug 09 07:09:09 user nova-compute[72809]:     <rng model="virtio">
Aug 09 07:09:09 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 07:09:09 user nova-compute[72809]:     </rng>
Aug 09 07:09:09 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 07:09:09 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 07:09:09 user nova-compute[72809]:       <stats period="10"/>
Aug 09 07:09:09 user nova-compute[72809]:     </memballoon>
Aug 09 07:09:09 user nova-compute[72809]:   </devices>
Aug 09 07:09:09 user nova-compute[72809]: </domain>
Aug 09 07:09:09 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:09:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1267805680',display_name='tempest-VolumesActionsTest-instance-1267805680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1267805680',id=40,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b8bf162c4714e328a7c3a28f173b665',ramdisk_id='',reservation_id='r-kdu7oufb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-289766275',owner_user_name='tempest-VolumesActionsTest-289766275-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:09:07Z,user_data=None,user_id='eb9efc3d272d42b78637687f7ba0b049',uuid=b527d58f-3171-4d22-980a-545824bf9523,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1045e820-7f44-40cf-aff9-7e0370014a21", "address": "fa:16:3e:3d:5b:8f", "network": {"id": "c573f3b4-05de-465c-b5b2-7e842a7ca92d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-427174675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b8bf162c4714e328a7c3a28f173b665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1045e820-7f", "ovs_interfaceid": "1045e820-7f44-40cf-aff9-7e0370014a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Converting VIF {"id": "1045e820-7f44-40cf-aff9-7e0370014a21", "address": "fa:16:3e:3d:5b:8f", "network": {"id": "c573f3b4-05de-465c-b5b2-7e842a7ca92d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-427174675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b8bf162c4714e328a7c3a28f173b665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1045e820-7f", "ovs_interfaceid": "1045e820-7f44-40cf-aff9-7e0370014a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:5b:8f,bridge_name='br-int',has_traffic_filtering=True,id=1045e820-7f44-40cf-aff9-7e0370014a21,network=Network(c573f3b4-05de-465c-b5b2-7e842a7ca92d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1045e820-7f') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG os_vif [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:5b:8f,bridge_name='br-int',has_traffic_filtering=True,id=1045e820-7f44-40cf-aff9-7e0370014a21,network=Network(c573f3b4-05de-465c-b5b2-7e842a7ca92d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1045e820-7f') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1045e820-7f, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1045e820-7f, col_values=(('external_ids', {'iface-id': '1045e820-7f44-40cf-aff9-7e0370014a21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:5b:8f', 'vm-uuid': 'b527d58f-3171-4d22-980a-545824bf9523'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:09 user nova-compute[72809]: INFO os_vif [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:5b:8f,bridge_name='br-int',has_traffic_filtering=True,id=1045e820-7f44-40cf-aff9-7e0370014a21,network=Network(c573f3b4-05de-465c-b5b2-7e842a7ca92d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1045e820-7f')
Aug 09 07:09:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] No VIF found with MAC fa:16:3e:3d:5b:8f, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG nova.compute.manager [req-8b141395-2f4a-4765-98f6-edc86b90e84b req-8af3460a-30fd-4cb7-a922-3443e181e832 service nova] [instance: b527d58f-3171-4d22-980a-545824bf9523] Received event network-changed-1045e820-7f44-40cf-aff9-7e0370014a21 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG nova.compute.manager [req-8b141395-2f4a-4765-98f6-edc86b90e84b req-8af3460a-30fd-4cb7-a922-3443e181e832 service nova] [instance: b527d58f-3171-4d22-980a-545824bf9523] Refreshing instance network info cache due to event network-changed-1045e820-7f44-40cf-aff9-7e0370014a21. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-8b141395-2f4a-4765-98f6-edc86b90e84b req-8af3460a-30fd-4cb7-a922-3443e181e832 service nova] Acquiring lock "refresh_cache-b527d58f-3171-4d22-980a-545824bf9523" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-8b141395-2f4a-4765-98f6-edc86b90e84b req-8af3460a-30fd-4cb7-a922-3443e181e832 service nova] Acquired lock "refresh_cache-b527d58f-3171-4d22-980a-545824bf9523" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:09:09 user nova-compute[72809]: DEBUG nova.network.neutron [req-8b141395-2f4a-4765-98f6-edc86b90e84b req-8af3460a-30fd-4cb7-a922-3443e181e832 service nova] [instance: b527d58f-3171-4d22-980a-545824bf9523] Refreshing network info cache for port 1045e820-7f44-40cf-aff9-7e0370014a21 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:09:10 user nova-compute[72809]: DEBUG nova.network.neutron [req-8b141395-2f4a-4765-98f6-edc86b90e84b req-8af3460a-30fd-4cb7-a922-3443e181e832 service nova] [instance: b527d58f-3171-4d22-980a-545824bf9523] Updated VIF entry in instance network info cache for port 1045e820-7f44-40cf-aff9-7e0370014a21. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:09:10 user nova-compute[72809]: DEBUG nova.network.neutron [req-8b141395-2f4a-4765-98f6-edc86b90e84b req-8af3460a-30fd-4cb7-a922-3443e181e832 service nova] [instance: b527d58f-3171-4d22-980a-545824bf9523] Updating instance_info_cache with network_info: [{"id": "1045e820-7f44-40cf-aff9-7e0370014a21", "address": "fa:16:3e:3d:5b:8f", "network": {"id": "c573f3b4-05de-465c-b5b2-7e842a7ca92d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-427174675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b8bf162c4714e328a7c3a28f173b665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1045e820-7f", "ovs_interfaceid": "1045e820-7f44-40cf-aff9-7e0370014a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:09:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-8b141395-2f4a-4765-98f6-edc86b90e84b req-8af3460a-30fd-4cb7-a922-3443e181e832 service nova] Releasing lock "refresh_cache-b527d58f-3171-4d22-980a-545824bf9523" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:09:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:10 user nova-compute[72809]: DEBUG nova.compute.manager [req-e7433a7f-538f-483f-92df-988974475f1e req-4c623bdd-da12-48aa-ac25-a0f372df5189 service nova] [instance: b527d58f-3171-4d22-980a-545824bf9523] Received event network-vif-plugged-1045e820-7f44-40cf-aff9-7e0370014a21 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:09:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e7433a7f-538f-483f-92df-988974475f1e req-4c623bdd-da12-48aa-ac25-a0f372df5189 service nova] Acquiring lock "b527d58f-3171-4d22-980a-545824bf9523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:09:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e7433a7f-538f-483f-92df-988974475f1e req-4c623bdd-da12-48aa-ac25-a0f372df5189 service nova] Lock "b527d58f-3171-4d22-980a-545824bf9523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:09:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e7433a7f-538f-483f-92df-988974475f1e req-4c623bdd-da12-48aa-ac25-a0f372df5189 service nova] Lock "b527d58f-3171-4d22-980a-545824bf9523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:09:10 user nova-compute[72809]: DEBUG nova.compute.manager [req-e7433a7f-538f-483f-92df-988974475f1e req-4c623bdd-da12-48aa-ac25-a0f372df5189 service nova] [instance: b527d58f-3171-4d22-980a-545824bf9523] No waiting events found dispatching network-vif-plugged-1045e820-7f44-40cf-aff9-7e0370014a21 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:09:10 user nova-compute[72809]: WARNING nova.compute.manager [req-e7433a7f-538f-483f-92df-988974475f1e req-4c623bdd-da12-48aa-ac25-a0f372df5189 service nova] [instance: b527d58f-3171-4d22-980a-545824bf9523] Received unexpected event network-vif-plugged-1045e820-7f44-40cf-aff9-7e0370014a21 for instance with vm_state building and task_state spawning.
Aug 09 07:09:11 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:11 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:11 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:13 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564953.0154095, b527d58f-3171-4d22-980a-545824bf9523 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:09:13 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b527d58f-3171-4d22-980a-545824bf9523] VM Resumed (Lifecycle Event)
Aug 09 07:09:13 user nova-compute[72809]: DEBUG nova.compute.manager [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 07:09:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 07:09:13 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: b527d58f-3171-4d22-980a-545824bf9523] Instance spawned successfully.
Aug 09 07:09:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 07:09:13 user nova-compute[72809]: DEBUG nova.compute.manager [req-cafa5a54-0d9c-40c0-a529-25ddbd296240 req-211175db-4f48-4de0-be34-e4043bc5834d service nova] [instance: b527d58f-3171-4d22-980a-545824bf9523] Received event network-vif-plugged-1045e820-7f44-40cf-aff9-7e0370014a21 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:09:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-cafa5a54-0d9c-40c0-a529-25ddbd296240 req-211175db-4f48-4de0-be34-e4043bc5834d service nova] Acquiring lock "b527d58f-3171-4d22-980a-545824bf9523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:09:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-cafa5a54-0d9c-40c0-a529-25ddbd296240 req-211175db-4f48-4de0-be34-e4043bc5834d service nova] Lock "b527d58f-3171-4d22-980a-545824bf9523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:09:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-cafa5a54-0d9c-40c0-a529-25ddbd296240 req-211175db-4f48-4de0-be34-e4043bc5834d service nova] Lock "b527d58f-3171-4d22-980a-545824bf9523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:09:13 user nova-compute[72809]: DEBUG nova.compute.manager [req-cafa5a54-0d9c-40c0-a529-25ddbd296240 req-211175db-4f48-4de0-be34-e4043bc5834d service nova] [instance: b527d58f-3171-4d22-980a-545824bf9523] No waiting events found dispatching network-vif-plugged-1045e820-7f44-40cf-aff9-7e0370014a21 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:09:13 user nova-compute[72809]: WARNING nova.compute.manager [req-cafa5a54-0d9c-40c0-a529-25ddbd296240 req-211175db-4f48-4de0-be34-e4043bc5834d service nova] [instance: b527d58f-3171-4d22-980a-545824bf9523] Received unexpected event network-vif-plugged-1045e820-7f44-40cf-aff9-7e0370014a21 for instance with vm_state building and task_state spawning.
Aug 09 07:09:13 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b527d58f-3171-4d22-980a-545824bf9523] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:09:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:09:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:09:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:09:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:09:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:09:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:09:13 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b527d58f-3171-4d22-980a-545824bf9523] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:09:13 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b527d58f-3171-4d22-980a-545824bf9523] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:09:13 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564953.0201387, b527d58f-3171-4d22-980a-545824bf9523 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:09:13 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b527d58f-3171-4d22-980a-545824bf9523] VM Started (Lifecycle Event)
Aug 09 07:09:13 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b527d58f-3171-4d22-980a-545824bf9523] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:09:13 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b527d58f-3171-4d22-980a-545824bf9523] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:09:13 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b527d58f-3171-4d22-980a-545824bf9523] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:09:13 user nova-compute[72809]: INFO nova.compute.manager [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Took 5.86 seconds to spawn the instance on the hypervisor.
Aug 09 07:09:13 user nova-compute[72809]: DEBUG nova.compute.manager [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:09:13 user nova-compute[72809]: INFO nova.compute.manager [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Took 6.80 seconds to build instance.
Aug 09 07:09:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-5b8c76f5-e485-4211-a0b4-c554921a4005 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Lock "b527d58f-3171-4d22-980a-545824bf9523" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.899s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:09:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG nova.compute.manager [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 07:09:20 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Creating image(s)
Aug 09 07:09:20 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Did not create local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Ensure instance console log exists: /opt/stack/data/nova/instances/01292d41-c87f-4ab0-8638-4aca44608f91/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Start _get_guest_xml network_info=[{"id": "61cbb890-9a23-4b5a-903c-33d4a8c6e689", "address": "fa:16:3e:a4:4b:39", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cbb890-9a", "ovs_interfaceid": "61cbb890-9a23-4b5a-903c-33d4a8c6e689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EfZOVKhu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '01292d41-c87f-4ab0-8638-4aca44608f91', 'attached_at': '', 'detached_at': '', 'volume_id': '51cc261a-1c80-4a03-8957-14375673184b', 'serial': '51cc261a-1c80-4a03-8957-14375673184b'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': 0, 'attachment_id': '43376476-9631-4ba5-89a8-89367890d671', 'volume_type': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 07:09:20 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:09:20 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:09:20 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EfZOVKhu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:09:20 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:09:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:09:20 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:09:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:09:20 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9258c55-ddc7-449b-9ae6-55776e79ca91]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 07:09:20 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81888de-85ca-4efa-9ec2-d7070d5415f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b] added
Aug 09 07:09:20 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9ba687-0ac6-415a-ac11-9659b1597bbd]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7037a5c-5ed7-4d61-a57e-feee7d4fbad7]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EfZOVKhu {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EfZOVKhu" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[be406362-9401-4d22-81ab-c054dcf4adff]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EfZOVKhu'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[827e9e83-2c61-49cb-babd-8383ee6e98a4]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[061654f7-7d0a-4c5a-9185-6e4e71ac378e]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:09:20 user nova-compute[72809]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)
Aug 09 07:09:20 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:09:20 user nova-compute[72809]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)
Aug 09 07:09:20 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0fec91-015f-4be7-9b4f-50e2e8b140fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b, portal: 172.16.0.220,3260]
Aug 09 07:09:20 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b, portal: 172.16.0.220,3260] successful.
Aug 09 07:09:20 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0645c5ea-8586-4ef7-9804-360286839138]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[8323bf40-4bb9-4d6c-a764-0ef402e01be4]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:09:20 user nova-compute[72809]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)
Aug 09 07:09:20 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:09:20 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:09:20 user nova-compute[72809]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)
Aug 09 07:09:20 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:09:20 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e388f4-43e4-44a8-94d6-95c08df9d85a]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EfZOVKhu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 07:09:20 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691564945.8619847, a754327a-9985-4430-af66-1d8bc82fb868 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:09:20 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: a754327a-9985-4430-af66-1d8bc82fb868] VM Stopped (Lifecycle Event)
Aug 09 07:09:20 user nova-compute[72809]: DEBUG nova.compute.manager [None req-892d3f5c-eb9f-4149-8496-3a5bba497932 None None] [instance: a754327a-9985-4430-af66-1d8bc82fb868] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:09:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:09:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23431393938386365', 'path': '/dev/sdc'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:09:21 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431393938386365', 'path': '/dev/sdc'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 07:09:21 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:08:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-538618460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-538618460',id=39,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1903437f7ed4c14a0660f64a2e0c647',ramdisk_id='',reservation_id='r-xczy0u8d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-917311946',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:08:55Z,user_data=None,user_id='6c4c5942852b412885a5b4698552058d',uuid=01292d41-c87f-4ab0-8638-4aca44608f91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61cbb890-9a23-4b5a-903c-33d4a8c6e689", "address": "fa:16:3e:a4:4b:39", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cbb890-9a", "ovs_interfaceid": "61cbb890-9a23-4b5a-903c-33d4a8c6e689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 07:09:21 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Converting VIF {"id": "61cbb890-9a23-4b5a-903c-33d4a8c6e689", "address": "fa:16:3e:a4:4b:39", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cbb890-9a", "ovs_interfaceid": "61cbb890-9a23-4b5a-903c-33d4a8c6e689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:09:21 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:4b:39,bridge_name='br-int',has_traffic_filtering=True,id=61cbb890-9a23-4b5a-903c-33d4a8c6e689,network=Network(5f03b0f9-e80d-428f-b0a6-57158568e620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61cbb890-9a') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:09:21 user nova-compute[72809]: DEBUG nova.objects.instance [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lazy-loading 'pci_devices' on Instance uuid 01292d41-c87f-4ab0-8638-4aca44608f91 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:09:21 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] End _get_guest_xml xml=<domain type="kvm">
Aug 09 07:09:21 user nova-compute[72809]:   <uuid>01292d41-c87f-4ab0-8638-4aca44608f91</uuid>
Aug 09 07:09:21 user nova-compute[72809]:   <name>instance-00000027</name>
Aug 09 07:09:21 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 07:09:21 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 07:09:21 user nova-compute[72809]:   <metadata>
Aug 09 07:09:21 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 07:09:21 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 07:09:21 user nova-compute[72809]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-538618460</nova:name>
Aug 09 07:09:21 user nova-compute[72809]:       <nova:creationTime>2023-08-09 07:09:20</nova:creationTime>
Aug 09 07:09:21 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 07:09:21 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 07:09:21 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 07:09:21 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 07:09:21 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 07:09:21 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 07:09:21 user nova-compute[72809]:       </nova:flavor>
Aug 09 07:09:21 user nova-compute[72809]:       <nova:owner>
Aug 09 07:09:21 user nova-compute[72809]:         <nova:user uuid="6c4c5942852b412885a5b4698552058d">tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member</nova:user>
Aug 09 07:09:21 user nova-compute[72809]:         <nova:project uuid="b1903437f7ed4c14a0660f64a2e0c647">tempest-ServerBootFromVolumeStableRescueTest-917311946</nova:project>
Aug 09 07:09:21 user nova-compute[72809]:       </nova:owner>
Aug 09 07:09:21 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 07:09:21 user nova-compute[72809]:       <nova:ports>
Aug 09 07:09:21 user nova-compute[72809]:         <nova:port uuid="61cbb890-9a23-4b5a-903c-33d4a8c6e689">
Aug 09 07:09:21 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 07:09:21 user nova-compute[72809]:         </nova:port>
Aug 09 07:09:21 user nova-compute[72809]:       </nova:ports>
Aug 09 07:09:21 user nova-compute[72809]:     </nova:instance>
Aug 09 07:09:21 user nova-compute[72809]:   </metadata>
Aug 09 07:09:21 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 07:09:21 user nova-compute[72809]:     <system>
Aug 09 07:09:21 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 07:09:21 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 07:09:21 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 07:09:21 user nova-compute[72809]:       <entry name="serial">01292d41-c87f-4ab0-8638-4aca44608f91</entry>
Aug 09 07:09:21 user nova-compute[72809]:       <entry name="uuid">01292d41-c87f-4ab0-8638-4aca44608f91</entry>
Aug 09 07:09:21 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 07:09:21 user nova-compute[72809]:     </system>
Aug 09 07:09:21 user nova-compute[72809]:   </sysinfo>
Aug 09 07:09:21 user nova-compute[72809]:   <os>
Aug 09 07:09:21 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 07:09:21 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 07:09:21 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 07:09:21 user nova-compute[72809]:   </os>
Aug 09 07:09:21 user nova-compute[72809]:   <features>
Aug 09 07:09:21 user nova-compute[72809]:     <acpi/>
Aug 09 07:09:21 user nova-compute[72809]:     <apic/>
Aug 09 07:09:21 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 07:09:21 user nova-compute[72809]:   </features>
Aug 09 07:09:21 user nova-compute[72809]:   <clock offset="utc">
Aug 09 07:09:21 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 07:09:21 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 07:09:21 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 07:09:21 user nova-compute[72809]:   </clock>
Aug 09 07:09:21 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 07:09:21 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 07:09:21 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 07:09:21 user nova-compute[72809]:   </cpu>
Aug 09 07:09:21 user nova-compute[72809]:   <devices>
Aug 09 07:09:21 user nova-compute[72809]:     <disk type="block" device="disk">
Aug 09 07:09:21 user nova-compute[72809]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:09:21 user nova-compute[72809]:       <source dev="/dev/sdc"/>
Aug 09 07:09:21 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 07:09:21 user nova-compute[72809]:       <serial>51cc261a-1c80-4a03-8957-14375673184b</serial>
Aug 09 07:09:21 user nova-compute[72809]:     </disk>
Aug 09 07:09:21 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 07:09:21 user nova-compute[72809]:       <mac address="fa:16:3e:a4:4b:39"/>
Aug 09 07:09:21 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:09:21 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 07:09:21 user nova-compute[72809]:       <target dev="tap61cbb890-9a"/>
Aug 09 07:09:21 user nova-compute[72809]:     </interface>
Aug 09 07:09:21 user nova-compute[72809]:     <serial type="pty">
Aug 09 07:09:21 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/01292d41-c87f-4ab0-8638-4aca44608f91/console.log" append="off"/>
Aug 09 07:09:21 user nova-compute[72809]:     </serial>
Aug 09 07:09:21 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 07:09:21 user nova-compute[72809]:     <video>
Aug 09 07:09:21 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:09:21 user nova-compute[72809]:     </video>
Aug 09 07:09:21 user nova-compute[72809]:     <rng model="virtio">
Aug 09 07:09:21 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 07:09:21 user nova-compute[72809]:     </rng>
Aug 09 07:09:21 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 07:09:21 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 07:09:21 user nova-compute[72809]:       <stats period="10"/>
Aug 09 07:09:21 user nova-compute[72809]:     </memballoon>
Aug 09 07:09:21 user nova-compute[72809]:   </devices>
Aug 09 07:09:21 user nova-compute[72809]: </domain>
Aug 09 07:09:21 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 07:09:21 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:08:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-538618460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-538618460',id=39,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1903437f7ed4c14a0660f64a2e0c647',ramdisk_id='',reservation_id='r-xczy0u8d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-917311946',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:08:55Z,user_data=None,user_id='6c4c5942852b412885a5b4698552058d',uuid=01292d41-c87f-4ab0-8638-4aca44608f91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61cbb890-9a23-4b5a-903c-33d4a8c6e689", "address": "fa:16:3e:a4:4b:39", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cbb890-9a", "ovs_interfaceid": "61cbb890-9a23-4b5a-903c-33d4a8c6e689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 07:09:21 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Converting VIF {"id": "61cbb890-9a23-4b5a-903c-33d4a8c6e689", "address": "fa:16:3e:a4:4b:39", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cbb890-9a", "ovs_interfaceid": "61cbb890-9a23-4b5a-903c-33d4a8c6e689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:09:21 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:4b:39,bridge_name='br-int',has_traffic_filtering=True,id=61cbb890-9a23-4b5a-903c-33d4a8c6e689,network=Network(5f03b0f9-e80d-428f-b0a6-57158568e620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61cbb890-9a') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:09:21 user nova-compute[72809]: DEBUG os_vif [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:4b:39,bridge_name='br-int',has_traffic_filtering=True,id=61cbb890-9a23-4b5a-903c-33d4a8c6e689,network=Network(5f03b0f9-e80d-428f-b0a6-57158568e620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61cbb890-9a') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 07:09:21 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:21 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:09:21 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 07:09:21 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:21 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61cbb890-9a, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:09:21 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap61cbb890-9a, col_values=(('external_ids', {'iface-id': '61cbb890-9a23-4b5a-903c-33d4a8c6e689', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:4b:39', 'vm-uuid': '01292d41-c87f-4ab0-8638-4aca44608f91'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:09:21 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:21 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:09:21 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:21 user nova-compute[72809]: INFO os_vif [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:4b:39,bridge_name='br-int',has_traffic_filtering=True,id=61cbb890-9a23-4b5a-903c-33d4a8c6e689,network=Network(5f03b0f9-e80d-428f-b0a6-57158568e620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61cbb890-9a')
Aug 09 07:09:21 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:09:21 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] No VIF found with MAC fa:16:3e:a4:4b:39, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:09:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:23 user nova-compute[72809]: DEBUG nova.compute.manager [req-85b44d39-e0db-4820-a4f0-d8e10e36e509 req-773ce58b-b924-40e0-b56d-b325d7958434 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received event network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:09:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-85b44d39-e0db-4820-a4f0-d8e10e36e509 req-773ce58b-b924-40e0-b56d-b325d7958434 service nova] Acquiring lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:09:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-85b44d39-e0db-4820-a4f0-d8e10e36e509 req-773ce58b-b924-40e0-b56d-b325d7958434 service nova] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:09:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-85b44d39-e0db-4820-a4f0-d8e10e36e509 req-773ce58b-b924-40e0-b56d-b325d7958434 service nova] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:09:23 user nova-compute[72809]: DEBUG nova.compute.manager [req-85b44d39-e0db-4820-a4f0-d8e10e36e509 req-773ce58b-b924-40e0-b56d-b325d7958434 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] No waiting events found dispatching network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:09:23 user nova-compute[72809]: WARNING nova.compute.manager [req-85b44d39-e0db-4820-a4f0-d8e10e36e509 req-773ce58b-b924-40e0-b56d-b325d7958434 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received unexpected event network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 for instance with vm_state building and task_state spawning.
Aug 09 07:09:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:25 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564965.148558, 01292d41-c87f-4ab0-8638-4aca44608f91 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:09:25 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] VM Resumed (Lifecycle Event)
Aug 09 07:09:25 user nova-compute[72809]: DEBUG nova.compute.manager [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 07:09:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 07:09:25 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Instance spawned successfully.
Aug 09 07:09:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 07:09:25 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:09:25 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:09:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:09:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:09:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:09:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:09:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:09:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:09:25 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:09:25 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691564965.1499095, 01292d41-c87f-4ab0-8638-4aca44608f91 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:09:25 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] VM Started (Lifecycle Event)
Aug 09 07:09:25 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:09:25 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:09:25 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:09:25 user nova-compute[72809]: INFO nova.compute.manager [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Took 5.08 seconds to spawn the instance on the hypervisor.
Aug 09 07:09:25 user nova-compute[72809]: DEBUG nova.compute.manager [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:09:25 user nova-compute[72809]: DEBUG nova.compute.manager [req-4e43d488-e569-4e6a-afea-6df1f5cba006 req-41046ced-a275-4aa2-84cf-6fedbfeebea0 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received event network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:09:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-4e43d488-e569-4e6a-afea-6df1f5cba006 req-41046ced-a275-4aa2-84cf-6fedbfeebea0 service nova] Acquiring lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:09:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-4e43d488-e569-4e6a-afea-6df1f5cba006 req-41046ced-a275-4aa2-84cf-6fedbfeebea0 service nova] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:09:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-4e43d488-e569-4e6a-afea-6df1f5cba006 req-41046ced-a275-4aa2-84cf-6fedbfeebea0 service nova] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:09:25 user nova-compute[72809]: DEBUG nova.compute.manager [req-4e43d488-e569-4e6a-afea-6df1f5cba006 req-41046ced-a275-4aa2-84cf-6fedbfeebea0 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] No waiting events found dispatching network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:09:25 user nova-compute[72809]: WARNING nova.compute.manager [req-4e43d488-e569-4e6a-afea-6df1f5cba006 req-41046ced-a275-4aa2-84cf-6fedbfeebea0 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received unexpected event network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 for instance with vm_state building and task_state spawning.
Aug 09 07:09:25 user nova-compute[72809]: INFO nova.compute.manager [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Took 31.02 seconds to build instance.
Aug 09 07:09:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-35396b62-0aa1-46ab-93ef-8dec908ac2f0 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "01292d41-c87f-4ab0-8638-4aca44608f91" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.133s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:09:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:31 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:36 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:38 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:09:38 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 07:09:38 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Rebuilding the list of instances to heal {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 07:09:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-336770eb-4f09-4134-92ef-f96039bf4fa9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:09:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-336770eb-4f09-4134-92ef-f96039bf4fa9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:09:38 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 07:09:38 user nova-compute[72809]: DEBUG nova.objects.instance [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lazy-loading 'info_cache' on Instance uuid 336770eb-4f09-4134-92ef-f96039bf4fa9 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:09:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:39 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Updating instance_info_cache with network_info: [{"id": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "address": "fa:16:3e:b9:56:8d", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac68313-9d", "ovs_interfaceid": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:09:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-336770eb-4f09-4134-92ef-f96039bf4fa9" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:09:39 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 07:09:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:41 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:09:41 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:09:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:09:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:09:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:09:41 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 07:09:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json" returned: 0 in 0.164s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:42 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b527d58f-3171-4d22-980a-545824bf9523/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b527d58f-3171-4d22-980a-545824bf9523/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b527d58f-3171-4d22-980a-545824bf9523/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b527d58f-3171-4d22-980a-545824bf9523/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:43 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:43 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:09:43 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:09:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:09:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:09:44 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:09:44 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:09:44 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:09:44 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=7674MB free_disk=25.047138214111328GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 07:09:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:09:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:09:45 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 336770eb-4f09-4134-92ef-f96039bf4fa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:09:45 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 1bde423f-0b73-448f-bdce-8d6af96d8fc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:09:45 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance bebd5a14-6272-4de1-a1a1-4fb45b867c7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:09:45 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 339372ed-140d-4226-ba00-2cc682214d5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:09:45 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 466a8e58-5f88-4ffe-a7fd-a346003f3508 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:09:45 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 63936bb9-97de-4a87-aa29-14129104c1d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:09:45 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 6e9996e8-c5eb-42c1-b88f-d75654e160c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:09:45 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 01292d41-c87f-4ab0-8638-4aca44608f91 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:09:45 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance b527d58f-3171-4d22-980a-545824bf9523 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:09:45 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 07:09:45 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 07:09:45 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:09:45 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:09:45 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 07:09:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.572s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:09:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:46 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:09:46 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:09:46 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:09:46 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:09:46 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Cleaning up deleted instances {{(pid=72809) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 07:09:46 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] There are 0 instances to clean {{(pid=72809) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 07:09:47 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:09:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:49 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:09:49 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 07:09:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:53 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:09:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:56 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:09:57 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:09:57 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72809) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 07:09:57 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:09:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b1a05ce9-5c5a-4b50-8f57-3ed29e776bc0 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "336770eb-4f09-4134-92ef-f96039bf4fa9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:10:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b1a05ce9-5c5a-4b50-8f57-3ed29e776bc0 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "336770eb-4f09-4134-92ef-f96039bf4fa9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:10:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b1a05ce9-5c5a-4b50-8f57-3ed29e776bc0 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "336770eb-4f09-4134-92ef-f96039bf4fa9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:10:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b1a05ce9-5c5a-4b50-8f57-3ed29e776bc0 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "336770eb-4f09-4134-92ef-f96039bf4fa9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:10:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b1a05ce9-5c5a-4b50-8f57-3ed29e776bc0 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "336770eb-4f09-4134-92ef-f96039bf4fa9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:10:01 user nova-compute[72809]: INFO nova.compute.manager [None req-b1a05ce9-5c5a-4b50-8f57-3ed29e776bc0 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Terminating instance
Aug 09 07:10:01 user nova-compute[72809]: DEBUG nova.compute.manager [None req-b1a05ce9-5c5a-4b50-8f57-3ed29e776bc0 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:10:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:01 user nova-compute[72809]: DEBUG nova.compute.manager [req-b0f853e4-2439-46fd-9b95-d6712f271378 req-ed4219d5-8d28-4de6-bf5a-9ae2b4c0365f service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Received event network-vif-unplugged-8ac68313-9d94-449d-87e1-9fb135c7bab5 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:10:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b0f853e4-2439-46fd-9b95-d6712f271378 req-ed4219d5-8d28-4de6-bf5a-9ae2b4c0365f service nova] Acquiring lock "336770eb-4f09-4134-92ef-f96039bf4fa9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:10:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b0f853e4-2439-46fd-9b95-d6712f271378 req-ed4219d5-8d28-4de6-bf5a-9ae2b4c0365f service nova] Lock "336770eb-4f09-4134-92ef-f96039bf4fa9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:10:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b0f853e4-2439-46fd-9b95-d6712f271378 req-ed4219d5-8d28-4de6-bf5a-9ae2b4c0365f service nova] Lock "336770eb-4f09-4134-92ef-f96039bf4fa9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:10:01 user nova-compute[72809]: DEBUG nova.compute.manager [req-b0f853e4-2439-46fd-9b95-d6712f271378 req-ed4219d5-8d28-4de6-bf5a-9ae2b4c0365f service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] No waiting events found dispatching network-vif-unplugged-8ac68313-9d94-449d-87e1-9fb135c7bab5 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:10:01 user nova-compute[72809]: DEBUG nova.compute.manager [req-b0f853e4-2439-46fd-9b95-d6712f271378 req-ed4219d5-8d28-4de6-bf5a-9ae2b4c0365f service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Received event network-vif-unplugged-8ac68313-9d94-449d-87e1-9fb135c7bab5 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:10:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:02 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Instance destroyed successfully.
Aug 09 07:10:02 user nova-compute[72809]: DEBUG nova.objects.instance [None req-b1a05ce9-5c5a-4b50-8f57-3ed29e776bc0 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lazy-loading 'resources' on Instance uuid 336770eb-4f09-4134-92ef-f96039bf4fa9 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:10:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-b1a05ce9-5c5a-4b50-8f57-3ed29e776bc0 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T06:53:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-83451525',display_name='tempest-ServerActionsTestOtherA-server-354299267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-83451525',id=16,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCouL5r1ONNNh4MEm1cE7q85fOqyiHXG74zUMePb7Qx7FM94grlflWjrtC3jQ2LeCgVBOqUmmFTQqcvNJ0pbLdMAdhZ4dM0vJEiMtEgevMXZ2oGhFPDEpbVyaR20DJopHw==',key_name='tempest-keypair-888098152',keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:57:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6da97330281c4d0eba99e485db051973',ramdisk_id='',reservation_id='r-p0mtguey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-118844208',owner_user_name='tempest-ServerActionsTestOtherA-118844208-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:57:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10e067d2b5b7459cadf50b1ed89a8864',uuid=336770eb-4f09-4134-92ef-f96039bf4fa9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "address": "fa:16:3e:b9:56:8d", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac68313-9d", "ovs_interfaceid": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:10:02 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-b1a05ce9-5c5a-4b50-8f57-3ed29e776bc0 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Converting VIF {"id": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "address": "fa:16:3e:b9:56:8d", "network": {"id": "0e68e18b-480a-4b6c-b194-39ba1099a4bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-268127379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6da97330281c4d0eba99e485db051973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac68313-9d", "ovs_interfaceid": "8ac68313-9d94-449d-87e1-9fb135c7bab5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:10:02 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-b1a05ce9-5c5a-4b50-8f57-3ed29e776bc0 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:56:8d,bridge_name='br-int',has_traffic_filtering=True,id=8ac68313-9d94-449d-87e1-9fb135c7bab5,network=Network(0e68e18b-480a-4b6c-b194-39ba1099a4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac68313-9d') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:10:02 user nova-compute[72809]: DEBUG os_vif [None req-b1a05ce9-5c5a-4b50-8f57-3ed29e776bc0 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:56:8d,bridge_name='br-int',has_traffic_filtering=True,id=8ac68313-9d94-449d-87e1-9fb135c7bab5,network=Network(0e68e18b-480a-4b6c-b194-39ba1099a4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac68313-9d') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:10:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ac68313-9d, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:10:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:10:02 user nova-compute[72809]: INFO os_vif [None req-b1a05ce9-5c5a-4b50-8f57-3ed29e776bc0 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:56:8d,bridge_name='br-int',has_traffic_filtering=True,id=8ac68313-9d94-449d-87e1-9fb135c7bab5,network=Network(0e68e18b-480a-4b6c-b194-39ba1099a4bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac68313-9d')
Aug 09 07:10:02 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-b1a05ce9-5c5a-4b50-8f57-3ed29e776bc0 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Deleting instance files /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9_del
Aug 09 07:10:02 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-b1a05ce9-5c5a-4b50-8f57-3ed29e776bc0 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Deletion of /opt/stack/data/nova/instances/336770eb-4f09-4134-92ef-f96039bf4fa9_del complete
Aug 09 07:10:02 user nova-compute[72809]: INFO nova.compute.manager [None req-b1a05ce9-5c5a-4b50-8f57-3ed29e776bc0 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 09 07:10:02 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-b1a05ce9-5c5a-4b50-8f57-3ed29e776bc0 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:10:02 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:10:02 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:10:02 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:10:02 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Took 0.67 seconds to deallocate network for instance.
Aug 09 07:10:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b1a05ce9-5c5a-4b50-8f57-3ed29e776bc0 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:10:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b1a05ce9-5c5a-4b50-8f57-3ed29e776bc0 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:10:03 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-b1a05ce9-5c5a-4b50-8f57-3ed29e776bc0 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:10:03 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-b1a05ce9-5c5a-4b50-8f57-3ed29e776bc0 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:10:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b1a05ce9-5c5a-4b50-8f57-3ed29e776bc0 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:10:03 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-b1a05ce9-5c5a-4b50-8f57-3ed29e776bc0 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Deleted allocations for instance 336770eb-4f09-4134-92ef-f96039bf4fa9
Aug 09 07:10:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b1a05ce9-5c5a-4b50-8f57-3ed29e776bc0 tempest-ServerActionsTestOtherA-118844208 tempest-ServerActionsTestOtherA-118844208-project-member] Lock "336770eb-4f09-4134-92ef-f96039bf4fa9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.113s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:10:03 user nova-compute[72809]: DEBUG nova.compute.manager [req-3bfd7828-7d32-4010-8696-db1054f8c330 req-59c34f74-9413-406c-9f40-5bb98692ce5d service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Received event network-vif-plugged-8ac68313-9d94-449d-87e1-9fb135c7bab5 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:10:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3bfd7828-7d32-4010-8696-db1054f8c330 req-59c34f74-9413-406c-9f40-5bb98692ce5d service nova] Acquiring lock "336770eb-4f09-4134-92ef-f96039bf4fa9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:10:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3bfd7828-7d32-4010-8696-db1054f8c330 req-59c34f74-9413-406c-9f40-5bb98692ce5d service nova] Lock "336770eb-4f09-4134-92ef-f96039bf4fa9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:10:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3bfd7828-7d32-4010-8696-db1054f8c330 req-59c34f74-9413-406c-9f40-5bb98692ce5d service nova] Lock "336770eb-4f09-4134-92ef-f96039bf4fa9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:10:03 user nova-compute[72809]: DEBUG nova.compute.manager [req-3bfd7828-7d32-4010-8696-db1054f8c330 req-59c34f74-9413-406c-9f40-5bb98692ce5d service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] No waiting events found dispatching network-vif-plugged-8ac68313-9d94-449d-87e1-9fb135c7bab5 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:10:03 user nova-compute[72809]: WARNING nova.compute.manager [req-3bfd7828-7d32-4010-8696-db1054f8c330 req-59c34f74-9413-406c-9f40-5bb98692ce5d service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Received unexpected event network-vif-plugged-8ac68313-9d94-449d-87e1-9fb135c7bab5 for instance with vm_state deleted and task_state None.
Aug 09 07:10:03 user nova-compute[72809]: DEBUG nova.compute.manager [req-3bfd7828-7d32-4010-8696-db1054f8c330 req-59c34f74-9413-406c-9f40-5bb98692ce5d service nova] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Received event network-vif-deleted-8ac68313-9d94-449d-87e1-9fb135c7bab5 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:10:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:17 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691565002.1174943, 336770eb-4f09-4134-92ef-f96039bf4fa9 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:10:17 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] VM Stopped (Lifecycle Event)
Aug 09 07:10:17 user nova-compute[72809]: DEBUG nova.compute.manager [None req-5ec75f93-3db6-4a44-af56-5756fcfeb524 None None] [instance: 336770eb-4f09-4134-92ef-f96039bf4fa9] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:10:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:10:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Acquiring lock "48f0adeb-a5e8-4f81-a534-04c702c272a3" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:10:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "48f0adeb-a5e8-4f81-a534-04c702c272a3" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:10:28 user nova-compute[72809]: INFO nova.compute.manager [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Unshelving
Aug 09 07:10:28 user nova-compute[72809]: INFO nova.virt.block_device [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Booting with volume 3386be22-3bf4-4702-888c-9d3e8d2ce54a at /dev/vda
Aug 09 07:10:29 user nova-compute[72809]: DEBUG os_brick.utils [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:10:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:29 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6514c417-601c-4394-9da2-16ece8b7de3c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:10:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:29 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b62e24-3acf-4bba-b461-a54665935c6b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:10:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:29 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0fb561-5a32-4400-8073-1a32585332f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:10:29 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e6c13a-96a5-4cfa-8aed-3f2b7cd907bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:10:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:10:29 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 07:10:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:10:29 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 07:10:29 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8b4102-e540-48aa-b26f-f81ae057f61a]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:10:29 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 07:10:29 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 07:10:29 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 07:10:29 user nova-compute[72809]: DEBUG os_brick.utils [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:10:29 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Updating existing volume attachment record: cf424fcb-b947-45e1-a536-dba6a7b4c818 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 07:10:32 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:10:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:10:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:10:38 user nova-compute[72809]: DEBUG nova.objects.instance [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lazy-loading 'pci_requests' on Instance uuid 48f0adeb-a5e8-4f81-a534-04c702c272a3 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:10:38 user nova-compute[72809]: DEBUG nova.objects.instance [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lazy-loading 'numa_topology' on Instance uuid 48f0adeb-a5e8-4f81-a534-04c702c272a3 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:10:38 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 07:10:38 user nova-compute[72809]: INFO nova.compute.claims [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Claim successful on node user
Aug 09 07:10:38 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Refreshing inventories for resource provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 07:10:38 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Updating ProviderTree inventory for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 07:10:38 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Updating inventory in ProviderTree for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 07:10:38 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Refreshing aggregate associations for resource provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3, aggregates: None {{(pid=72809) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 07:10:38 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Refreshing trait associations for resource provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI {{(pid=72809) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 07:10:38 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:10:38 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:10:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.731s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:10:39 user nova-compute[72809]: INFO nova.network.neutron [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Updating port 69cd2937-cfc9-42c1-bd26-c5debab643fc with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 09 07:10:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Acquiring lock "refresh_cache-48f0adeb-a5e8-4f81-a534-04c702c272a3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:10:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Acquired lock "refresh_cache-48f0adeb-a5e8-4f81-a534-04c702c272a3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:10:39 user nova-compute[72809]: DEBUG nova.network.neutron [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:10:40 user nova-compute[72809]: DEBUG nova.compute.manager [req-02b1e4b4-a4af-4654-aad8-d9b9c3eb8c93 req-c0483290-de7a-4dad-ac4d-59e29a4ba07c service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Received event network-changed-69cd2937-cfc9-42c1-bd26-c5debab643fc {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:10:40 user nova-compute[72809]: DEBUG nova.compute.manager [req-02b1e4b4-a4af-4654-aad8-d9b9c3eb8c93 req-c0483290-de7a-4dad-ac4d-59e29a4ba07c service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Refreshing instance network info cache due to event network-changed-69cd2937-cfc9-42c1-bd26-c5debab643fc. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:10:40 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-02b1e4b4-a4af-4654-aad8-d9b9c3eb8c93 req-c0483290-de7a-4dad-ac4d-59e29a4ba07c service nova] Acquiring lock "refresh_cache-48f0adeb-a5e8-4f81-a534-04c702c272a3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:10:40 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:10:40 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 07:10:40 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-1bde423f-0b73-448f-bdce-8d6af96d8fc6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:10:40 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-1bde423f-0b73-448f-bdce-8d6af96d8fc6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:10:40 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 07:10:40 user nova-compute[72809]: DEBUG nova.network.neutron [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Updating instance_info_cache with network_info: [{"id": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "address": "fa:16:3e:43:7d:86", "network": {"id": "2bd3fecc-598f-4b7d-a306-5b31f8e81019", "bridge": "br-int", "label": "tempest-TestShelveInstance-696590898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0c708ffc744c3ab8175ad7b939e4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd2937-cf", "ovs_interfaceid": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:10:40 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Releasing lock "refresh_cache-48f0adeb-a5e8-4f81-a534-04c702c272a3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:10:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 07:10:40 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Creating image(s)
Aug 09 07:10:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Did not create local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 07:10:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Ensure instance console log exists: /opt/stack/data/nova/instances/48f0adeb-a5e8-4f81-a534-04c702c272a3/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 07:10:40 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:10:40 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:10:40 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:10:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Start _get_guest_xml network_info=[{"id": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "address": "fa:16:3e:43:7d:86", "network": {"id": "2bd3fecc-598f-4b7d-a306-5b31f8e81019", "bridge": "br-int", "label": "tempest-TestShelveInstance-696590898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0c708ffc744c3ab8175ad7b939e4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd2937-cf", "ovs_interfaceid": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsWoEVyQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '48f0adeb-a5e8-4f81-a534-04c702c272a3', 'attached_at': '', 'detached_at': '', 'volume_id': '3386be22-3bf4-4702-888c-9d3e8d2ce54a', 'serial': '3386be22-3bf4-4702-888c-9d3e8d2ce54a'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'boot_index': 0, 'attachment_id': 'cf424fcb-b947-45e1-a536-dba6a7b4c818', 'volume_type': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 07:10:40 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-02b1e4b4-a4af-4654-aad8-d9b9c3eb8c93 req-c0483290-de7a-4dad-ac4d-59e29a4ba07c service nova] Acquired lock "refresh_cache-48f0adeb-a5e8-4f81-a534-04c702c272a3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:10:40 user nova-compute[72809]: DEBUG nova.network.neutron [req-02b1e4b4-a4af-4654-aad8-d9b9c3eb8c93 req-c0483290-de7a-4dad-ac4d-59e29a4ba07c service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Refreshing network info cache for port 69cd2937-cfc9-42c1-bd26-c5debab643fc {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:10:40 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:10:40 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:10:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG nova.objects.instance [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lazy-loading 'vcpu_model' on Instance uuid 48f0adeb-a5e8-4f81-a534-04c702c272a3 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsWoEVyQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:10:41 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:10:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:10:41 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:10:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:10:41 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3f91f7-a0b1-47a8-908e-47ec6ecb269e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 07:10:41 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[af35ed24-5e22-45b4-bb08-f046025fd44d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a] added
Aug 09 07:10:41 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6894f65a-8986-4c06-994c-668b11352bbc]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca7aed4-433d-49c6-b9c7-4b6a8cecf47b]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DsWoEVyQ {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DsWoEVyQ" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[db714417-0846-45d7-a6f7-b26e3824d0ea]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DsWoEVyQ'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[440e339d-c2c4-48f5-a389-05f7da023f5f]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[575e1a2d-2cd2-4a99-b1b5-523993e6d5ce]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:10:41 user nova-compute[72809]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)
Aug 09 07:10:41 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:10:41 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:10:41 user nova-compute[72809]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)
Aug 09 07:10:41 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:10:41 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0f006f-bfcb-4a44-89a9-f341fb83d88a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a, portal: 172.16.0.220,3260]
Aug 09 07:10:41 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a, portal: 172.16.0.220,3260] successful.
Aug 09 07:10:41 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Updating instance_info_cache with network_info: [{"id": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "address": "fa:16:3e:3b:e0:d8", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81017ed8-c8", "ovs_interfaceid": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2989a8-3b02-4211-896a-d6c5f9f7332d]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-1bde423f-0b73-448f-bdce-8d6af96d8fc6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c4f85e-e903-4ab0-ac31-eeeadcd4f00e]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:10:41 user nova-compute[72809]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)
Aug 09 07:10:41 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:10:41 user nova-compute[72809]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a (non-flash)
Aug 09 07:10:41 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:10:41 user nova-compute[72809]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)
Aug 09 07:10:41 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:10:41 user nova-compute[72809]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a (non-flash)
Aug 09 07:10:41 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.028s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82a373e-8f99-4ef0-9105-42b924e57343]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsWoEVyQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 07:10:41 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG nova.compute.manager [req-9c4275db-cd35-4c03-841d-185fe5ab5d87 req-52ad0134-1308-416d-b36a-79e8877db3a1 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Received event network-changed-871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG nova.compute.manager [req-9c4275db-cd35-4c03-841d-185fe5ab5d87 req-52ad0134-1308-416d-b36a-79e8877db3a1 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Refreshing instance network info cache due to event network-changed-871a925e-dae2-45d5-8e6d-24d429032d70. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9c4275db-cd35-4c03-841d-185fe5ab5d87 req-52ad0134-1308-416d-b36a-79e8877db3a1 service nova] Acquiring lock "refresh_cache-63936bb9-97de-4a87-aa29-14129104c1d3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9c4275db-cd35-4c03-841d-185fe5ab5d87 req-52ad0134-1308-416d-b36a-79e8877db3a1 service nova] Acquired lock "refresh_cache-63936bb9-97de-4a87-aa29-14129104c1d3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG nova.network.neutron [req-9c4275db-cd35-4c03-841d-185fe5ab5d87 req-52ad0134-1308-416d-b36a-79e8877db3a1 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Refreshing network info cache for port 871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG nova.network.neutron [req-02b1e4b4-a4af-4654-aad8-d9b9c3eb8c93 req-c0483290-de7a-4dad-ac4d-59e29a4ba07c service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Updated VIF entry in instance network info cache for port 69cd2937-cfc9-42c1-bd26-c5debab643fc. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG nova.network.neutron [req-02b1e4b4-a4af-4654-aad8-d9b9c3eb8c93 req-c0483290-de7a-4dad-ac4d-59e29a4ba07c service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Updating instance_info_cache with network_info: [{"id": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "address": "fa:16:3e:43:7d:86", "network": {"id": "2bd3fecc-598f-4b7d-a306-5b31f8e81019", "bridge": "br-int", "label": "tempest-TestShelveInstance-696590898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0c708ffc744c3ab8175ad7b939e4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd2937-cf", "ovs_interfaceid": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-02b1e4b4-a4af-4654-aad8-d9b9c3eb8c93 req-c0483290-de7a-4dad-ac4d-59e29a4ba07c service nova] Releasing lock "refresh_cache-48f0adeb-a5e8-4f81-a534-04c702c272a3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23932396532313232', 'path': '/dev/sde'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932396532313232', 'path': '/dev/sde'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T07:06:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1995239041',display_name='tempest-TestShelveInstance-server-1995239041',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1995239041',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1236424892',keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:07:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4b0c708ffc744c3ab8175ad7b939e4e3',ramdisk_id='',reservation_id='r-1lnz0lx6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1139600942',owner_user_name='tempest-TestShelveInstance-1139600942-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:10:29Z,user_data=None,user_id='e0e9000c85ba4fa5aef9c2c2b592b950',uuid=48f0adeb-a5e8-4f81-a534-04c702c272a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "address": "fa:16:3e:43:7d:86", "network": {"id": "2bd3fecc-598f-4b7d-a306-5b31f8e81019", "bridge": "br-int", "label": "tempest-TestShelveInstance-696590898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0c708ffc744c3ab8175ad7b939e4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd2937-cf", "ovs_interfaceid": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Converting VIF {"id": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "address": "fa:16:3e:43:7d:86", "network": {"id": "2bd3fecc-598f-4b7d-a306-5b31f8e81019", "bridge": "br-int", "label": "tempest-TestShelveInstance-696590898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0c708ffc744c3ab8175ad7b939e4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd2937-cf", "ovs_interfaceid": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:7d:86,bridge_name='br-int',has_traffic_filtering=True,id=69cd2937-cfc9-42c1-bd26-c5debab643fc,network=Network(2bd3fecc-598f-4b7d-a306-5b31f8e81019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69cd2937-cf') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG nova.objects.instance [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lazy-loading 'pci_devices' on Instance uuid 48f0adeb-a5e8-4f81-a534-04c702c272a3 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] End _get_guest_xml xml=<domain type="kvm">
Aug 09 07:10:42 user nova-compute[72809]:   <uuid>48f0adeb-a5e8-4f81-a534-04c702c272a3</uuid>
Aug 09 07:10:42 user nova-compute[72809]:   <name>instance-00000026</name>
Aug 09 07:10:42 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 07:10:42 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 07:10:42 user nova-compute[72809]:   <metadata>
Aug 09 07:10:42 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 07:10:42 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 07:10:42 user nova-compute[72809]:       <nova:name>tempest-TestShelveInstance-server-1995239041</nova:name>
Aug 09 07:10:42 user nova-compute[72809]:       <nova:creationTime>2023-08-09 07:10:40</nova:creationTime>
Aug 09 07:10:42 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 07:10:42 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 07:10:42 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 07:10:42 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 07:10:42 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 07:10:42 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 07:10:42 user nova-compute[72809]:       </nova:flavor>
Aug 09 07:10:42 user nova-compute[72809]:       <nova:owner>
Aug 09 07:10:42 user nova-compute[72809]:         <nova:user uuid="e0e9000c85ba4fa5aef9c2c2b592b950">tempest-TestShelveInstance-1139600942-project-member</nova:user>
Aug 09 07:10:42 user nova-compute[72809]:         <nova:project uuid="4b0c708ffc744c3ab8175ad7b939e4e3">tempest-TestShelveInstance-1139600942</nova:project>
Aug 09 07:10:42 user nova-compute[72809]:       </nova:owner>
Aug 09 07:10:42 user nova-compute[72809]:       <nova:ports>
Aug 09 07:10:42 user nova-compute[72809]:         <nova:port uuid="69cd2937-cfc9-42c1-bd26-c5debab643fc">
Aug 09 07:10:42 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 07:10:42 user nova-compute[72809]:         </nova:port>
Aug 09 07:10:42 user nova-compute[72809]:       </nova:ports>
Aug 09 07:10:42 user nova-compute[72809]:     </nova:instance>
Aug 09 07:10:42 user nova-compute[72809]:   </metadata>
Aug 09 07:10:42 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 07:10:42 user nova-compute[72809]:     <system>
Aug 09 07:10:42 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 07:10:42 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 07:10:42 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 07:10:42 user nova-compute[72809]:       <entry name="serial">48f0adeb-a5e8-4f81-a534-04c702c272a3</entry>
Aug 09 07:10:42 user nova-compute[72809]:       <entry name="uuid">48f0adeb-a5e8-4f81-a534-04c702c272a3</entry>
Aug 09 07:10:42 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 07:10:42 user nova-compute[72809]:     </system>
Aug 09 07:10:42 user nova-compute[72809]:   </sysinfo>
Aug 09 07:10:42 user nova-compute[72809]:   <os>
Aug 09 07:10:42 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 07:10:42 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 07:10:42 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 07:10:42 user nova-compute[72809]:   </os>
Aug 09 07:10:42 user nova-compute[72809]:   <features>
Aug 09 07:10:42 user nova-compute[72809]:     <acpi/>
Aug 09 07:10:42 user nova-compute[72809]:     <apic/>
Aug 09 07:10:42 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 07:10:42 user nova-compute[72809]:   </features>
Aug 09 07:10:42 user nova-compute[72809]:   <clock offset="utc">
Aug 09 07:10:42 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 07:10:42 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 07:10:42 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 07:10:42 user nova-compute[72809]:   </clock>
Aug 09 07:10:42 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 07:10:42 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 07:10:42 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 07:10:42 user nova-compute[72809]:   </cpu>
Aug 09 07:10:42 user nova-compute[72809]:   <devices>
Aug 09 07:10:42 user nova-compute[72809]:     <disk type="block" device="disk">
Aug 09 07:10:42 user nova-compute[72809]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:10:42 user nova-compute[72809]:       <source dev="/dev/sde"/>
Aug 09 07:10:42 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 07:10:42 user nova-compute[72809]:       <serial>3386be22-3bf4-4702-888c-9d3e8d2ce54a</serial>
Aug 09 07:10:42 user nova-compute[72809]:     </disk>
Aug 09 07:10:42 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 07:10:42 user nova-compute[72809]:       <mac address="fa:16:3e:43:7d:86"/>
Aug 09 07:10:42 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:10:42 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 07:10:42 user nova-compute[72809]:       <target dev="tap69cd2937-cf"/>
Aug 09 07:10:42 user nova-compute[72809]:     </interface>
Aug 09 07:10:42 user nova-compute[72809]:     <serial type="pty">
Aug 09 07:10:42 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/48f0adeb-a5e8-4f81-a534-04c702c272a3/console.log" append="off"/>
Aug 09 07:10:42 user nova-compute[72809]:     </serial>
Aug 09 07:10:42 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 07:10:42 user nova-compute[72809]:     <video>
Aug 09 07:10:42 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:10:42 user nova-compute[72809]:     </video>
Aug 09 07:10:42 user nova-compute[72809]:     <rng model="virtio">
Aug 09 07:10:42 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 07:10:42 user nova-compute[72809]:     </rng>
Aug 09 07:10:42 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 07:10:42 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 07:10:42 user nova-compute[72809]:       <stats period="10"/>
Aug 09 07:10:42 user nova-compute[72809]:     </memballoon>
Aug 09 07:10:42 user nova-compute[72809]:   </devices>
Aug 09 07:10:42 user nova-compute[72809]: </domain>
Aug 09 07:10:42 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T07:06:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1995239041',display_name='tempest-TestShelveInstance-server-1995239041',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1995239041',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1236424892',keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:07:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4b0c708ffc744c3ab8175ad7b939e4e3',ramdisk_id='',reservation_id='r-1lnz0lx6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1139600942',owner_user_name='tempest-TestShelveInstance-1139600942-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:10:29Z,user_data=None,user_id='e0e9000c85ba4fa5aef9c2c2b592b950',uuid=48f0adeb-a5e8-4f81-a534-04c702c272a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "address": "fa:16:3e:43:7d:86", "network": {"id": "2bd3fecc-598f-4b7d-a306-5b31f8e81019", "bridge": "br-int", "label": "tempest-TestShelveInstance-696590898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0c708ffc744c3ab8175ad7b939e4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd2937-cf", "ovs_interfaceid": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Converting VIF {"id": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "address": "fa:16:3e:43:7d:86", "network": {"id": "2bd3fecc-598f-4b7d-a306-5b31f8e81019", "bridge": "br-int", "label": "tempest-TestShelveInstance-696590898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0c708ffc744c3ab8175ad7b939e4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd2937-cf", "ovs_interfaceid": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:7d:86,bridge_name='br-int',has_traffic_filtering=True,id=69cd2937-cfc9-42c1-bd26-c5debab643fc,network=Network(2bd3fecc-598f-4b7d-a306-5b31f8e81019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69cd2937-cf') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG os_vif [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:7d:86,bridge_name='br-int',has_traffic_filtering=True,id=69cd2937-cfc9-42c1-bd26-c5debab643fc,network=Network(2bd3fecc-598f-4b7d-a306-5b31f8e81019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69cd2937-cf') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69cd2937-cf, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap69cd2937-cf, col_values=(('external_ids', {'iface-id': '69cd2937-cfc9-42c1-bd26-c5debab643fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:7d:86', 'vm-uuid': '48f0adeb-a5e8-4f81-a534-04c702c272a3'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:42 user nova-compute[72809]: INFO os_vif [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:7d:86,bridge_name='br-int',has_traffic_filtering=True,id=69cd2937-cfc9-42c1-bd26-c5debab643fc,network=Network(2bd3fecc-598f-4b7d-a306-5b31f8e81019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69cd2937-cf')
Aug 09 07:10:42 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] No VIF found with MAC fa:16:3e:43:7d:86, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "63936bb9-97de-4a87-aa29-14129104c1d3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "63936bb9-97de-4a87-aa29-14129104c1d3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:10:42 user nova-compute[72809]: INFO nova.compute.manager [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Detaching volume a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb
Aug 09 07:10:42 user nova-compute[72809]: DEBUG nova.network.neutron [req-9c4275db-cd35-4c03-841d-185fe5ab5d87 req-52ad0134-1308-416d-b36a-79e8877db3a1 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Updated VIF entry in instance network info cache for port 871a925e-dae2-45d5-8e6d-24d429032d70. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG nova.network.neutron [req-9c4275db-cd35-4c03-841d-185fe5ab5d87 req-52ad0134-1308-416d-b36a-79e8877db3a1 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Updating instance_info_cache with network_info: [{"id": "871a925e-dae2-45d5-8e6d-24d429032d70", "address": "fa:16:3e:a0:e1:1d", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871a925e-da", "ovs_interfaceid": "871a925e-dae2-45d5-8e6d-24d429032d70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9c4275db-cd35-4c03-841d-185fe5ab5d87 req-52ad0134-1308-416d-b36a-79e8877db3a1 service nova] Releasing lock "refresh_cache-63936bb9-97de-4a87-aa29-14129104c1d3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:10:42 user nova-compute[72809]: INFO nova.virt.block_device [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Attempting to driver detach volume a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb from mountpoint /dev/vdb
Aug 09 07:10:42 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Attempting to detach device vdb from instance 63936bb9-97de-4a87-aa29-14129104c1d3 from the persistent domain config. {{(pid=72809) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:10:42 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:10:42 user nova-compute[72809]:   <source dev="/dev/sdd"/>
Aug 09 07:10:42 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:10:42 user nova-compute[72809]:   <serial>a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb</serial>
Aug 09 07:10:42 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 07:10:42 user nova-compute[72809]: </disk>
Aug 09 07:10:42 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:10:42 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Successfully detached device vdb from instance 63936bb9-97de-4a87-aa29-14129104c1d3 from the persistent domain config.
Aug 09 07:10:42 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 63936bb9-97de-4a87-aa29-14129104c1d3 from the live domain config. {{(pid=72809) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:10:42 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:10:42 user nova-compute[72809]:   <source dev="/dev/sdd"/>
Aug 09 07:10:42 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:10:42 user nova-compute[72809]:   <serial>a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb</serial>
Aug 09 07:10:42 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 07:10:42 user nova-compute[72809]: </disk>
Aug 09 07:10:42 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:10:42 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Received event <DeviceRemovedEvent: 1691565043.2335155, 63936bb9-97de-4a87-aa29-14129104c1d3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72809) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 63936bb9-97de-4a87-aa29-14129104c1d3 {{(pid=72809) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 07:10:43 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Successfully detached device vdb from instance 63936bb9-97de-4a87-aa29-14129104c1d3 from the live domain config.
Aug 09 07:10:43 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dJceuFZi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:10:43 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:10:43 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[53333d61-76bb-4f0d-8229-afb95ef60bb9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c519db-d78f-4c81-9b2a-170f2239e4b1]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:10:43 user nova-compute[72809]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)
Aug 09 07:10:43 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:10:43 user nova-compute[72809]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a (non-flash)
Aug 09 07:10:43 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:10:43 user nova-compute[72809]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb (non-flash)
Aug 09 07:10:43 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:10:43 user nova-compute[72809]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a (non-flash)
Aug 09 07:10:43 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc1385c8160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb'): ({'sdd'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Removing single pathed devices sdd {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04f7a80-98a1-4bc3-9d19-a3cfff3e924e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5253dc0-79c2-4341-999d-9fe2bb41cadd]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Flushing IO for device /dev/sdd {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4d2ed0-a750-4f3d-9ab3-72c5eb9f3e48]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.028s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dced9d7-dc19-4d07-9239-4ea5e1f5d3c0]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] SCSI volumes sdd have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5af2c5-453b-43f3-a0e0-8232002ac591]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a916846-a673-4a18-a7a3-a864cbe7ab5f]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb, portal: 172.16.0.220,3260]
Aug 09 07:10:43 user nova-compute[72809]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb, portal: 172.16.0.220,3260] successful.
Aug 09 07:10:43 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c5034e-03e4-453e-a20a-c9a0cb3dd1cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[460fd3a9-548d-4c79-963f-1a44efd0afd5]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] <== disconnect_volume: return (291ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:10:43 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:44 user nova-compute[72809]: DEBUG nova.compute.manager [req-a4c943b0-6ac0-410a-8794-f3c1a2d7b3a6 req-7fd54dcf-6205-4cf8-a224-9ba4697c33a3 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Received event network-changed-871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:10:44 user nova-compute[72809]: DEBUG nova.compute.manager [req-a4c943b0-6ac0-410a-8794-f3c1a2d7b3a6 req-7fd54dcf-6205-4cf8-a224-9ba4697c33a3 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Refreshing instance network info cache due to event network-changed-871a925e-dae2-45d5-8e6d-24d429032d70. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:10:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a4c943b0-6ac0-410a-8794-f3c1a2d7b3a6 req-7fd54dcf-6205-4cf8-a224-9ba4697c33a3 service nova] Acquiring lock "refresh_cache-63936bb9-97de-4a87-aa29-14129104c1d3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:10:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a4c943b0-6ac0-410a-8794-f3c1a2d7b3a6 req-7fd54dcf-6205-4cf8-a224-9ba4697c33a3 service nova] Acquired lock "refresh_cache-63936bb9-97de-4a87-aa29-14129104c1d3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:10:44 user nova-compute[72809]: DEBUG nova.network.neutron [req-a4c943b0-6ac0-410a-8794-f3c1a2d7b3a6 req-7fd54dcf-6205-4cf8-a224-9ba4697c33a3 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Refreshing network info cache for port 871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:10:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:44 user nova-compute[72809]: DEBUG nova.objects.instance [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lazy-loading 'flavor' on Instance uuid 63936bb9-97de-4a87-aa29-14129104c1d3 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:10:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-e8249a56-f70b-42a9-a1b0-12f6c2ee960e tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "63936bb9-97de-4a87-aa29-14129104c1d3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.873s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:10:44 user nova-compute[72809]: DEBUG nova.network.neutron [req-a4c943b0-6ac0-410a-8794-f3c1a2d7b3a6 req-7fd54dcf-6205-4cf8-a224-9ba4697c33a3 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Updated VIF entry in instance network info cache for port 871a925e-dae2-45d5-8e6d-24d429032d70. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:10:44 user nova-compute[72809]: DEBUG nova.network.neutron [req-a4c943b0-6ac0-410a-8794-f3c1a2d7b3a6 req-7fd54dcf-6205-4cf8-a224-9ba4697c33a3 service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Updating instance_info_cache with network_info: [{"id": "871a925e-dae2-45d5-8e6d-24d429032d70", "address": "fa:16:3e:a0:e1:1d", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871a925e-da", "ovs_interfaceid": "871a925e-dae2-45d5-8e6d-24d429032d70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:10:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a4c943b0-6ac0-410a-8794-f3c1a2d7b3a6 req-7fd54dcf-6205-4cf8-a224-9ba4697c33a3 service nova] Releasing lock "refresh_cache-63936bb9-97de-4a87-aa29-14129104c1d3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:10:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:45 user nova-compute[72809]: INFO nova.compute.manager [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Rescuing
Aug 09 07:10:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "refresh_cache-01292d41-c87f-4ab0-8638-4aca44608f91" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:10:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquired lock "refresh_cache-01292d41-c87f-4ab0-8638-4aca44608f91" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:10:45 user nova-compute[72809]: DEBUG nova.network.neutron [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:10:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:45 user nova-compute[72809]: DEBUG nova.network.neutron [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Updating instance_info_cache with network_info: [{"id": "61cbb890-9a23-4b5a-903c-33d4a8c6e689", "address": "fa:16:3e:a4:4b:39", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cbb890-9a", "ovs_interfaceid": "61cbb890-9a23-4b5a-903c-33d4a8c6e689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:10:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Releasing lock "refresh_cache-01292d41-c87f-4ab0-8638-4aca44608f91" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:10:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b527d58f-3171-4d22-980a-545824bf9523/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG nova.compute.manager [req-918bd12b-31f6-4a33-84ce-cb977a5f6741 req-851794c8-59b4-4c48-99ed-85d6175a0a0b service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Received event network-vif-plugged-69cd2937-cfc9-42c1-bd26-c5debab643fc {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-918bd12b-31f6-4a33-84ce-cb977a5f6741 req-851794c8-59b4-4c48-99ed-85d6175a0a0b service nova] Acquiring lock "48f0adeb-a5e8-4f81-a534-04c702c272a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-918bd12b-31f6-4a33-84ce-cb977a5f6741 req-851794c8-59b4-4c48-99ed-85d6175a0a0b service nova] Lock "48f0adeb-a5e8-4f81-a534-04c702c272a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-918bd12b-31f6-4a33-84ce-cb977a5f6741 req-851794c8-59b4-4c48-99ed-85d6175a0a0b service nova] Lock "48f0adeb-a5e8-4f81-a534-04c702c272a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG nova.compute.manager [req-918bd12b-31f6-4a33-84ce-cb977a5f6741 req-851794c8-59b4-4c48-99ed-85d6175a0a0b service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] No waiting events found dispatching network-vif-plugged-69cd2937-cfc9-42c1-bd26-c5debab643fc {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:10:46 user nova-compute[72809]: WARNING nova.compute.manager [req-918bd12b-31f6-4a33-84ce-cb977a5f6741 req-851794c8-59b4-4c48-99ed-85d6175a0a0b service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Received unexpected event network-vif-plugged-69cd2937-cfc9-42c1-bd26-c5debab643fc for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 07:10:46 user nova-compute[72809]: DEBUG nova.compute.manager [req-918bd12b-31f6-4a33-84ce-cb977a5f6741 req-851794c8-59b4-4c48-99ed-85d6175a0a0b service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Received event network-vif-plugged-69cd2937-cfc9-42c1-bd26-c5debab643fc {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-918bd12b-31f6-4a33-84ce-cb977a5f6741 req-851794c8-59b4-4c48-99ed-85d6175a0a0b service nova] Acquiring lock "48f0adeb-a5e8-4f81-a534-04c702c272a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-918bd12b-31f6-4a33-84ce-cb977a5f6741 req-851794c8-59b4-4c48-99ed-85d6175a0a0b service nova] Lock "48f0adeb-a5e8-4f81-a534-04c702c272a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-918bd12b-31f6-4a33-84ce-cb977a5f6741 req-851794c8-59b4-4c48-99ed-85d6175a0a0b service nova] Lock "48f0adeb-a5e8-4f81-a534-04c702c272a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG nova.compute.manager [req-918bd12b-31f6-4a33-84ce-cb977a5f6741 req-851794c8-59b4-4c48-99ed-85d6175a0a0b service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] No waiting events found dispatching network-vif-plugged-69cd2937-cfc9-42c1-bd26-c5debab643fc {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:10:46 user nova-compute[72809]: WARNING nova.compute.manager [req-918bd12b-31f6-4a33-84ce-cb977a5f6741 req-851794c8-59b4-4c48-99ed-85d6175a0a0b service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Received unexpected event network-vif-plugged-69cd2937-cfc9-42c1-bd26-c5debab643fc for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 07:10:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG nova.compute.manager [req-26a40186-70b2-454e-864d-c9bfccfa94ca req-6abe15a0-316c-45bc-9120-a56480219f2f service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received event network-vif-unplugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-26a40186-70b2-454e-864d-c9bfccfa94ca req-6abe15a0-316c-45bc-9120-a56480219f2f service nova] Acquiring lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-26a40186-70b2-454e-864d-c9bfccfa94ca req-6abe15a0-316c-45bc-9120-a56480219f2f service nova] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-26a40186-70b2-454e-864d-c9bfccfa94ca req-6abe15a0-316c-45bc-9120-a56480219f2f service nova] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG nova.compute.manager [req-26a40186-70b2-454e-864d-c9bfccfa94ca req-6abe15a0-316c-45bc-9120-a56480219f2f service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] No waiting events found dispatching network-vif-unplugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:10:46 user nova-compute[72809]: WARNING nova.compute.manager [req-26a40186-70b2-454e-864d-c9bfccfa94ca req-6abe15a0-316c-45bc-9120-a56480219f2f service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received unexpected event network-vif-unplugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 for instance with vm_state active and task_state rescuing.
Aug 09 07:10:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b527d58f-3171-4d22-980a-545824bf9523/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b527d58f-3171-4d22-980a-545824bf9523/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b527d58f-3171-4d22-980a-545824bf9523/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691565046.5853705, 48f0adeb-a5e8-4f81-a534-04c702c272a3 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:10:46 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] VM Resumed (Lifecycle Event)
Aug 09 07:10:46 user nova-compute[72809]: DEBUG nova.compute.manager [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 07:10:46 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Instance spawned successfully.
Aug 09 07:10:46 user nova-compute[72809]: DEBUG nova.compute.manager [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:10:46 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:10:46 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691565046.5858972, 48f0adeb-a5e8-4f81-a534-04c702c272a3 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:10:46 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] VM Started (Lifecycle Event)
Aug 09 07:10:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6afa29c6-fd85-40ef-86fe-b6a64c671af7 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "48f0adeb-a5e8-4f81-a534-04c702c272a3" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.895s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:10:46 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Instance destroyed successfully.
Aug 09 07:10:46 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Attempting a stable device rescue
Aug 09 07:10:46 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72809) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Instance directory exists: not creating {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 07:10:46 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Creating image(s)
Aug 09 07:10:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "/opt/stack/data/nova/instances/01292d41-c87f-4ab0-8638-4aca44608f91/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "/opt/stack/data/nova/instances/01292d41-c87f-4ab0-8638-4aca44608f91/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "/opt/stack/data/nova/instances/01292d41-c87f-4ab0-8638-4aca44608f91/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG nova.objects.instance [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lazy-loading 'trusted_certs' on Instance uuid 01292d41-c87f-4ab0-8638-4aca44608f91 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "105db938e88836852bb67e943a14dce3d494b314" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "105db938e88836852bb67e943a14dce3d494b314" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:10:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/105db938e88836852bb67e943a14dce3d494b314.part --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk --force-share --output=json" returned: 0 in 1.298s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/105db938e88836852bb67e943a14dce3d494b314.part --force-share --output=json" returned: 0 in 0.157s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:48 user nova-compute[72809]: DEBUG nova.virt.images [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] 89458c0d-b794-4cfc-b121-b96c8b729215 was qcow2, converting to raw {{(pid=72809) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 07:10:48 user nova-compute[72809]: DEBUG nova.privsep.utils [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72809) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 07:10:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/105db938e88836852bb67e943a14dce3d494b314.part /opt/stack/data/nova/instances/_base/105db938e88836852bb67e943a14dce3d494b314.converted {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:10:48 user nova-compute[72809]: DEBUG nova.compute.manager [req-1fd6c92a-e571-4feb-a140-d9aa4d8ac4b9 req-51a1bd3d-8b48-41cb-9540-bb7786e7f82c service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received event network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:10:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1fd6c92a-e571-4feb-a140-d9aa4d8ac4b9 req-51a1bd3d-8b48-41cb-9540-bb7786e7f82c service nova] Acquiring lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:10:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1fd6c92a-e571-4feb-a140-d9aa4d8ac4b9 req-51a1bd3d-8b48-41cb-9540-bb7786e7f82c service nova] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:10:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1fd6c92a-e571-4feb-a140-d9aa4d8ac4b9 req-51a1bd3d-8b48-41cb-9540-bb7786e7f82c service nova] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:10:48 user nova-compute[72809]: DEBUG nova.compute.manager [req-1fd6c92a-e571-4feb-a140-d9aa4d8ac4b9 req-51a1bd3d-8b48-41cb-9540-bb7786e7f82c service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] No waiting events found dispatching network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:10:48 user nova-compute[72809]: WARNING nova.compute.manager [req-1fd6c92a-e571-4feb-a140-d9aa4d8ac4b9 req-51a1bd3d-8b48-41cb-9540-bb7786e7f82c service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received unexpected event network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 for instance with vm_state active and task_state rescuing.
Aug 09 07:10:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/105db938e88836852bb67e943a14dce3d494b314.part /opt/stack/data/nova/instances/_base/105db938e88836852bb67e943a14dce3d494b314.converted" returned: 0 in 0.757s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/105db938e88836852bb67e943a14dce3d494b314.converted --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:49 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:10:49 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=7814MB free_disk=25.06203842163086GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/105db938e88836852bb67e943a14dce3d494b314.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "105db938e88836852bb67e943a14dce3d494b314" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.403s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "105db938e88836852bb67e943a14dce3d494b314" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "105db938e88836852bb67e943a14dce3d494b314" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/105db938e88836852bb67e943a14dce3d494b314 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 1bde423f-0b73-448f-bdce-8d6af96d8fc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance bebd5a14-6272-4de1-a1a1-4fb45b867c7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 339372ed-140d-4226-ba00-2cc682214d5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 466a8e58-5f88-4ffe-a7fd-a346003f3508 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 63936bb9-97de-4a87-aa29-14129104c1d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 6e9996e8-c5eb-42c1-b88f-d75654e160c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 01292d41-c87f-4ab0-8638-4aca44608f91 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance b527d58f-3171-4d22-980a-545824bf9523 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 48f0adeb-a5e8-4f81-a534-04c702c272a3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/105db938e88836852bb67e943a14dce3d494b314 --force-share --output=json" returned: 0 in 0.161s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/105db938e88836852bb67e943a14dce3d494b314,backing_fmt=raw /opt/stack/data/nova/instances/01292d41-c87f-4ab0-8638-4aca44608f91/disk.rescue {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/105db938e88836852bb67e943a14dce3d494b314,backing_fmt=raw /opt/stack/data/nova/instances/01292d41-c87f-4ab0-8638-4aca44608f91/disk.rescue" returned: 0 in 0.062s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "105db938e88836852bb67e943a14dce3d494b314" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.objects.instance [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lazy-loading 'migration_context' on Instance uuid 01292d41-c87f-4ab0-8638-4aca44608f91 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Start _get_guest_xml network_info=[{"id": "61cbb890-9a23-4b5a-903c-33d4a8c6e689", "address": "fa:16:3e:a4:4b:39", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "vif_mac": "fa:16:3e:a4:4b:39"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cbb890-9a", "ovs_interfaceid": "61cbb890-9a23-4b5a-903c-33d4a8c6e689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '89458c0d-b794-4cfc-b121-b96c8b729215', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EfZOVKhu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '01292d41-c87f-4ab0-8638-4aca44608f91', 'attached_at': '', 'detached_at': '', 'volume_id': '51cc261a-1c80-4a03-8957-14375673184b', 'serial': '51cc261a-1c80-4a03-8957-14375673184b'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': 0, 'attachment_id': '43376476-9631-4ba5-89a8-89367890d671', 'volume_type': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.objects.instance [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lazy-loading 'resources' on Instance uuid 01292d41-c87f-4ab0-8638-4aca44608f91 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.objects.instance [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lazy-loading 'numa_topology' on Instance uuid 01292d41-c87f-4ab0-8638-4aca44608f91 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:10:49 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:10:49 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.objects.instance [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lazy-loading 'vcpu_model' on Instance uuid 01292d41-c87f-4ab0-8638-4aca44608f91 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EfZOVKhu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:10:49 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:10:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:10:49 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:10:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:10:49 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b -p 172.16.0.220:3260" returned: 0 in 0.026s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ff3830-9eea-4b8c-9ba4-0f4743a140aa]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = EfZOVKhu\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 09 07:10:49 user nova-compute[72809]: node.name = iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b
Aug 09 07:10:49 user nova-compute[72809]: node.tpgt = -1
Aug 09 07:10:49 user nova-compute[72809]: node.startup = automatic
Aug 09 07:10:49 user nova-compute[72809]: node.leading_login = No
Aug 09 07:10:49 user nova-compute[72809]: iface.iscsi_ifacename = default
Aug 09 07:10:49 user nova-compute[72809]: iface.net_ifacename = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.ipaddress = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.prefix_len = 0
Aug 09 07:10:49 user nova-compute[72809]: iface.hwaddress = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.transport_name = tcp
Aug 09 07:10:49 user nova-compute[72809]: iface.initiatorname = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.state = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.vlan_id = 0
Aug 09 07:10:49 user nova-compute[72809]: iface.vlan_priority = 0
Aug 09 07:10:49 user nova-compute[72809]: iface.vlan_state = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.iface_num = 0
Aug 09 07:10:49 user nova-compute[72809]: iface.mtu = 0
Aug 09 07:10:49 user nova-compute[72809]: iface.port = 0
Aug 09 07:10:49 user nova-compute[72809]: iface.bootproto = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.subnet_mask = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.gateway = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.dhcp_alt_client_id_state = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.dhcp_alt_client_id = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.dhcp_dns = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.dhcp_learn_iqn = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.dhcp_req_vendor_id_state = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.dhcp_vendor_id_state = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.dhcp_vendor_id = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.dhcp_slp_da = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.fragmentation = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.gratuitous_arp = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.incoming_forwarding = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.tos_state = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.tos = 0
Aug 09 07:10:49 user nova-compute[72809]: iface.ttl = 0
Aug 09 07:10:49 user nova-compute[72809]: iface.delayed_ack = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.tcp_nagle = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.tcp_wsf_state = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.tcp_wsf = 0
Aug 09 07:10:49 user nova-compute[72809]: iface.tcp_timer_scale = 0
Aug 09 07:10:49 user nova-compute[72809]: iface.tcp_timestamp = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.redirect = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.def_task_mgmt_timeout = 0
Aug 09 07:10:49 user nova-compute[72809]: iface.header_digest = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.data_digest = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.immediate_data = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.initial_r2t = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.data_seq_inorder = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.data_pdu_inorder = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.erl = 0
Aug 09 07:10:49 user nova-compute[72809]: iface.max_receive_data_len = 0
Aug 09 07:10:49 user nova-compute[72809]: iface.first_burst_len = 0
Aug 09 07:10:49 user nova-compute[72809]: iface.max_outstanding_r2t = 0
Aug 09 07:10:49 user nova-compute[72809]: iface.max_burst_len = 0
Aug 09 07:10:49 user nova-compute[72809]: iface.chap_auth = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.bidi_chap = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.strict_login_compliance = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.discovery_auth = <empty>
Aug 09 07:10:49 user nova-compute[72809]: iface.discovery_logout = <empty>
Aug 09 07:10:49 user nova-compute[72809]: node.discovery_address = <empty>
Aug 09 07:10:49 user nova-compute[72809]: node.discovery_port = 0
Aug 09 07:10:49 user nova-compute[72809]: node.discovery_type = static
Aug 09 07:10:49 user nova-compute[72809]: node.session.initial_cmdsn = 0
Aug 09 07:10:49 user nova-compute[72809]: node.session.initial_login_retry_max = 8
Aug 09 07:10:49 user nova-compute[72809]: node.session.xmit_thread_priority = -20
Aug 09 07:10:49 user nova-compute[72809]: node.session.cmds_max = 128
Aug 09 07:10:49 user nova-compute[72809]: node.session.queue_depth = 32
Aug 09 07:10:49 user nova-compute[72809]: node.session.nr_sessions = 1
Aug 09 07:10:49 user nova-compute[72809]: node.session.auth.authmethod = CHAP
Aug 09 07:10:49 user nova-compute[72809]: node.session.auth.username = EfZOVKhu
Aug 09 07:10:49 user nova-compute[72809]: node.session.auth.password = ***
Aug 09 07:10:49 user nova-compute[72809]: node.session.auth.username_in = <empty>
Aug 09 07:10:49 user nova-compute[72809]: node.session.auth.password_in = <empty>
Aug 09 07:10:49 user nova-compute[72809]: node.session.auth.chap_algs = MD5
Aug 09 07:10:49 user nova-compute[72809]: node.session.timeo.replacement_timeout = 120
Aug 09 07:10:49 user nova-compute[72809]: node.session.err_timeo.abort_timeout = 15
Aug 09 07:10:49 user nova-compute[72809]: node.session.err_timeo.lu_reset_timeout = 30
Aug 09 07:10:49 user nova-compute[72809]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 09 07:10:49 user nova-compute[72809]: node.session.err_timeo.host_reset_timeout = 60
Aug 09 07:10:49 user nova-compute[72809]: node.session.iscsi.FastAbort = Yes
Aug 09 07:10:49 user nova-compute[72809]: node.session.iscsi.InitialR2T = No
Aug 09 07:10:49 user nova-compute[72809]: node.session.iscsi.ImmediateData = Yes
Aug 09 07:10:49 user nova-compute[72809]: node.session.iscsi.FirstBurstLength = 262144
Aug 09 07:10:49 user nova-compute[72809]: node.session.iscsi.MaxBurstLength = 16776192
Aug 09 07:10:49 user nova-compute[72809]: node.session.iscsi.DefaultTime2Retain = 0
Aug 09 07:10:49 user nova-compute[72809]: node.session.iscsi.DefaultTime2Wait = 2
Aug 09 07:10:49 user nova-compute[72809]: node.session.iscsi.MaxConnections = 1
Aug 09 07:10:49 user nova-compute[72809]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 09 07:10:49 user nova-compute[72809]: node.session.iscsi.ERL = 0
Aug 09 07:10:49 user nova-compute[72809]: node.session.scan = manual
Aug 09 07:10:49 user nova-compute[72809]: node.session.reopen_max = 0
Aug 09 07:10:49 user nova-compute[72809]: node.conn[0].address = 172.16.0.220
Aug 09 07:10:49 user nova-compute[72809]: node.conn[0].port = 3260
Aug 09 07:10:49 user nova-compute[72809]: node.conn[0].startup = manual
Aug 09 07:10:49 user nova-compute[72809]: node.conn[0].tcp.window_size = 524288
Aug 09 07:10:49 user nova-compute[72809]: node.conn[0].tcp.type_of_service = 0
Aug 09 07:10:49 user nova-compute[72809]: node.conn[0].timeo.logout_timeout = 15
Aug 09 07:10:49 user nova-compute[72809]: node.conn[0].timeo.login_timeout = 15
Aug 09 07:10:49 user nova-compute[72809]: node.conn[0].timeo.auth_timeout = 45
Aug 09 07:10:49 user nova-compute[72809]: node.conn[0].timeo.noop_out_interval = 5
Aug 09 07:10:49 user nova-compute[72809]: node.conn[0].timeo.noop_out_timeout = 5
Aug 09 07:10:49 user nova-compute[72809]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 09 07:10:49 user nova-compute[72809]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 09 07:10:49 user nova-compute[72809]: node.conn[0].iscsi.HeaderDigest = None
Aug 09 07:10:49 user nova-compute[72809]: node.conn[0].iscsi.DataDigest = None
Aug 09 07:10:49 user nova-compute[72809]: node.conn[0].iscsi.IFMarker = No
Aug 09 07:10:49 user nova-compute[72809]: node.conn[0].iscsi.OFMarker = No
Aug 09 07:10:49 user nova-compute[72809]: # END RECORD
Aug 09 07:10:49 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[254f7d83-20a7-4e0e-94d4-ae0c7b7ab8ae]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[786b4a9d-f5f2-4cac-bb3e-88d8ffd4300a]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EfZOVKhu {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.636s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EfZOVKhu" returned: 0 in 0.027s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[135befd5-da0d-400e-a47f-475ac63cd7e4]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EfZOVKhu'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d660bef7-f9ae-43f4-a001-c26c6db009e9]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8c870a-d9e5-4846-b0ad-30481e19de9b]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:10:49 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:10:49 user nova-compute[72809]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a (non-flash)
Aug 09 07:10:49 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:10:49 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:10:49 user nova-compute[72809]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a (non-flash)
Aug 09 07:10:49 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.199s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] HCTL ('34', '0', '0', 0) found on session 41 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[26497913-34b5-462b-aad9-6ba91cd9bdec]: (4, ('0 0 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Searching for a device in session 41 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EfZOVKhu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.226s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] <== connect_volume: return (228ms) {'type': 'block', 'scsi_wwn': '23431393938386365', 'path': '/dev/sdc'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431393938386365', 'path': '/dev/sdc'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:08:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-538618460',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-538618460',id=39,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:09:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1903437f7ed4c14a0660f64a2e0c647',ramdisk_id='',reservation_id='r-xczy0u8d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-917311946',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:09:25Z,user_data=None,user_id='6c4c5942852b412885a5b4698552058d',uuid=01292d41-c87f-4ab0-8638-4aca44608f91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61cbb890-9a23-4b5a-903c-33d4a8c6e689", "address": "fa:16:3e:a4:4b:39", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "vif_mac": "fa:16:3e:a4:4b:39"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cbb890-9a", "ovs_interfaceid": "61cbb890-9a23-4b5a-903c-33d4a8c6e689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Converting VIF {"id": "61cbb890-9a23-4b5a-903c-33d4a8c6e689", "address": "fa:16:3e:a4:4b:39", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "vif_mac": "fa:16:3e:a4:4b:39"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cbb890-9a", "ovs_interfaceid": "61cbb890-9a23-4b5a-903c-33d4a8c6e689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:4b:39,bridge_name='br-int',has_traffic_filtering=True,id=61cbb890-9a23-4b5a-903c-33d4a8c6e689,network=Network(5f03b0f9-e80d-428f-b0a6-57158568e620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61cbb890-9a') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:10:49 user nova-compute[72809]: DEBUG nova.objects.instance [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lazy-loading 'pci_devices' on Instance uuid 01292d41-c87f-4ab0-8638-4aca44608f91 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:10:50 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] End _get_guest_xml xml=<domain type="kvm">
Aug 09 07:10:50 user nova-compute[72809]:   <uuid>01292d41-c87f-4ab0-8638-4aca44608f91</uuid>
Aug 09 07:10:50 user nova-compute[72809]:   <name>instance-00000027</name>
Aug 09 07:10:50 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 07:10:50 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 07:10:50 user nova-compute[72809]:   <metadata>
Aug 09 07:10:50 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 07:10:50 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 07:10:50 user nova-compute[72809]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-538618460</nova:name>
Aug 09 07:10:50 user nova-compute[72809]:       <nova:creationTime>2023-08-09 07:10:49</nova:creationTime>
Aug 09 07:10:50 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 07:10:50 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 07:10:50 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 07:10:50 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 07:10:50 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 07:10:50 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 07:10:50 user nova-compute[72809]:       </nova:flavor>
Aug 09 07:10:50 user nova-compute[72809]:       <nova:owner>
Aug 09 07:10:50 user nova-compute[72809]:         <nova:user uuid="6c4c5942852b412885a5b4698552058d">tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member</nova:user>
Aug 09 07:10:50 user nova-compute[72809]:         <nova:project uuid="b1903437f7ed4c14a0660f64a2e0c647">tempest-ServerBootFromVolumeStableRescueTest-917311946</nova:project>
Aug 09 07:10:50 user nova-compute[72809]:       </nova:owner>
Aug 09 07:10:50 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 07:10:50 user nova-compute[72809]:       <nova:ports>
Aug 09 07:10:50 user nova-compute[72809]:         <nova:port uuid="61cbb890-9a23-4b5a-903c-33d4a8c6e689">
Aug 09 07:10:50 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 07:10:50 user nova-compute[72809]:         </nova:port>
Aug 09 07:10:50 user nova-compute[72809]:       </nova:ports>
Aug 09 07:10:50 user nova-compute[72809]:     </nova:instance>
Aug 09 07:10:50 user nova-compute[72809]:   </metadata>
Aug 09 07:10:50 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 07:10:50 user nova-compute[72809]:     <system>
Aug 09 07:10:50 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 07:10:50 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 07:10:50 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 07:10:50 user nova-compute[72809]:       <entry name="serial">01292d41-c87f-4ab0-8638-4aca44608f91</entry>
Aug 09 07:10:50 user nova-compute[72809]:       <entry name="uuid">01292d41-c87f-4ab0-8638-4aca44608f91</entry>
Aug 09 07:10:50 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 07:10:50 user nova-compute[72809]:     </system>
Aug 09 07:10:50 user nova-compute[72809]:   </sysinfo>
Aug 09 07:10:50 user nova-compute[72809]:   <os>
Aug 09 07:10:50 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 07:10:50 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 07:10:50 user nova-compute[72809]:   </os>
Aug 09 07:10:50 user nova-compute[72809]:   <features>
Aug 09 07:10:50 user nova-compute[72809]:     <acpi/>
Aug 09 07:10:50 user nova-compute[72809]:     <apic/>
Aug 09 07:10:50 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 07:10:50 user nova-compute[72809]:   </features>
Aug 09 07:10:50 user nova-compute[72809]:   <clock offset="utc">
Aug 09 07:10:50 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 07:10:50 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 07:10:50 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 07:10:50 user nova-compute[72809]:   </clock>
Aug 09 07:10:50 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 07:10:50 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 07:10:50 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 07:10:50 user nova-compute[72809]:   </cpu>
Aug 09 07:10:50 user nova-compute[72809]:   <devices>
Aug 09 07:10:50 user nova-compute[72809]:     <disk type="block" device="disk">
Aug 09 07:10:50 user nova-compute[72809]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:10:50 user nova-compute[72809]:       <source dev="/dev/sdc"/>
Aug 09 07:10:50 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 07:10:50 user nova-compute[72809]:       <serial>51cc261a-1c80-4a03-8957-14375673184b</serial>
Aug 09 07:10:50 user nova-compute[72809]:     </disk>
Aug 09 07:10:50 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 07:10:50 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 07:10:50 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/01292d41-c87f-4ab0-8638-4aca44608f91/disk.rescue"/>
Aug 09 07:10:50 user nova-compute[72809]:       <target dev="vdb" bus="virtio"/>
Aug 09 07:10:50 user nova-compute[72809]:       <boot order="1"/>
Aug 09 07:10:50 user nova-compute[72809]:     </disk>
Aug 09 07:10:50 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 07:10:50 user nova-compute[72809]:       <mac address="fa:16:3e:a4:4b:39"/>
Aug 09 07:10:50 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:10:50 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 07:10:50 user nova-compute[72809]:       <target dev="tap61cbb890-9a"/>
Aug 09 07:10:50 user nova-compute[72809]:     </interface>
Aug 09 07:10:50 user nova-compute[72809]:     <serial type="pty">
Aug 09 07:10:50 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/01292d41-c87f-4ab0-8638-4aca44608f91/console.log" append="off"/>
Aug 09 07:10:50 user nova-compute[72809]:     </serial>
Aug 09 07:10:50 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 07:10:50 user nova-compute[72809]:     <video>
Aug 09 07:10:50 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:10:50 user nova-compute[72809]:     </video>
Aug 09 07:10:50 user nova-compute[72809]:     <rng model="virtio">
Aug 09 07:10:50 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 07:10:50 user nova-compute[72809]:     </rng>
Aug 09 07:10:50 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 07:10:50 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 07:10:50 user nova-compute[72809]:       <stats period="10"/>
Aug 09 07:10:50 user nova-compute[72809]:     </memballoon>
Aug 09 07:10:50 user nova-compute[72809]:   </devices>
Aug 09 07:10:50 user nova-compute[72809]: </domain>
Aug 09 07:10:50 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 07:10:50 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Instance destroyed successfully.
Aug 09 07:10:50 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:10:50 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:10:50 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] No VIF found with MAC fa:16:3e:a4:4b:39, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:10:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:51 user nova-compute[72809]: DEBUG nova.compute.manager [req-a72ff442-cf72-4207-a531-b2ff6907a08a req-3ff49d48-46e7-4190-9abf-f05284a8021c service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received event network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:10:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a72ff442-cf72-4207-a531-b2ff6907a08a req-3ff49d48-46e7-4190-9abf-f05284a8021c service nova] Acquiring lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:10:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a72ff442-cf72-4207-a531-b2ff6907a08a req-3ff49d48-46e7-4190-9abf-f05284a8021c service nova] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:10:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a72ff442-cf72-4207-a531-b2ff6907a08a req-3ff49d48-46e7-4190-9abf-f05284a8021c service nova] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:10:51 user nova-compute[72809]: DEBUG nova.compute.manager [req-a72ff442-cf72-4207-a531-b2ff6907a08a req-3ff49d48-46e7-4190-9abf-f05284a8021c service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] No waiting events found dispatching network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:10:51 user nova-compute[72809]: WARNING nova.compute.manager [req-a72ff442-cf72-4207-a531-b2ff6907a08a req-3ff49d48-46e7-4190-9abf-f05284a8021c service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received unexpected event network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 for instance with vm_state active and task_state rescuing.
Aug 09 07:10:52 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:10:52 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:10:52 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:10:52 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:10:52 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:10:52 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 07:10:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:53 user nova-compute[72809]: DEBUG nova.compute.manager [req-c8a45dd1-8316-40a5-b215-459af848186e req-ac495ea8-927e-4bca-8837-5f0ba935c89a service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received event network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:10:53 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c8a45dd1-8316-40a5-b215-459af848186e req-ac495ea8-927e-4bca-8837-5f0ba935c89a service nova] Acquiring lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:10:53 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c8a45dd1-8316-40a5-b215-459af848186e req-ac495ea8-927e-4bca-8837-5f0ba935c89a service nova] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:10:53 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c8a45dd1-8316-40a5-b215-459af848186e req-ac495ea8-927e-4bca-8837-5f0ba935c89a service nova] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:10:53 user nova-compute[72809]: DEBUG nova.compute.manager [req-c8a45dd1-8316-40a5-b215-459af848186e req-ac495ea8-927e-4bca-8837-5f0ba935c89a service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] No waiting events found dispatching network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:10:53 user nova-compute[72809]: WARNING nova.compute.manager [req-c8a45dd1-8316-40a5-b215-459af848186e req-ac495ea8-927e-4bca-8837-5f0ba935c89a service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received unexpected event network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 for instance with vm_state active and task_state rescuing.
Aug 09 07:10:53 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Removed pending event for 01292d41-c87f-4ab0-8638-4aca44608f91 due to event {{(pid=72809) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 07:10:53 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691565053.9169528, 01292d41-c87f-4ab0-8638-4aca44608f91 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:10:53 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] VM Resumed (Lifecycle Event)
Aug 09 07:10:53 user nova-compute[72809]: DEBUG nova.compute.manager [None req-d1b7ca0f-dc23-47d2-a4c5-86cd7190d842 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:10:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:53 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:10:53 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:10:53 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 07:10:53 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691565053.9172199, 01292d41-c87f-4ab0-8638-4aca44608f91 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:10:53 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] VM Started (Lifecycle Event)
Aug 09 07:10:53 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:10:54 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:10:54 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:10:55 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:10:56 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:10:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2ec49cef-8a65-4eb4-bf47-4767714e1204 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Acquiring lock "b527d58f-3171-4d22-980a-545824bf9523" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:11:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2ec49cef-8a65-4eb4-bf47-4767714e1204 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Lock "b527d58f-3171-4d22-980a-545824bf9523" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:11:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2ec49cef-8a65-4eb4-bf47-4767714e1204 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Acquiring lock "b527d58f-3171-4d22-980a-545824bf9523-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:11:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2ec49cef-8a65-4eb4-bf47-4767714e1204 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Lock "b527d58f-3171-4d22-980a-545824bf9523-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:11:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2ec49cef-8a65-4eb4-bf47-4767714e1204 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Lock "b527d58f-3171-4d22-980a-545824bf9523-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:11:06 user nova-compute[72809]: INFO nova.compute.manager [None req-2ec49cef-8a65-4eb4-bf47-4767714e1204 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Terminating instance
Aug 09 07:11:06 user nova-compute[72809]: DEBUG nova.compute.manager [None req-2ec49cef-8a65-4eb4-bf47-4767714e1204 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:11:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:07 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: b527d58f-3171-4d22-980a-545824bf9523] Instance destroyed successfully.
Aug 09 07:11:07 user nova-compute[72809]: DEBUG nova.objects.instance [None req-2ec49cef-8a65-4eb4-bf47-4767714e1204 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Lazy-loading 'resources' on Instance uuid b527d58f-3171-4d22-980a-545824bf9523 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:11:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-2ec49cef-8a65-4eb4-bf47-4767714e1204 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:09:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1267805680',display_name='tempest-VolumesActionsTest-instance-1267805680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1267805680',id=40,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:09:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b8bf162c4714e328a7c3a28f173b665',ramdisk_id='',reservation_id='r-kdu7oufb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-289766275',owner_user_name='tempest-VolumesActionsTest-289766275-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:09:13Z,user_data=None,user_id='eb9efc3d272d42b78637687f7ba0b049',uuid=b527d58f-3171-4d22-980a-545824bf9523,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1045e820-7f44-40cf-aff9-7e0370014a21", "address": "fa:16:3e:3d:5b:8f", "network": {"id": "c573f3b4-05de-465c-b5b2-7e842a7ca92d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-427174675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b8bf162c4714e328a7c3a28f173b665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1045e820-7f", "ovs_interfaceid": "1045e820-7f44-40cf-aff9-7e0370014a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:11:07 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-2ec49cef-8a65-4eb4-bf47-4767714e1204 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Converting VIF {"id": "1045e820-7f44-40cf-aff9-7e0370014a21", "address": "fa:16:3e:3d:5b:8f", "network": {"id": "c573f3b4-05de-465c-b5b2-7e842a7ca92d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-427174675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b8bf162c4714e328a7c3a28f173b665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1045e820-7f", "ovs_interfaceid": "1045e820-7f44-40cf-aff9-7e0370014a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:11:07 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-2ec49cef-8a65-4eb4-bf47-4767714e1204 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:5b:8f,bridge_name='br-int',has_traffic_filtering=True,id=1045e820-7f44-40cf-aff9-7e0370014a21,network=Network(c573f3b4-05de-465c-b5b2-7e842a7ca92d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1045e820-7f') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:11:07 user nova-compute[72809]: DEBUG os_vif [None req-2ec49cef-8a65-4eb4-bf47-4767714e1204 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:5b:8f,bridge_name='br-int',has_traffic_filtering=True,id=1045e820-7f44-40cf-aff9-7e0370014a21,network=Network(c573f3b4-05de-465c-b5b2-7e842a7ca92d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1045e820-7f') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:11:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1045e820-7f, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:11:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:11:07 user nova-compute[72809]: INFO os_vif [None req-2ec49cef-8a65-4eb4-bf47-4767714e1204 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:5b:8f,bridge_name='br-int',has_traffic_filtering=True,id=1045e820-7f44-40cf-aff9-7e0370014a21,network=Network(c573f3b4-05de-465c-b5b2-7e842a7ca92d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1045e820-7f')
Aug 09 07:11:07 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-2ec49cef-8a65-4eb4-bf47-4767714e1204 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Deleting instance files /opt/stack/data/nova/instances/b527d58f-3171-4d22-980a-545824bf9523_del
Aug 09 07:11:07 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-2ec49cef-8a65-4eb4-bf47-4767714e1204 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Deletion of /opt/stack/data/nova/instances/b527d58f-3171-4d22-980a-545824bf9523_del complete
Aug 09 07:11:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-0d11505e-4427-40e8-9168-b7107de48019 req-319438ee-eefb-4660-95ce-de80b1e37946 service nova] [instance: b527d58f-3171-4d22-980a-545824bf9523] Received event network-vif-unplugged-1045e820-7f44-40cf-aff9-7e0370014a21 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:11:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0d11505e-4427-40e8-9168-b7107de48019 req-319438ee-eefb-4660-95ce-de80b1e37946 service nova] Acquiring lock "b527d58f-3171-4d22-980a-545824bf9523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:11:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0d11505e-4427-40e8-9168-b7107de48019 req-319438ee-eefb-4660-95ce-de80b1e37946 service nova] Lock "b527d58f-3171-4d22-980a-545824bf9523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:11:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0d11505e-4427-40e8-9168-b7107de48019 req-319438ee-eefb-4660-95ce-de80b1e37946 service nova] Lock "b527d58f-3171-4d22-980a-545824bf9523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:11:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-0d11505e-4427-40e8-9168-b7107de48019 req-319438ee-eefb-4660-95ce-de80b1e37946 service nova] [instance: b527d58f-3171-4d22-980a-545824bf9523] No waiting events found dispatching network-vif-unplugged-1045e820-7f44-40cf-aff9-7e0370014a21 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:11:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-0d11505e-4427-40e8-9168-b7107de48019 req-319438ee-eefb-4660-95ce-de80b1e37946 service nova] [instance: b527d58f-3171-4d22-980a-545824bf9523] Received event network-vif-unplugged-1045e820-7f44-40cf-aff9-7e0370014a21 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:11:07 user nova-compute[72809]: INFO nova.compute.manager [None req-2ec49cef-8a65-4eb4-bf47-4767714e1204 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] [instance: b527d58f-3171-4d22-980a-545824bf9523] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 09 07:11:07 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-2ec49cef-8a65-4eb4-bf47-4767714e1204 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:11:07 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: b527d58f-3171-4d22-980a-545824bf9523] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:11:07 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: b527d58f-3171-4d22-980a-545824bf9523] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:11:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:09 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: b527d58f-3171-4d22-980a-545824bf9523] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:11:09 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: b527d58f-3171-4d22-980a-545824bf9523] Took 1.61 seconds to deallocate network for instance.
Aug 09 07:11:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2ec49cef-8a65-4eb4-bf47-4767714e1204 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:11:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2ec49cef-8a65-4eb4-bf47-4767714e1204 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:11:09 user nova-compute[72809]: DEBUG nova.compute.manager [req-df5d8e19-653c-419d-b4fa-b5652deacc7d req-11452c14-aeda-44b3-8f0c-6302d1e11f92 service nova] [instance: b527d58f-3171-4d22-980a-545824bf9523] Received event network-vif-plugged-1045e820-7f44-40cf-aff9-7e0370014a21 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:11:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-df5d8e19-653c-419d-b4fa-b5652deacc7d req-11452c14-aeda-44b3-8f0c-6302d1e11f92 service nova] Acquiring lock "b527d58f-3171-4d22-980a-545824bf9523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:11:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-df5d8e19-653c-419d-b4fa-b5652deacc7d req-11452c14-aeda-44b3-8f0c-6302d1e11f92 service nova] Lock "b527d58f-3171-4d22-980a-545824bf9523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:11:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-df5d8e19-653c-419d-b4fa-b5652deacc7d req-11452c14-aeda-44b3-8f0c-6302d1e11f92 service nova] Lock "b527d58f-3171-4d22-980a-545824bf9523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:11:09 user nova-compute[72809]: DEBUG nova.compute.manager [req-df5d8e19-653c-419d-b4fa-b5652deacc7d req-11452c14-aeda-44b3-8f0c-6302d1e11f92 service nova] [instance: b527d58f-3171-4d22-980a-545824bf9523] No waiting events found dispatching network-vif-plugged-1045e820-7f44-40cf-aff9-7e0370014a21 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:11:09 user nova-compute[72809]: WARNING nova.compute.manager [req-df5d8e19-653c-419d-b4fa-b5652deacc7d req-11452c14-aeda-44b3-8f0c-6302d1e11f92 service nova] [instance: b527d58f-3171-4d22-980a-545824bf9523] Received unexpected event network-vif-plugged-1045e820-7f44-40cf-aff9-7e0370014a21 for instance with vm_state deleted and task_state None.
Aug 09 07:11:09 user nova-compute[72809]: DEBUG nova.compute.manager [req-df5d8e19-653c-419d-b4fa-b5652deacc7d req-11452c14-aeda-44b3-8f0c-6302d1e11f92 service nova] [instance: b527d58f-3171-4d22-980a-545824bf9523] Received event network-vif-deleted-1045e820-7f44-40cf-aff9-7e0370014a21 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:11:09 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-2ec49cef-8a65-4eb4-bf47-4767714e1204 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:11:09 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-2ec49cef-8a65-4eb4-bf47-4767714e1204 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:11:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2ec49cef-8a65-4eb4-bf47-4767714e1204 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:11:10 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-2ec49cef-8a65-4eb4-bf47-4767714e1204 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Deleted allocations for instance b527d58f-3171-4d22-980a-545824bf9523
Aug 09 07:11:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-2ec49cef-8a65-4eb4-bf47-4767714e1204 tempest-VolumesActionsTest-289766275 tempest-VolumesActionsTest-289766275-project-member] Lock "b527d58f-3171-4d22-980a-545824bf9523" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.215s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:11:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Acquiring lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:11:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:11:20 user nova-compute[72809]: DEBUG nova.compute.manager [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 07:11:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:11:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:11:20 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 07:11:20 user nova-compute[72809]: INFO nova.compute.claims [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Claim successful on node user
Aug 09 07:11:20 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:11:20 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:11:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:11:20 user nova-compute[72809]: DEBUG nova.compute.manager [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 07:11:20 user nova-compute[72809]: DEBUG nova.compute.manager [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 07:11:20 user nova-compute[72809]: DEBUG nova.network.neutron [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 07:11:20 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 07:11:20 user nova-compute[72809]: DEBUG nova.compute.manager [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 07:11:21 user nova-compute[72809]: DEBUG nova.policy [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00d76eca58cf4ada8c8d9843110db8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a9a141f54c4a9da74993125c9c137b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 07:11:21 user nova-compute[72809]: DEBUG nova.compute.manager [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 07:11:21 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 07:11:21 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Creating image(s)
Aug 09 07:11:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Acquiring lock "/opt/stack/data/nova/instances/d29dd60c-2a98-4d47-b11c-67e88bb17dc3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:11:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "/opt/stack/data/nova/instances/d29dd60c-2a98-4d47-b11c-67e88bb17dc3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:11:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "/opt/stack/data/nova/instances/d29dd60c-2a98-4d47-b11c-67e88bb17dc3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:11:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:11:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.144s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:11:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:11:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:11:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:11:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.136s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:11:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/d29dd60c-2a98-4d47-b11c-67e88bb17dc3/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:11:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/d29dd60c-2a98-4d47-b11c-67e88bb17dc3/disk 1073741824" returned: 0 in 0.058s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:11:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:11:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:11:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.153s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:11:21 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d29dd60c-2a98-4d47-b11c-67e88bb17dc3/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 07:11:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d29dd60c-2a98-4d47-b11c-67e88bb17dc3/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:11:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d29dd60c-2a98-4d47-b11c-67e88bb17dc3/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:11:21 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Cannot resize image /opt/stack/data/nova/instances/d29dd60c-2a98-4d47-b11c-67e88bb17dc3/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 07:11:21 user nova-compute[72809]: DEBUG nova.objects.instance [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lazy-loading 'migration_context' on Instance uuid d29dd60c-2a98-4d47-b11c-67e88bb17dc3 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:11:21 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 07:11:21 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Ensure instance console log exists: /opt/stack/data/nova/instances/d29dd60c-2a98-4d47-b11c-67e88bb17dc3/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 07:11:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:11:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:11:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:11:21 user nova-compute[72809]: DEBUG nova.network.neutron [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Successfully created port: bb24be9c-c2ff-42e7-84ba-2f76b9400db2 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 07:11:22 user nova-compute[72809]: DEBUG nova.network.neutron [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Successfully updated port: bb24be9c-c2ff-42e7-84ba-2f76b9400db2 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 07:11:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Acquiring lock "refresh_cache-d29dd60c-2a98-4d47-b11c-67e88bb17dc3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:11:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Acquired lock "refresh_cache-d29dd60c-2a98-4d47-b11c-67e88bb17dc3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:11:22 user nova-compute[72809]: DEBUG nova.network.neutron [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:11:22 user nova-compute[72809]: DEBUG nova.compute.manager [req-e13ab4ed-496f-4db3-892f-3b9eba7141a5 req-bd6d8163-8e6e-4e7d-9cc1-ce0aff2943c9 service nova] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Received event network-changed-bb24be9c-c2ff-42e7-84ba-2f76b9400db2 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:11:22 user nova-compute[72809]: DEBUG nova.compute.manager [req-e13ab4ed-496f-4db3-892f-3b9eba7141a5 req-bd6d8163-8e6e-4e7d-9cc1-ce0aff2943c9 service nova] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Refreshing instance network info cache due to event network-changed-bb24be9c-c2ff-42e7-84ba-2f76b9400db2. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:11:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e13ab4ed-496f-4db3-892f-3b9eba7141a5 req-bd6d8163-8e6e-4e7d-9cc1-ce0aff2943c9 service nova] Acquiring lock "refresh_cache-d29dd60c-2a98-4d47-b11c-67e88bb17dc3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:11:22 user nova-compute[72809]: DEBUG nova.network.neutron [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 07:11:22 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691565067.742267, b527d58f-3171-4d22-980a-545824bf9523 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:11:22 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: b527d58f-3171-4d22-980a-545824bf9523] VM Stopped (Lifecycle Event)
Aug 09 07:11:22 user nova-compute[72809]: DEBUG nova.compute.manager [None req-8d116aa2-af75-4e0d-a929-d01bcf6343f0 None None] [instance: b527d58f-3171-4d22-980a-545824bf9523] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:11:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:22 user nova-compute[72809]: DEBUG nova.network.neutron [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Updating instance_info_cache with network_info: [{"id": "bb24be9c-c2ff-42e7-84ba-2f76b9400db2", "address": "fa:16:3e:e8:4d:13", "network": {"id": "828c1b8f-947e-450a-b97f-d5b149941ccf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-718683445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9a141f54c4a9da74993125c9c137b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb24be9c-c2", "ovs_interfaceid": "bb24be9c-c2ff-42e7-84ba-2f76b9400db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:11:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Releasing lock "refresh_cache-d29dd60c-2a98-4d47-b11c-67e88bb17dc3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:11:22 user nova-compute[72809]: DEBUG nova.compute.manager [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Instance network_info: |[{"id": "bb24be9c-c2ff-42e7-84ba-2f76b9400db2", "address": "fa:16:3e:e8:4d:13", "network": {"id": "828c1b8f-947e-450a-b97f-d5b149941ccf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-718683445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9a141f54c4a9da74993125c9c137b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb24be9c-c2", "ovs_interfaceid": "bb24be9c-c2ff-42e7-84ba-2f76b9400db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 07:11:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e13ab4ed-496f-4db3-892f-3b9eba7141a5 req-bd6d8163-8e6e-4e7d-9cc1-ce0aff2943c9 service nova] Acquired lock "refresh_cache-d29dd60c-2a98-4d47-b11c-67e88bb17dc3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:11:22 user nova-compute[72809]: DEBUG nova.network.neutron [req-e13ab4ed-496f-4db3-892f-3b9eba7141a5 req-bd6d8163-8e6e-4e7d-9cc1-ce0aff2943c9 service nova] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Refreshing network info cache for port bb24be9c-c2ff-42e7-84ba-2f76b9400db2 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:11:22 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Start _get_guest_xml network_info=[{"id": "bb24be9c-c2ff-42e7-84ba-2f76b9400db2", "address": "fa:16:3e:e8:4d:13", "network": {"id": "828c1b8f-947e-450a-b97f-d5b149941ccf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-718683445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9a141f54c4a9da74993125c9c137b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb24be9c-c2", "ovs_interfaceid": "bb24be9c-c2ff-42e7-84ba-2f76b9400db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 07:11:23 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:11:23 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:11:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:11:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-300120339',display_name='tempest-TestServerVolumeAttachmentScenario-server-300120339',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-300120339',id=41,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDO5zCMnu9F3in7/6k3DMBofuZf8GGZoxh92ERiSsEhc3YVzSF2IlXp3KzAguGW7YqPTbiIAxY60KFKK+TqMF01ko/2kWkkVaOOgUMcH6g2nrOeAxRl+TL4f+qm8SMqGQ==',key_name='tempest-keypair-1499573665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25a9a141f54c4a9da74993125c9c137b',ramdisk_id='',reservation_id='r-16evibcs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1603584851',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1603584851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:11:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00d76eca58cf4ada8c8d9843110db8b5',uuid=d29dd60c-2a98-4d47-b11c-67e88bb17dc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb24be9c-c2ff-42e7-84ba-2f76b9400db2", "address": "fa:16:3e:e8:4d:13", "network": {"id": "828c1b8f-947e-450a-b97f-d5b149941ccf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-718683445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9a141f54c4a9da74993125c9c137b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb24be9c-c2", "ovs_interfaceid": "bb24be9c-c2ff-42e7-84ba-2f76b9400db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Converting VIF {"id": "bb24be9c-c2ff-42e7-84ba-2f76b9400db2", "address": "fa:16:3e:e8:4d:13", "network": {"id": "828c1b8f-947e-450a-b97f-d5b149941ccf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-718683445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9a141f54c4a9da74993125c9c137b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb24be9c-c2", "ovs_interfaceid": "bb24be9c-c2ff-42e7-84ba-2f76b9400db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:4d:13,bridge_name='br-int',has_traffic_filtering=True,id=bb24be9c-c2ff-42e7-84ba-2f76b9400db2,network=Network(828c1b8f-947e-450a-b97f-d5b149941ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb24be9c-c2') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG nova.objects.instance [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lazy-loading 'pci_devices' on Instance uuid d29dd60c-2a98-4d47-b11c-67e88bb17dc3 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] End _get_guest_xml xml=<domain type="kvm">
Aug 09 07:11:23 user nova-compute[72809]:   <uuid>d29dd60c-2a98-4d47-b11c-67e88bb17dc3</uuid>
Aug 09 07:11:23 user nova-compute[72809]:   <name>instance-00000029</name>
Aug 09 07:11:23 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 07:11:23 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 07:11:23 user nova-compute[72809]:   <metadata>
Aug 09 07:11:23 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 07:11:23 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 07:11:23 user nova-compute[72809]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-300120339</nova:name>
Aug 09 07:11:23 user nova-compute[72809]:       <nova:creationTime>2023-08-09 07:11:23</nova:creationTime>
Aug 09 07:11:23 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 07:11:23 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 07:11:23 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 07:11:23 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 07:11:23 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 07:11:23 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 07:11:23 user nova-compute[72809]:       </nova:flavor>
Aug 09 07:11:23 user nova-compute[72809]:       <nova:owner>
Aug 09 07:11:23 user nova-compute[72809]:         <nova:user uuid="00d76eca58cf4ada8c8d9843110db8b5">tempest-TestServerVolumeAttachmentScenario-1603584851-project-member</nova:user>
Aug 09 07:11:23 user nova-compute[72809]:         <nova:project uuid="25a9a141f54c4a9da74993125c9c137b">tempest-TestServerVolumeAttachmentScenario-1603584851</nova:project>
Aug 09 07:11:23 user nova-compute[72809]:       </nova:owner>
Aug 09 07:11:23 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 07:11:23 user nova-compute[72809]:       <nova:ports>
Aug 09 07:11:23 user nova-compute[72809]:         <nova:port uuid="bb24be9c-c2ff-42e7-84ba-2f76b9400db2">
Aug 09 07:11:23 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 07:11:23 user nova-compute[72809]:         </nova:port>
Aug 09 07:11:23 user nova-compute[72809]:       </nova:ports>
Aug 09 07:11:23 user nova-compute[72809]:     </nova:instance>
Aug 09 07:11:23 user nova-compute[72809]:   </metadata>
Aug 09 07:11:23 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 07:11:23 user nova-compute[72809]:     <system>
Aug 09 07:11:23 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 07:11:23 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 07:11:23 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 07:11:23 user nova-compute[72809]:       <entry name="serial">d29dd60c-2a98-4d47-b11c-67e88bb17dc3</entry>
Aug 09 07:11:23 user nova-compute[72809]:       <entry name="uuid">d29dd60c-2a98-4d47-b11c-67e88bb17dc3</entry>
Aug 09 07:11:23 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 07:11:23 user nova-compute[72809]:     </system>
Aug 09 07:11:23 user nova-compute[72809]:   </sysinfo>
Aug 09 07:11:23 user nova-compute[72809]:   <os>
Aug 09 07:11:23 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 07:11:23 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 07:11:23 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 07:11:23 user nova-compute[72809]:   </os>
Aug 09 07:11:23 user nova-compute[72809]:   <features>
Aug 09 07:11:23 user nova-compute[72809]:     <acpi/>
Aug 09 07:11:23 user nova-compute[72809]:     <apic/>
Aug 09 07:11:23 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 07:11:23 user nova-compute[72809]:   </features>
Aug 09 07:11:23 user nova-compute[72809]:   <clock offset="utc">
Aug 09 07:11:23 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 07:11:23 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 07:11:23 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 07:11:23 user nova-compute[72809]:   </clock>
Aug 09 07:11:23 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 07:11:23 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 07:11:23 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 07:11:23 user nova-compute[72809]:   </cpu>
Aug 09 07:11:23 user nova-compute[72809]:   <devices>
Aug 09 07:11:23 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 07:11:23 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 07:11:23 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/d29dd60c-2a98-4d47-b11c-67e88bb17dc3/disk"/>
Aug 09 07:11:23 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 07:11:23 user nova-compute[72809]:     </disk>
Aug 09 07:11:23 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 07:11:23 user nova-compute[72809]:       <mac address="fa:16:3e:e8:4d:13"/>
Aug 09 07:11:23 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:11:23 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 07:11:23 user nova-compute[72809]:       <target dev="tapbb24be9c-c2"/>
Aug 09 07:11:23 user nova-compute[72809]:     </interface>
Aug 09 07:11:23 user nova-compute[72809]:     <serial type="pty">
Aug 09 07:11:23 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/d29dd60c-2a98-4d47-b11c-67e88bb17dc3/console.log" append="off"/>
Aug 09 07:11:23 user nova-compute[72809]:     </serial>
Aug 09 07:11:23 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 07:11:23 user nova-compute[72809]:     <video>
Aug 09 07:11:23 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:11:23 user nova-compute[72809]:     </video>
Aug 09 07:11:23 user nova-compute[72809]:     <rng model="virtio">
Aug 09 07:11:23 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 07:11:23 user nova-compute[72809]:     </rng>
Aug 09 07:11:23 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 07:11:23 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 07:11:23 user nova-compute[72809]:       <stats period="10"/>
Aug 09 07:11:23 user nova-compute[72809]:     </memballoon>
Aug 09 07:11:23 user nova-compute[72809]:   </devices>
Aug 09 07:11:23 user nova-compute[72809]: </domain>
Aug 09 07:11:23 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:11:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-300120339',display_name='tempest-TestServerVolumeAttachmentScenario-server-300120339',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-300120339',id=41,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDO5zCMnu9F3in7/6k3DMBofuZf8GGZoxh92ERiSsEhc3YVzSF2IlXp3KzAguGW7YqPTbiIAxY60KFKK+TqMF01ko/2kWkkVaOOgUMcH6g2nrOeAxRl+TL4f+qm8SMqGQ==',key_name='tempest-keypair-1499573665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25a9a141f54c4a9da74993125c9c137b',ramdisk_id='',reservation_id='r-16evibcs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1603584851',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1603584851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:11:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00d76eca58cf4ada8c8d9843110db8b5',uuid=d29dd60c-2a98-4d47-b11c-67e88bb17dc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb24be9c-c2ff-42e7-84ba-2f76b9400db2", "address": "fa:16:3e:e8:4d:13", "network": {"id": "828c1b8f-947e-450a-b97f-d5b149941ccf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-718683445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9a141f54c4a9da74993125c9c137b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb24be9c-c2", "ovs_interfaceid": "bb24be9c-c2ff-42e7-84ba-2f76b9400db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Converting VIF {"id": "bb24be9c-c2ff-42e7-84ba-2f76b9400db2", "address": "fa:16:3e:e8:4d:13", "network": {"id": "828c1b8f-947e-450a-b97f-d5b149941ccf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-718683445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9a141f54c4a9da74993125c9c137b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb24be9c-c2", "ovs_interfaceid": "bb24be9c-c2ff-42e7-84ba-2f76b9400db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:4d:13,bridge_name='br-int',has_traffic_filtering=True,id=bb24be9c-c2ff-42e7-84ba-2f76b9400db2,network=Network(828c1b8f-947e-450a-b97f-d5b149941ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb24be9c-c2') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG os_vif [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:4d:13,bridge_name='br-int',has_traffic_filtering=True,id=bb24be9c-c2ff-42e7-84ba-2f76b9400db2,network=Network(828c1b8f-947e-450a-b97f-d5b149941ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb24be9c-c2') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb24be9c-c2, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbb24be9c-c2, col_values=(('external_ids', {'iface-id': 'bb24be9c-c2ff-42e7-84ba-2f76b9400db2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:4d:13', 'vm-uuid': 'd29dd60c-2a98-4d47-b11c-67e88bb17dc3'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:23 user nova-compute[72809]: INFO os_vif [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:4d:13,bridge_name='br-int',has_traffic_filtering=True,id=bb24be9c-c2ff-42e7-84ba-2f76b9400db2,network=Network(828c1b8f-947e-450a-b97f-d5b149941ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb24be9c-c2')
Aug 09 07:11:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] No VIF found with MAC fa:16:3e:e8:4d:13, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG nova.network.neutron [req-e13ab4ed-496f-4db3-892f-3b9eba7141a5 req-bd6d8163-8e6e-4e7d-9cc1-ce0aff2943c9 service nova] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Updated VIF entry in instance network info cache for port bb24be9c-c2ff-42e7-84ba-2f76b9400db2. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG nova.network.neutron [req-e13ab4ed-496f-4db3-892f-3b9eba7141a5 req-bd6d8163-8e6e-4e7d-9cc1-ce0aff2943c9 service nova] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Updating instance_info_cache with network_info: [{"id": "bb24be9c-c2ff-42e7-84ba-2f76b9400db2", "address": "fa:16:3e:e8:4d:13", "network": {"id": "828c1b8f-947e-450a-b97f-d5b149941ccf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-718683445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9a141f54c4a9da74993125c9c137b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb24be9c-c2", "ovs_interfaceid": "bb24be9c-c2ff-42e7-84ba-2f76b9400db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e13ab4ed-496f-4db3-892f-3b9eba7141a5 req-bd6d8163-8e6e-4e7d-9cc1-ce0aff2943c9 service nova] Releasing lock "refresh_cache-d29dd60c-2a98-4d47-b11c-67e88bb17dc3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:11:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:24 user nova-compute[72809]: DEBUG nova.compute.manager [req-8397e685-13cd-4c26-9441-67193b209adf req-a907949a-8388-4e59-8542-88e7647307d1 service nova] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Received event network-vif-plugged-bb24be9c-c2ff-42e7-84ba-2f76b9400db2 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:11:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-8397e685-13cd-4c26-9441-67193b209adf req-a907949a-8388-4e59-8542-88e7647307d1 service nova] Acquiring lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:11:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-8397e685-13cd-4c26-9441-67193b209adf req-a907949a-8388-4e59-8542-88e7647307d1 service nova] Lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:11:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-8397e685-13cd-4c26-9441-67193b209adf req-a907949a-8388-4e59-8542-88e7647307d1 service nova] Lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:11:24 user nova-compute[72809]: DEBUG nova.compute.manager [req-8397e685-13cd-4c26-9441-67193b209adf req-a907949a-8388-4e59-8542-88e7647307d1 service nova] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] No waiting events found dispatching network-vif-plugged-bb24be9c-c2ff-42e7-84ba-2f76b9400db2 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:11:24 user nova-compute[72809]: WARNING nova.compute.manager [req-8397e685-13cd-4c26-9441-67193b209adf req-a907949a-8388-4e59-8542-88e7647307d1 service nova] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Received unexpected event network-vif-plugged-bb24be9c-c2ff-42e7-84ba-2f76b9400db2 for instance with vm_state building and task_state spawning.
Aug 09 07:11:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:26 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691565086.72969, d29dd60c-2a98-4d47-b11c-67e88bb17dc3 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:11:26 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] VM Resumed (Lifecycle Event)
Aug 09 07:11:26 user nova-compute[72809]: DEBUG nova.compute.manager [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 07:11:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 07:11:26 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Instance spawned successfully.
Aug 09 07:11:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 07:11:26 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:11:26 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:11:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:11:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:11:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:11:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:11:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:11:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:11:26 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:11:26 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691565086.7333903, d29dd60c-2a98-4d47-b11c-67e88bb17dc3 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:11:26 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] VM Started (Lifecycle Event)
Aug 09 07:11:26 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:11:26 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:11:26 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:11:26 user nova-compute[72809]: INFO nova.compute.manager [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Took 5.78 seconds to spawn the instance on the hypervisor.
Aug 09 07:11:26 user nova-compute[72809]: DEBUG nova.compute.manager [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:11:26 user nova-compute[72809]: DEBUG nova.compute.manager [req-018ec59d-ebbf-41d5-a159-91c02e8a3ed0 req-25151e5d-644f-48c9-9c89-7b28cf00831e service nova] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Received event network-vif-plugged-bb24be9c-c2ff-42e7-84ba-2f76b9400db2 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:11:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-018ec59d-ebbf-41d5-a159-91c02e8a3ed0 req-25151e5d-644f-48c9-9c89-7b28cf00831e service nova] Acquiring lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:11:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-018ec59d-ebbf-41d5-a159-91c02e8a3ed0 req-25151e5d-644f-48c9-9c89-7b28cf00831e service nova] Lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:11:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-018ec59d-ebbf-41d5-a159-91c02e8a3ed0 req-25151e5d-644f-48c9-9c89-7b28cf00831e service nova] Lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:11:26 user nova-compute[72809]: DEBUG nova.compute.manager [req-018ec59d-ebbf-41d5-a159-91c02e8a3ed0 req-25151e5d-644f-48c9-9c89-7b28cf00831e service nova] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] No waiting events found dispatching network-vif-plugged-bb24be9c-c2ff-42e7-84ba-2f76b9400db2 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:11:26 user nova-compute[72809]: WARNING nova.compute.manager [req-018ec59d-ebbf-41d5-a159-91c02e8a3ed0 req-25151e5d-644f-48c9-9c89-7b28cf00831e service nova] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Received unexpected event network-vif-plugged-bb24be9c-c2ff-42e7-84ba-2f76b9400db2 for instance with vm_state building and task_state spawning.
Aug 09 07:11:26 user nova-compute[72809]: INFO nova.compute.manager [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Took 6.52 seconds to build instance.
Aug 09 07:11:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-51510656-5d40-4265-966d-c43c70329917 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.627s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:11:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3362875b-4fad-4ffd-b08b-88e15abb9465 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "63936bb9-97de-4a87-aa29-14129104c1d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:11:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3362875b-4fad-4ffd-b08b-88e15abb9465 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "63936bb9-97de-4a87-aa29-14129104c1d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:11:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3362875b-4fad-4ffd-b08b-88e15abb9465 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:11:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3362875b-4fad-4ffd-b08b-88e15abb9465 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.005s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:11:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3362875b-4fad-4ffd-b08b-88e15abb9465 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:11:33 user nova-compute[72809]: INFO nova.compute.manager [None req-3362875b-4fad-4ffd-b08b-88e15abb9465 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Terminating instance
Aug 09 07:11:33 user nova-compute[72809]: DEBUG nova.compute.manager [None req-3362875b-4fad-4ffd-b08b-88e15abb9465 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:11:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:33 user nova-compute[72809]: DEBUG nova.compute.manager [req-c3379ab0-bf44-4052-92fe-62dca4d3856b req-3ffb4c57-0f6d-4047-8cee-3247e1c2554c service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Received event network-vif-unplugged-871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:11:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c3379ab0-bf44-4052-92fe-62dca4d3856b req-3ffb4c57-0f6d-4047-8cee-3247e1c2554c service nova] Acquiring lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:11:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c3379ab0-bf44-4052-92fe-62dca4d3856b req-3ffb4c57-0f6d-4047-8cee-3247e1c2554c service nova] Lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:11:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c3379ab0-bf44-4052-92fe-62dca4d3856b req-3ffb4c57-0f6d-4047-8cee-3247e1c2554c service nova] Lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:11:33 user nova-compute[72809]: DEBUG nova.compute.manager [req-c3379ab0-bf44-4052-92fe-62dca4d3856b req-3ffb4c57-0f6d-4047-8cee-3247e1c2554c service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] No waiting events found dispatching network-vif-unplugged-871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:11:33 user nova-compute[72809]: DEBUG nova.compute.manager [req-c3379ab0-bf44-4052-92fe-62dca4d3856b req-3ffb4c57-0f6d-4047-8cee-3247e1c2554c service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Received event network-vif-unplugged-871a925e-dae2-45d5-8e6d-24d429032d70 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:11:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:33 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Instance destroyed successfully.
Aug 09 07:11:33 user nova-compute[72809]: DEBUG nova.objects.instance [None req-3362875b-4fad-4ffd-b08b-88e15abb9465 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lazy-loading 'resources' on Instance uuid 63936bb9-97de-4a87-aa29-14129104c1d3 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:11:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-3362875b-4fad-4ffd-b08b-88e15abb9465 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:04:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1556535521',display_name='tempest-ServerRescueNegativeTestJSON-server-1556535521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1556535521',id=35,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHeoIs5ATCyUGa031aHbazVkBN/+n/Z8VWoRm/Wus5x5A8l851hJVnTTm9YA2bIXyG0hvdO+4f6Xok23XdDFN+F0ZS83bBZmztR4TmBSoz2mlXYe3ZeHSAukj28ybVZyQ==',key_name='tempest-keypair-1071783678',keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:07:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e75b8536be334abba712e1c6f6886cdf',ramdisk_id='',reservation_id='r-mngut0hx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1153742012',owner_user_name='tempest-ServerRescueNegativeTestJSON-1153742012-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:08:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='740071d735364ce5b0e6a7bb0dbdffe3',uuid=63936bb9-97de-4a87-aa29-14129104c1d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "871a925e-dae2-45d5-8e6d-24d429032d70", "address": "fa:16:3e:a0:e1:1d", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871a925e-da", "ovs_interfaceid": "871a925e-dae2-45d5-8e6d-24d429032d70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:11:33 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-3362875b-4fad-4ffd-b08b-88e15abb9465 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Converting VIF {"id": "871a925e-dae2-45d5-8e6d-24d429032d70", "address": "fa:16:3e:a0:e1:1d", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap871a925e-da", "ovs_interfaceid": "871a925e-dae2-45d5-8e6d-24d429032d70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:11:33 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-3362875b-4fad-4ffd-b08b-88e15abb9465 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:e1:1d,bridge_name='br-int',has_traffic_filtering=True,id=871a925e-dae2-45d5-8e6d-24d429032d70,network=Network(fb9ae39b-117a-4cca-8080-683f63e8a318),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap871a925e-da') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:11:33 user nova-compute[72809]: DEBUG os_vif [None req-3362875b-4fad-4ffd-b08b-88e15abb9465 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:e1:1d,bridge_name='br-int',has_traffic_filtering=True,id=871a925e-dae2-45d5-8e6d-24d429032d70,network=Network(fb9ae39b-117a-4cca-8080-683f63e8a318),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap871a925e-da') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:11:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap871a925e-da, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:11:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:33 user nova-compute[72809]: INFO os_vif [None req-3362875b-4fad-4ffd-b08b-88e15abb9465 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:e1:1d,bridge_name='br-int',has_traffic_filtering=True,id=871a925e-dae2-45d5-8e6d-24d429032d70,network=Network(fb9ae39b-117a-4cca-8080-683f63e8a318),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap871a925e-da')
Aug 09 07:11:33 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-3362875b-4fad-4ffd-b08b-88e15abb9465 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Deleting instance files /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3_del
Aug 09 07:11:33 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-3362875b-4fad-4ffd-b08b-88e15abb9465 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Deletion of /opt/stack/data/nova/instances/63936bb9-97de-4a87-aa29-14129104c1d3_del complete
Aug 09 07:11:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:33 user nova-compute[72809]: INFO nova.compute.manager [None req-3362875b-4fad-4ffd-b08b-88e15abb9465 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 09 07:11:33 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-3362875b-4fad-4ffd-b08b-88e15abb9465 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:11:34 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:11:34 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:11:34 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:11:34 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Took 0.93 seconds to deallocate network for instance.
Aug 09 07:11:34 user nova-compute[72809]: DEBUG nova.compute.manager [req-b82797d7-dc40-4100-bd62-682909634245 req-842f5a51-24b5-4c5b-badb-f3c648893a6f service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Received event network-vif-deleted-871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:11:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3362875b-4fad-4ffd-b08b-88e15abb9465 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:11:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3362875b-4fad-4ffd-b08b-88e15abb9465 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:11:35 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-3362875b-4fad-4ffd-b08b-88e15abb9465 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:11:35 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-3362875b-4fad-4ffd-b08b-88e15abb9465 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:11:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3362875b-4fad-4ffd-b08b-88e15abb9465 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:11:35 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-3362875b-4fad-4ffd-b08b-88e15abb9465 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Deleted allocations for instance 63936bb9-97de-4a87-aa29-14129104c1d3
Aug 09 07:11:35 user nova-compute[72809]: DEBUG nova.compute.manager [req-239cc973-e8f1-4a38-8df9-c2dbc42d591c req-02d0b652-eedb-482d-87cd-703edc450ade service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Received event network-vif-plugged-871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:11:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-239cc973-e8f1-4a38-8df9-c2dbc42d591c req-02d0b652-eedb-482d-87cd-703edc450ade service nova] Acquiring lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:11:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-239cc973-e8f1-4a38-8df9-c2dbc42d591c req-02d0b652-eedb-482d-87cd-703edc450ade service nova] Lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:11:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-239cc973-e8f1-4a38-8df9-c2dbc42d591c req-02d0b652-eedb-482d-87cd-703edc450ade service nova] Lock "63936bb9-97de-4a87-aa29-14129104c1d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:11:35 user nova-compute[72809]: DEBUG nova.compute.manager [req-239cc973-e8f1-4a38-8df9-c2dbc42d591c req-02d0b652-eedb-482d-87cd-703edc450ade service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] No waiting events found dispatching network-vif-plugged-871a925e-dae2-45d5-8e6d-24d429032d70 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:11:35 user nova-compute[72809]: WARNING nova.compute.manager [req-239cc973-e8f1-4a38-8df9-c2dbc42d591c req-02d0b652-eedb-482d-87cd-703edc450ade service nova] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Received unexpected event network-vif-plugged-871a925e-dae2-45d5-8e6d-24d429032d70 for instance with vm_state deleted and task_state None.
Aug 09 07:11:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3362875b-4fad-4ffd-b08b-88e15abb9465 tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "63936bb9-97de-4a87-aa29-14129104c1d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.418s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:11:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:40 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:11:40 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 07:11:40 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-bebd5a14-6272-4de1-a1a1-4fb45b867c7f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:11:40 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-bebd5a14-6272-4de1-a1a1-4fb45b867c7f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:11:40 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 07:11:42 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Updating instance_info_cache with network_info: [{"id": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "address": "fa:16:3e:95:65:6f", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c034fd-3a", "ovs_interfaceid": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:11:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-bebd5a14-6272-4de1-a1a1-4fb45b867c7f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:11:42 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 07:11:42 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:11:43 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:43 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:11:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:11:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:11:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:11:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 07:11:43 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:11:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json" returned: 0 in 0.165s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:11:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:11:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:11:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:11:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:11:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:11:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:11:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:11:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:11:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:11:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:11:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:11:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:11:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:11:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:11:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d29dd60c-2a98-4d47-b11c-67e88bb17dc3/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:11:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d29dd60c-2a98-4d47-b11c-67e88bb17dc3/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:11:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d29dd60c-2a98-4d47-b11c-67e88bb17dc3/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:11:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d29dd60c-2a98-4d47-b11c-67e88bb17dc3/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:11:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:11:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:11:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:11:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:11:45 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:11:45 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:11:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01292d41-c87f-4ab0-8638-4aca44608f91/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:11:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01292d41-c87f-4ab0-8638-4aca44608f91/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:11:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01292d41-c87f-4ab0-8638-4aca44608f91/disk.rescue --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:11:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01292d41-c87f-4ab0-8638-4aca44608f91/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:11:46 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:11:46 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:11:46 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:11:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=7729MB free_disk=24.979785919189453GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 07:11:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:11:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:11:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 1bde423f-0b73-448f-bdce-8d6af96d8fc6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:11:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance bebd5a14-6272-4de1-a1a1-4fb45b867c7f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:11:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 339372ed-140d-4226-ba00-2cc682214d5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:11:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 466a8e58-5f88-4ffe-a7fd-a346003f3508 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:11:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 6e9996e8-c5eb-42c1-b88f-d75654e160c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:11:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 01292d41-c87f-4ab0-8638-4aca44608f91 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:11:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 48f0adeb-a5e8-4f81-a534-04c702c272a3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:11:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance d29dd60c-2a98-4d47-b11c-67e88bb17dc3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:11:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 07:11:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 07:11:47 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:11:47 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:11:47 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 07:11:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:11:48 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691565093.841663, 63936bb9-97de-4a87-aa29-14129104c1d3 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:11:48 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] VM Stopped (Lifecycle Event)
Aug 09 07:11:48 user nova-compute[72809]: DEBUG nova.compute.manager [None req-c565ddef-24e5-4ed8-96fb-696994204251 None None] [instance: 63936bb9-97de-4a87-aa29-14129104c1d3] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:11:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:50 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:11:50 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:11:50 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:11:50 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:11:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:51 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:11:51 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 07:11:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:11:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:11:55 user nova-compute[72809]: DEBUG nova.compute.manager [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 07:11:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:11:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:11:55 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 07:11:55 user nova-compute[72809]: INFO nova.compute.claims [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Claim successful on node user
Aug 09 07:11:55 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:11:55 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:11:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:11:55 user nova-compute[72809]: DEBUG nova.compute.manager [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 07:11:55 user nova-compute[72809]: DEBUG nova.compute.manager [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 07:11:55 user nova-compute[72809]: DEBUG nova.network.neutron [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 07:11:55 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 07:11:55 user nova-compute[72809]: DEBUG nova.compute.manager [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 07:11:55 user nova-compute[72809]: DEBUG nova.policy [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ed97d2c12b4b408cb1ab70dc60b2170d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96695e79164d4b9d836be01cad13efd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 07:11:56 user nova-compute[72809]: DEBUG nova.compute.manager [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 07:11:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 07:11:56 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Creating image(s)
Aug 09 07:11:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "/opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:11:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "/opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:11:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "/opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:11:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "1cf4d3cb6079987eb7a29e77c813afd5eb8d35d6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:11:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "1cf4d3cb6079987eb7a29e77c813afd5eb8d35d6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:11:56 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cf4d3cb6079987eb7a29e77c813afd5eb8d35d6.part --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:11:56 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cf4d3cb6079987eb7a29e77c813afd5eb8d35d6.part --force-share --output=json" returned: 0 in 0.142s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:11:56 user nova-compute[72809]: DEBUG nova.virt.images [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] 69804617-2d9d-4732-9fa3-a2e99341612f was qcow2, converting to raw {{(pid=72809) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 07:11:56 user nova-compute[72809]: DEBUG nova.privsep.utils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72809) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 07:11:56 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1cf4d3cb6079987eb7a29e77c813afd5eb8d35d6.part /opt/stack/data/nova/instances/_base/1cf4d3cb6079987eb7a29e77c813afd5eb8d35d6.converted {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:11:56 user nova-compute[72809]: DEBUG nova.network.neutron [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Successfully created port: 7319b474-9cbb-4012-992b-b6e41c507433 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1cf4d3cb6079987eb7a29e77c813afd5eb8d35d6.part /opt/stack/data/nova/instances/_base/1cf4d3cb6079987eb7a29e77c813afd5eb8d35d6.converted" returned: 0 in 0.464s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cf4d3cb6079987eb7a29e77c813afd5eb8d35d6.converted --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cf4d3cb6079987eb7a29e77c813afd5eb8d35d6.converted --force-share --output=json" returned: 0 in 0.134s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "1cf4d3cb6079987eb7a29e77c813afd5eb8d35d6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.176s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cf4d3cb6079987eb7a29e77c813afd5eb8d35d6 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cf4d3cb6079987eb7a29e77c813afd5eb8d35d6 --force-share --output=json" returned: 0 in 0.140s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "1cf4d3cb6079987eb7a29e77c813afd5eb8d35d6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "1cf4d3cb6079987eb7a29e77c813afd5eb8d35d6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cf4d3cb6079987eb7a29e77c813afd5eb8d35d6 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cf4d3cb6079987eb7a29e77c813afd5eb8d35d6 --force-share --output=json" returned: 0 in 0.135s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1cf4d3cb6079987eb7a29e77c813afd5eb8d35d6,backing_fmt=raw /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG nova.network.neutron [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Successfully updated port: 7319b474-9cbb-4012-992b-b6e41c507433 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG nova.compute.manager [req-3e52b6d9-a9a6-46e0-b8a6-ee560e51c44a req-74e3b7e7-62fc-4748-ac77-fbccd3d14776 service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Received event network-changed-7319b474-9cbb-4012-992b-b6e41c507433 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG nova.compute.manager [req-3e52b6d9-a9a6-46e0-b8a6-ee560e51c44a req-74e3b7e7-62fc-4748-ac77-fbccd3d14776 service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Refreshing instance network info cache due to event network-changed-7319b474-9cbb-4012-992b-b6e41c507433. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3e52b6d9-a9a6-46e0-b8a6-ee560e51c44a req-74e3b7e7-62fc-4748-ac77-fbccd3d14776 service nova] Acquiring lock "refresh_cache-b00766a3-5171-4022-8cb3-77ea9c8c5db6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3e52b6d9-a9a6-46e0-b8a6-ee560e51c44a req-74e3b7e7-62fc-4748-ac77-fbccd3d14776 service nova] Acquired lock "refresh_cache-b00766a3-5171-4022-8cb3-77ea9c8c5db6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG nova.network.neutron [req-3e52b6d9-a9a6-46e0-b8a6-ee560e51c44a req-74e3b7e7-62fc-4748-ac77-fbccd3d14776 service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Refreshing network info cache for port 7319b474-9cbb-4012-992b-b6e41c507433 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1cf4d3cb6079987eb7a29e77c813afd5eb8d35d6,backing_fmt=raw /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk 1073741824" returned: 0 in 0.066s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "refresh_cache-b00766a3-5171-4022-8cb3-77ea9c8c5db6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "1cf4d3cb6079987eb7a29e77c813afd5eb8d35d6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cf4d3cb6079987eb7a29e77c813afd5eb8d35d6 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG nova.network.neutron [req-3e52b6d9-a9a6-46e0-b8a6-ee560e51c44a req-74e3b7e7-62fc-4748-ac77-fbccd3d14776 service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cf4d3cb6079987eb7a29e77c813afd5eb8d35d6 --force-share --output=json" returned: 0 in 0.138s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Cannot resize image /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG nova.objects.instance [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lazy-loading 'migration_context' on Instance uuid b00766a3-5171-4022-8cb3-77ea9c8c5db6 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Ensure instance console log exists: /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG nova.network.neutron [req-3e52b6d9-a9a6-46e0-b8a6-ee560e51c44a req-74e3b7e7-62fc-4748-ac77-fbccd3d14776 service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3e52b6d9-a9a6-46e0-b8a6-ee560e51c44a req-74e3b7e7-62fc-4748-ac77-fbccd3d14776 service nova] Releasing lock "refresh_cache-b00766a3-5171-4022-8cb3-77ea9c8c5db6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquired lock "refresh_cache-b00766a3-5171-4022-8cb3-77ea9c8c5db6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG nova.network.neutron [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:11:57 user nova-compute[72809]: DEBUG nova.network.neutron [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG nova.network.neutron [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Updating instance_info_cache with network_info: [{"id": "7319b474-9cbb-4012-992b-b6e41c507433", "address": "fa:16:3e:46:ed:75", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7319b474-9c", "ovs_interfaceid": "7319b474-9cbb-4012-992b-b6e41c507433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Releasing lock "refresh_cache-b00766a3-5171-4022-8cb3-77ea9c8c5db6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG nova.compute.manager [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Instance network_info: |[{"id": "7319b474-9cbb-4012-992b-b6e41c507433", "address": "fa:16:3e:46:ed:75", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7319b474-9c", "ovs_interfaceid": "7319b474-9cbb-4012-992b-b6e41c507433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Start _get_guest_xml network_info=[{"id": "7319b474-9cbb-4012-992b-b6e41c507433", "address": "fa:16:3e:46:ed:75", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7319b474-9c", "ovs_interfaceid": "7319b474-9cbb-4012-992b-b6e41c507433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T07:11:52Z,direct_url=<?>,disk_format='qcow2',id=69804617-2d9d-4732-9fa3-a2e99341612f,min_disk=0,min_ram=0,name='tempest-scenario-img--199571686',owner='96695e79164d4b9d836be01cad13efd8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T07:11:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '69804617-2d9d-4732-9fa3-a2e99341612f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 07:11:58 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:11:58 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:11:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T07:11:52Z,direct_url=<?>,disk_format='qcow2',id=69804617-2d9d-4732-9fa3-a2e99341612f,min_disk=0,min_ram=0,name='tempest-scenario-img--199571686',owner='96695e79164d4b9d836be01cad13efd8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T07:11:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:11:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-275542902',display_name='tempest-TestMinimumBasicScenario-server-275542902',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-275542902',id=42,image_ref='69804617-2d9d-4732-9fa3-a2e99341612f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL66oBtNaPzlMlbKOWSTNg47DcXATsR8KBT9Ay3EFhkFcRH3fzS+FojTgaNiLQ7xi0/BINtV7FyabX+JzG2grwDO2Ln+2KY2fSwekJmdD/VuoBWBGR5Q8FWtvVx4WLi/MQ==',key_name='tempest-TestMinimumBasicScenario-838682356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96695e79164d4b9d836be01cad13efd8',ramdisk_id='',reservation_id='r-a2twhv46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='69804617-2d9d-4732-9fa3-a2e99341612f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1810598523',owner_user_name='tempest-TestMinimumBasicScenario-1810598523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:11:56Z,user_data=None,user_id='ed97d2c12b4b408cb1ab70dc60b2170d',uuid=b00766a3-5171-4022-8cb3-77ea9c8c5db6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7319b474-9cbb-4012-992b-b6e41c507433", "address": "fa:16:3e:46:ed:75", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7319b474-9c", "ovs_interfaceid": "7319b474-9cbb-4012-992b-b6e41c507433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Converting VIF {"id": "7319b474-9cbb-4012-992b-b6e41c507433", "address": "fa:16:3e:46:ed:75", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7319b474-9c", "ovs_interfaceid": "7319b474-9cbb-4012-992b-b6e41c507433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:ed:75,bridge_name='br-int',has_traffic_filtering=True,id=7319b474-9cbb-4012-992b-b6e41c507433,network=Network(0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7319b474-9c') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG nova.objects.instance [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lazy-loading 'pci_devices' on Instance uuid b00766a3-5171-4022-8cb3-77ea9c8c5db6 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] End _get_guest_xml xml=<domain type="kvm">
Aug 09 07:11:58 user nova-compute[72809]:   <uuid>b00766a3-5171-4022-8cb3-77ea9c8c5db6</uuid>
Aug 09 07:11:58 user nova-compute[72809]:   <name>instance-0000002a</name>
Aug 09 07:11:58 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 07:11:58 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 07:11:58 user nova-compute[72809]:   <metadata>
Aug 09 07:11:58 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 07:11:58 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 07:11:58 user nova-compute[72809]:       <nova:name>tempest-TestMinimumBasicScenario-server-275542902</nova:name>
Aug 09 07:11:58 user nova-compute[72809]:       <nova:creationTime>2023-08-09 07:11:58</nova:creationTime>
Aug 09 07:11:58 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 07:11:58 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 07:11:58 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 07:11:58 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 07:11:58 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 07:11:58 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 07:11:58 user nova-compute[72809]:       </nova:flavor>
Aug 09 07:11:58 user nova-compute[72809]:       <nova:owner>
Aug 09 07:11:58 user nova-compute[72809]:         <nova:user uuid="ed97d2c12b4b408cb1ab70dc60b2170d">tempest-TestMinimumBasicScenario-1810598523-project-member</nova:user>
Aug 09 07:11:58 user nova-compute[72809]:         <nova:project uuid="96695e79164d4b9d836be01cad13efd8">tempest-TestMinimumBasicScenario-1810598523</nova:project>
Aug 09 07:11:58 user nova-compute[72809]:       </nova:owner>
Aug 09 07:11:58 user nova-compute[72809]:       <nova:root type="image" uuid="69804617-2d9d-4732-9fa3-a2e99341612f"/>
Aug 09 07:11:58 user nova-compute[72809]:       <nova:ports>
Aug 09 07:11:58 user nova-compute[72809]:         <nova:port uuid="7319b474-9cbb-4012-992b-b6e41c507433">
Aug 09 07:11:58 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 07:11:58 user nova-compute[72809]:         </nova:port>
Aug 09 07:11:58 user nova-compute[72809]:       </nova:ports>
Aug 09 07:11:58 user nova-compute[72809]:     </nova:instance>
Aug 09 07:11:58 user nova-compute[72809]:   </metadata>
Aug 09 07:11:58 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 07:11:58 user nova-compute[72809]:     <system>
Aug 09 07:11:58 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 07:11:58 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 07:11:58 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 07:11:58 user nova-compute[72809]:       <entry name="serial">b00766a3-5171-4022-8cb3-77ea9c8c5db6</entry>
Aug 09 07:11:58 user nova-compute[72809]:       <entry name="uuid">b00766a3-5171-4022-8cb3-77ea9c8c5db6</entry>
Aug 09 07:11:58 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 07:11:58 user nova-compute[72809]:     </system>
Aug 09 07:11:58 user nova-compute[72809]:   </sysinfo>
Aug 09 07:11:58 user nova-compute[72809]:   <os>
Aug 09 07:11:58 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 07:11:58 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 07:11:58 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 07:11:58 user nova-compute[72809]:   </os>
Aug 09 07:11:58 user nova-compute[72809]:   <features>
Aug 09 07:11:58 user nova-compute[72809]:     <acpi/>
Aug 09 07:11:58 user nova-compute[72809]:     <apic/>
Aug 09 07:11:58 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 07:11:58 user nova-compute[72809]:   </features>
Aug 09 07:11:58 user nova-compute[72809]:   <clock offset="utc">
Aug 09 07:11:58 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 07:11:58 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 07:11:58 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 07:11:58 user nova-compute[72809]:   </clock>
Aug 09 07:11:58 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 07:11:58 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 07:11:58 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 07:11:58 user nova-compute[72809]:   </cpu>
Aug 09 07:11:58 user nova-compute[72809]:   <devices>
Aug 09 07:11:58 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 07:11:58 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 07:11:58 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk"/>
Aug 09 07:11:58 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 07:11:58 user nova-compute[72809]:     </disk>
Aug 09 07:11:58 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 07:11:58 user nova-compute[72809]:       <mac address="fa:16:3e:46:ed:75"/>
Aug 09 07:11:58 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:11:58 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 07:11:58 user nova-compute[72809]:       <target dev="tap7319b474-9c"/>
Aug 09 07:11:58 user nova-compute[72809]:     </interface>
Aug 09 07:11:58 user nova-compute[72809]:     <serial type="pty">
Aug 09 07:11:58 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/console.log" append="off"/>
Aug 09 07:11:58 user nova-compute[72809]:     </serial>
Aug 09 07:11:58 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 07:11:58 user nova-compute[72809]:     <video>
Aug 09 07:11:58 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:11:58 user nova-compute[72809]:     </video>
Aug 09 07:11:58 user nova-compute[72809]:     <rng model="virtio">
Aug 09 07:11:58 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 07:11:58 user nova-compute[72809]:     </rng>
Aug 09 07:11:58 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 07:11:58 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 07:11:58 user nova-compute[72809]:       <stats period="10"/>
Aug 09 07:11:58 user nova-compute[72809]:     </memballoon>
Aug 09 07:11:58 user nova-compute[72809]:   </devices>
Aug 09 07:11:58 user nova-compute[72809]: </domain>
Aug 09 07:11:58 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:11:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-275542902',display_name='tempest-TestMinimumBasicScenario-server-275542902',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-275542902',id=42,image_ref='69804617-2d9d-4732-9fa3-a2e99341612f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL66oBtNaPzlMlbKOWSTNg47DcXATsR8KBT9Ay3EFhkFcRH3fzS+FojTgaNiLQ7xi0/BINtV7FyabX+JzG2grwDO2Ln+2KY2fSwekJmdD/VuoBWBGR5Q8FWtvVx4WLi/MQ==',key_name='tempest-TestMinimumBasicScenario-838682356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96695e79164d4b9d836be01cad13efd8',ramdisk_id='',reservation_id='r-a2twhv46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='69804617-2d9d-4732-9fa3-a2e99341612f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1810598523',owner_user_name='tempest-TestMinimumBasicScenario-1810598523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:11:56Z,user_data=None,user_id='ed97d2c12b4b408cb1ab70dc60b2170d',uuid=b00766a3-5171-4022-8cb3-77ea9c8c5db6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7319b474-9cbb-4012-992b-b6e41c507433", "address": "fa:16:3e:46:ed:75", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7319b474-9c", "ovs_interfaceid": "7319b474-9cbb-4012-992b-b6e41c507433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Converting VIF {"id": "7319b474-9cbb-4012-992b-b6e41c507433", "address": "fa:16:3e:46:ed:75", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7319b474-9c", "ovs_interfaceid": "7319b474-9cbb-4012-992b-b6e41c507433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:ed:75,bridge_name='br-int',has_traffic_filtering=True,id=7319b474-9cbb-4012-992b-b6e41c507433,network=Network(0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7319b474-9c') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG os_vif [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:ed:75,bridge_name='br-int',has_traffic_filtering=True,id=7319b474-9cbb-4012-992b-b6e41c507433,network=Network(0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7319b474-9c') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7319b474-9c, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7319b474-9c, col_values=(('external_ids', {'iface-id': '7319b474-9cbb-4012-992b-b6e41c507433', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:ed:75', 'vm-uuid': 'b00766a3-5171-4022-8cb3-77ea9c8c5db6'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:58 user nova-compute[72809]: INFO os_vif [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:ed:75,bridge_name='br-int',has_traffic_filtering=True,id=7319b474-9cbb-4012-992b-b6e41c507433,network=Network(0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7319b474-9c')
Aug 09 07:11:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:11:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] No VIF found with MAC fa:16:3e:46:ed:75, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:11:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:11:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:00 user nova-compute[72809]: DEBUG nova.compute.manager [req-726b4e2e-535d-4cdb-9220-35582b12e8de req-7f2fb35f-a97d-434b-9650-1b49bf17e437 service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Received event network-vif-plugged-7319b474-9cbb-4012-992b-b6e41c507433 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:12:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-726b4e2e-535d-4cdb-9220-35582b12e8de req-7f2fb35f-a97d-434b-9650-1b49bf17e437 service nova] Acquiring lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:12:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-726b4e2e-535d-4cdb-9220-35582b12e8de req-7f2fb35f-a97d-434b-9650-1b49bf17e437 service nova] Lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:12:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-726b4e2e-535d-4cdb-9220-35582b12e8de req-7f2fb35f-a97d-434b-9650-1b49bf17e437 service nova] Lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:12:00 user nova-compute[72809]: DEBUG nova.compute.manager [req-726b4e2e-535d-4cdb-9220-35582b12e8de req-7f2fb35f-a97d-434b-9650-1b49bf17e437 service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] No waiting events found dispatching network-vif-plugged-7319b474-9cbb-4012-992b-b6e41c507433 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:12:00 user nova-compute[72809]: WARNING nova.compute.manager [req-726b4e2e-535d-4cdb-9220-35582b12e8de req-7f2fb35f-a97d-434b-9650-1b49bf17e437 service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Received unexpected event network-vif-plugged-7319b474-9cbb-4012-992b-b6e41c507433 for instance with vm_state building and task_state spawning.
Aug 09 07:12:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:02 user nova-compute[72809]: DEBUG nova.compute.manager [req-79807765-1267-4780-86ce-f862f371b691 req-845ad453-115d-47c4-b7c2-e5bfbd5d83cb service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Received event network-vif-plugged-7319b474-9cbb-4012-992b-b6e41c507433 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:12:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-79807765-1267-4780-86ce-f862f371b691 req-845ad453-115d-47c4-b7c2-e5bfbd5d83cb service nova] Acquiring lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:12:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-79807765-1267-4780-86ce-f862f371b691 req-845ad453-115d-47c4-b7c2-e5bfbd5d83cb service nova] Lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:12:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-79807765-1267-4780-86ce-f862f371b691 req-845ad453-115d-47c4-b7c2-e5bfbd5d83cb service nova] Lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:12:02 user nova-compute[72809]: DEBUG nova.compute.manager [req-79807765-1267-4780-86ce-f862f371b691 req-845ad453-115d-47c4-b7c2-e5bfbd5d83cb service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] No waiting events found dispatching network-vif-plugged-7319b474-9cbb-4012-992b-b6e41c507433 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:12:02 user nova-compute[72809]: WARNING nova.compute.manager [req-79807765-1267-4780-86ce-f862f371b691 req-845ad453-115d-47c4-b7c2-e5bfbd5d83cb service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Received unexpected event network-vif-plugged-7319b474-9cbb-4012-992b-b6e41c507433 for instance with vm_state building and task_state spawning.
Aug 09 07:12:02 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691565122.2988396, b00766a3-5171-4022-8cb3-77ea9c8c5db6 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:12:02 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] VM Resumed (Lifecycle Event)
Aug 09 07:12:02 user nova-compute[72809]: DEBUG nova.compute.manager [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 07:12:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 07:12:02 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Instance spawned successfully.
Aug 09 07:12:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 07:12:02 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:12:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:12:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:12:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:12:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:12:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:12:02 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:12:02 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:12:02 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:12:02 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691565122.3005185, b00766a3-5171-4022-8cb3-77ea9c8c5db6 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:12:02 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] VM Started (Lifecycle Event)
Aug 09 07:12:02 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:12:02 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:12:02 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:12:02 user nova-compute[72809]: INFO nova.compute.manager [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Took 6.43 seconds to spawn the instance on the hypervisor.
Aug 09 07:12:02 user nova-compute[72809]: DEBUG nova.compute.manager [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:12:02 user nova-compute[72809]: INFO nova.compute.manager [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Took 7.18 seconds to build instance.
Aug 09 07:12:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0b8fbd02-e3b9-45b1-a2d4-5593e9c32211 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.278s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:12:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:20 user nova-compute[72809]: DEBUG nova.compute.manager [req-23a67a3c-f8d5-44bb-9e94-618a6690bd3a req-bc65d3d7-25f4-44e5-90cf-ac1cd82ab5d3 service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Received event network-changed-69cd2937-cfc9-42c1-bd26-c5debab643fc {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:12:20 user nova-compute[72809]: DEBUG nova.compute.manager [req-23a67a3c-f8d5-44bb-9e94-618a6690bd3a req-bc65d3d7-25f4-44e5-90cf-ac1cd82ab5d3 service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Refreshing instance network info cache due to event network-changed-69cd2937-cfc9-42c1-bd26-c5debab643fc. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:12:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-23a67a3c-f8d5-44bb-9e94-618a6690bd3a req-bc65d3d7-25f4-44e5-90cf-ac1cd82ab5d3 service nova] Acquiring lock "refresh_cache-48f0adeb-a5e8-4f81-a534-04c702c272a3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:12:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-23a67a3c-f8d5-44bb-9e94-618a6690bd3a req-bc65d3d7-25f4-44e5-90cf-ac1cd82ab5d3 service nova] Acquired lock "refresh_cache-48f0adeb-a5e8-4f81-a534-04c702c272a3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:12:20 user nova-compute[72809]: DEBUG nova.network.neutron [req-23a67a3c-f8d5-44bb-9e94-618a6690bd3a req-bc65d3d7-25f4-44e5-90cf-ac1cd82ab5d3 service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Refreshing network info cache for port 69cd2937-cfc9-42c1-bd26-c5debab643fc {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:12:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Acquiring lock "48f0adeb-a5e8-4f81-a534-04c702c272a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:12:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "48f0adeb-a5e8-4f81-a534-04c702c272a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:12:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Acquiring lock "48f0adeb-a5e8-4f81-a534-04c702c272a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:12:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "48f0adeb-a5e8-4f81-a534-04c702c272a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:12:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "48f0adeb-a5e8-4f81-a534-04c702c272a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:12:20 user nova-compute[72809]: INFO nova.compute.manager [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Terminating instance
Aug 09 07:12:20 user nova-compute[72809]: DEBUG nova.compute.manager [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:12:20 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:20 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:20 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:20 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:20 user nova-compute[72809]: DEBUG nova.network.neutron [req-23a67a3c-f8d5-44bb-9e94-618a6690bd3a req-bc65d3d7-25f4-44e5-90cf-ac1cd82ab5d3 service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Updated VIF entry in instance network info cache for port 69cd2937-cfc9-42c1-bd26-c5debab643fc. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:12:20 user nova-compute[72809]: DEBUG nova.network.neutron [req-23a67a3c-f8d5-44bb-9e94-618a6690bd3a req-bc65d3d7-25f4-44e5-90cf-ac1cd82ab5d3 service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Updating instance_info_cache with network_info: [{"id": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "address": "fa:16:3e:43:7d:86", "network": {"id": "2bd3fecc-598f-4b7d-a306-5b31f8e81019", "bridge": "br-int", "label": "tempest-TestShelveInstance-696590898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0c708ffc744c3ab8175ad7b939e4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd2937-cf", "ovs_interfaceid": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:12:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-23a67a3c-f8d5-44bb-9e94-618a6690bd3a req-bc65d3d7-25f4-44e5-90cf-ac1cd82ab5d3 service nova] Releasing lock "refresh_cache-48f0adeb-a5e8-4f81-a534-04c702c272a3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:21 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Instance destroyed successfully.
Aug 09 07:12:21 user nova-compute[72809]: DEBUG nova.objects.instance [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lazy-loading 'resources' on Instance uuid 48f0adeb-a5e8-4f81-a534-04c702c272a3 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T07:06:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1995239041',display_name='tempest-TestShelveInstance-server-1995239041',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1995239041',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNltj5AhfdReKC+XXSY6ejv8Ie2lm2YSrdkcUJXL7q6V25F5DxWfy2C7Pk7FV62dJX0Li1dF/73C3Hzfrynk0pBWPWkfYCaD3NMi4Kd0GOmpueQ4DMju5iODY6Pa9axjOQ==',key_name='tempest-TestShelveInstance-1236424892',keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:10:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b0c708ffc744c3ab8175ad7b939e4e3',ramdisk_id='',reservation_id='r-1lnz0lx6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1139600942',owner_user_name='tempest-TestShelveInstance-1139600942-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:10:47Z,user_data=None,user_id='e0e9000c85ba4fa5aef9c2c2b592b950',uuid=48f0adeb-a5e8-4f81-a534-04c702c272a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "address": "fa:16:3e:43:7d:86", "network": {"id": "2bd3fecc-598f-4b7d-a306-5b31f8e81019", "bridge": "br-int", "label": "tempest-TestShelveInstance-696590898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0c708ffc744c3ab8175ad7b939e4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd2937-cf", "ovs_interfaceid": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Converting VIF {"id": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "address": "fa:16:3e:43:7d:86", "network": {"id": "2bd3fecc-598f-4b7d-a306-5b31f8e81019", "bridge": "br-int", "label": "tempest-TestShelveInstance-696590898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b0c708ffc744c3ab8175ad7b939e4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd2937-cf", "ovs_interfaceid": "69cd2937-cfc9-42c1-bd26-c5debab643fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:7d:86,bridge_name='br-int',has_traffic_filtering=True,id=69cd2937-cfc9-42c1-bd26-c5debab643fc,network=Network(2bd3fecc-598f-4b7d-a306-5b31f8e81019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69cd2937-cf') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG os_vif [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:7d:86,bridge_name='br-int',has_traffic_filtering=True,id=69cd2937-cfc9-42c1-bd26-c5debab643fc,network=Network(2bd3fecc-598f-4b7d-a306-5b31f8e81019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69cd2937-cf') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69cd2937-cf, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:12:21 user nova-compute[72809]: INFO os_vif [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:7d:86,bridge_name='br-int',has_traffic_filtering=True,id=69cd2937-cfc9-42c1-bd26-c5debab643fc,network=Network(2bd3fecc-598f-4b7d-a306-5b31f8e81019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69cd2937-cf')
Aug 09 07:12:21 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsWoEVyQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:12:21 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:12:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0be9b51-ad03-445a-8174-847192892ea8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[408560eb-5177-4977-a4f3-6b94b7491dff]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:12:21 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:12:21 user nova-compute[72809]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a (non-flash)
Aug 09 07:12:21 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:12:21 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:12:21 user nova-compute[72809]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a (non-flash)
Aug 09 07:12:21 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc138511630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a'): ({'sde'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Removing single pathed devices sde {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bb0c1e-5e94-4c94-8880-c8459031839c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG nova.compute.manager [req-9ff3d09d-fd7a-4fef-a36b-5f93287c5cb6 req-9dd0e08c-b20f-47c6-8241-70809c63ab5f service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Received event network-vif-unplugged-69cd2937-cfc9-42c1-bd26-c5debab643fc {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9ff3d09d-fd7a-4fef-a36b-5f93287c5cb6 req-9dd0e08c-b20f-47c6-8241-70809c63ab5f service nova] Acquiring lock "48f0adeb-a5e8-4f81-a534-04c702c272a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9ff3d09d-fd7a-4fef-a36b-5f93287c5cb6 req-9dd0e08c-b20f-47c6-8241-70809c63ab5f service nova] Lock "48f0adeb-a5e8-4f81-a534-04c702c272a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9ff3d09d-fd7a-4fef-a36b-5f93287c5cb6 req-9dd0e08c-b20f-47c6-8241-70809c63ab5f service nova] Lock "48f0adeb-a5e8-4f81-a534-04c702c272a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG nova.compute.manager [req-9ff3d09d-fd7a-4fef-a36b-5f93287c5cb6 req-9dd0e08c-b20f-47c6-8241-70809c63ab5f service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] No waiting events found dispatching network-vif-unplugged-69cd2937-cfc9-42c1-bd26-c5debab643fc {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG nova.compute.manager [req-9ff3d09d-fd7a-4fef-a36b-5f93287c5cb6 req-9dd0e08c-b20f-47c6-8241-70809c63ab5f service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Received event network-vif-unplugged-69cd2937-cfc9-42c1-bd26-c5debab643fc for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4789ca2a-6a23-493e-88fa-b840380c3bb0]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Flushing IO for device /dev/sde {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5234ceb2-56ee-4da3-a037-35a984c70d7f]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ea8823-5623-4b79-a83b-6e786f96b44b]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] SCSI volumes sde have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb4b624-cd06-4082-9d8a-57212fcd5f9e]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc91568-6ef6-4daf-bccc-2f83aebb5852]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a, portal: 172.16.0.220,3260]
Aug 09 07:12:21 user nova-compute[72809]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a, portal: 172.16.0.220,3260] successful.
Aug 09 07:12:21 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3386be22-3bf4-4702-888c-9d3e8d2ce54a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[712bf833-4021-4813-a1f5-4b4e4e8018bc]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] <== disconnect_volume: return (324ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:12:21 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Deleting instance files /opt/stack/data/nova/instances/48f0adeb-a5e8-4f81-a534-04c702c272a3_del
Aug 09 07:12:21 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Deletion of /opt/stack/data/nova/instances/48f0adeb-a5e8-4f81-a534-04c702c272a3_del complete
Aug 09 07:12:21 user nova-compute[72809]: INFO nova.compute.manager [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Took 1.32 seconds to destroy the instance on the hypervisor.
Aug 09 07:12:21 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:12:21 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:12:22 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:12:22 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Took 0.70 seconds to deallocate network for instance.
Aug 09 07:12:22 user nova-compute[72809]: DEBUG nova.compute.manager [req-ad45fcee-9713-4072-9315-e39dbdf3df13 req-1e05d7b2-e869-45ef-a197-a053e83e0bb2 service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Received event network-vif-deleted-69cd2937-cfc9-42c1-bd26-c5debab643fc {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:12:22 user nova-compute[72809]: INFO nova.compute.manager [req-ad45fcee-9713-4072-9315-e39dbdf3df13 req-1e05d7b2-e869-45ef-a197-a053e83e0bb2 service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Neutron deleted interface 69cd2937-cfc9-42c1-bd26-c5debab643fc; detaching it from the instance and deleting it from the info cache
Aug 09 07:12:22 user nova-compute[72809]: DEBUG nova.network.neutron [req-ad45fcee-9713-4072-9315-e39dbdf3df13 req-1e05d7b2-e869-45ef-a197-a053e83e0bb2 service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:12:22 user nova-compute[72809]: DEBUG nova.compute.manager [req-ad45fcee-9713-4072-9315-e39dbdf3df13 req-1e05d7b2-e869-45ef-a197-a053e83e0bb2 service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Detach interface failed, port_id=69cd2937-cfc9-42c1-bd26-c5debab643fc, reason: Instance 48f0adeb-a5e8-4f81-a534-04c702c272a3 could not be found. {{(pid=72809) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 07:12:23 user nova-compute[72809]: INFO nova.compute.manager [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Took 0.74 seconds to detach 1 volumes for instance.
Aug 09 07:12:23 user nova-compute[72809]: DEBUG nova.compute.manager [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Deleting volume: 3386be22-3bf4-4702-888c-9d3e8d2ce54a {{(pid=72809) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 07:12:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:12:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:12:23 user nova-compute[72809]: DEBUG nova.compute.manager [req-60ef7acd-5042-4a86-bf69-200407293611 req-3de4bb38-3ee3-4009-832b-5cc93cf947c9 service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Received event network-vif-plugged-69cd2937-cfc9-42c1-bd26-c5debab643fc {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:12:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-60ef7acd-5042-4a86-bf69-200407293611 req-3de4bb38-3ee3-4009-832b-5cc93cf947c9 service nova] Acquiring lock "48f0adeb-a5e8-4f81-a534-04c702c272a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:12:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-60ef7acd-5042-4a86-bf69-200407293611 req-3de4bb38-3ee3-4009-832b-5cc93cf947c9 service nova] Lock "48f0adeb-a5e8-4f81-a534-04c702c272a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:12:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-60ef7acd-5042-4a86-bf69-200407293611 req-3de4bb38-3ee3-4009-832b-5cc93cf947c9 service nova] Lock "48f0adeb-a5e8-4f81-a534-04c702c272a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:12:23 user nova-compute[72809]: DEBUG nova.compute.manager [req-60ef7acd-5042-4a86-bf69-200407293611 req-3de4bb38-3ee3-4009-832b-5cc93cf947c9 service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] No waiting events found dispatching network-vif-plugged-69cd2937-cfc9-42c1-bd26-c5debab643fc {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:12:23 user nova-compute[72809]: WARNING nova.compute.manager [req-60ef7acd-5042-4a86-bf69-200407293611 req-3de4bb38-3ee3-4009-832b-5cc93cf947c9 service nova] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Received unexpected event network-vif-plugged-69cd2937-cfc9-42c1-bd26-c5debab643fc for instance with vm_state deleted and task_state None.
Aug 09 07:12:23 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:12:23 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:12:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.314s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:12:23 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Deleted allocations for instance 48f0adeb-a5e8-4f81-a534-04c702c272a3
Aug 09 07:12:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-46dbee5a-b18d-4a39-b6bb-7f2a5cee7816 tempest-TestShelveInstance-1139600942 tempest-TestShelveInstance-1139600942-project-member] Lock "48f0adeb-a5e8-4f81-a534-04c702c272a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.501s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:12:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:31 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquiring lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:12:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:12:33 user nova-compute[72809]: DEBUG nova.compute.manager [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 07:12:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:12:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:12:33 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 07:12:33 user nova-compute[72809]: INFO nova.compute.claims [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Claim successful on node user
Aug 09 07:12:33 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:12:33 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:12:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:12:34 user nova-compute[72809]: DEBUG nova.compute.manager [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 07:12:34 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:34 user nova-compute[72809]: DEBUG nova.compute.manager [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 07:12:34 user nova-compute[72809]: DEBUG nova.network.neutron [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 07:12:34 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 07:12:34 user nova-compute[72809]: DEBUG nova.compute.manager [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 07:12:34 user nova-compute[72809]: DEBUG nova.policy [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b188eb3ed1df40768c24486c0bd06235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29c65ac1c7649c1bc05bd790821801e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 07:12:34 user nova-compute[72809]: DEBUG nova.compute.manager [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 07:12:34 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 07:12:34 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Creating image(s)
Aug 09 07:12:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquiring lock "/opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:12:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "/opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:12:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "/opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:12:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:12:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.161s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:12:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:12:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:12:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:12:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.136s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:12:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:12:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk 1073741824" returned: 0 in 0.054s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:12:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:12:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:12:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.139s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:12:34 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 07:12:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:12:34 user nova-compute[72809]: DEBUG nova.network.neutron [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Successfully created port: 4ccb4018-12aa-43f0-95d9-3021c4b8e61e {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 07:12:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:12:34 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Cannot resize image /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 07:12:34 user nova-compute[72809]: DEBUG nova.objects.instance [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lazy-loading 'migration_context' on Instance uuid 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:12:34 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 07:12:34 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Ensure instance console log exists: /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 07:12:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:12:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:12:34 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:12:35 user nova-compute[72809]: DEBUG nova.network.neutron [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Successfully updated port: 4ccb4018-12aa-43f0-95d9-3021c4b8e61e {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 07:12:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquiring lock "refresh_cache-91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:12:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquired lock "refresh_cache-91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:12:35 user nova-compute[72809]: DEBUG nova.network.neutron [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:12:35 user nova-compute[72809]: DEBUG nova.compute.manager [req-7d9d4c50-6763-43ed-a93f-cbf7d8660a00 req-2102bb9a-69d6-4e69-b4b3-ba86ba4cfc67 service nova] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Received event network-changed-4ccb4018-12aa-43f0-95d9-3021c4b8e61e {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:12:35 user nova-compute[72809]: DEBUG nova.compute.manager [req-7d9d4c50-6763-43ed-a93f-cbf7d8660a00 req-2102bb9a-69d6-4e69-b4b3-ba86ba4cfc67 service nova] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Refreshing instance network info cache due to event network-changed-4ccb4018-12aa-43f0-95d9-3021c4b8e61e. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:12:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7d9d4c50-6763-43ed-a93f-cbf7d8660a00 req-2102bb9a-69d6-4e69-b4b3-ba86ba4cfc67 service nova] Acquiring lock "refresh_cache-91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:12:35 user nova-compute[72809]: DEBUG nova.network.neutron [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.network.neutron [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Updating instance_info_cache with network_info: [{"id": "4ccb4018-12aa-43f0-95d9-3021c4b8e61e", "address": "fa:16:3e:3d:dc:e9", "network": {"id": "1aa93c25-f23b-4acf-83dc-407d71f0284f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2043026175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29c65ac1c7649c1bc05bd790821801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccb4018-12", "ovs_interfaceid": "4ccb4018-12aa-43f0-95d9-3021c4b8e61e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Releasing lock "refresh_cache-91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.compute.manager [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Instance network_info: |[{"id": "4ccb4018-12aa-43f0-95d9-3021c4b8e61e", "address": "fa:16:3e:3d:dc:e9", "network": {"id": "1aa93c25-f23b-4acf-83dc-407d71f0284f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2043026175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29c65ac1c7649c1bc05bd790821801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccb4018-12", "ovs_interfaceid": "4ccb4018-12aa-43f0-95d9-3021c4b8e61e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7d9d4c50-6763-43ed-a93f-cbf7d8660a00 req-2102bb9a-69d6-4e69-b4b3-ba86ba4cfc67 service nova] Acquired lock "refresh_cache-91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.network.neutron [req-7d9d4c50-6763-43ed-a93f-cbf7d8660a00 req-2102bb9a-69d6-4e69-b4b3-ba86ba4cfc67 service nova] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Refreshing network info cache for port 4ccb4018-12aa-43f0-95d9-3021c4b8e61e {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Start _get_guest_xml network_info=[{"id": "4ccb4018-12aa-43f0-95d9-3021c4b8e61e", "address": "fa:16:3e:3d:dc:e9", "network": {"id": "1aa93c25-f23b-4acf-83dc-407d71f0284f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2043026175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29c65ac1c7649c1bc05bd790821801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccb4018-12", "ovs_interfaceid": "4ccb4018-12aa-43f0-95d9-3021c4b8e61e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 07:12:36 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:12:36 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-688152727',display_name='tempest-SnapshotDataIntegrityTests-server-688152727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-688152727',id=43,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJ4Fy5Yb+PbuBHKTtUH+j18umyuJ8D5XYxOzU2DEUuC18bQqnnYuSrWq+0U4B4YeCUZ3J1fl9zpO7FCv7Fq+mZEG4KzK1f17jr4MPEl0YdTBVj1LFXD8V3UCtM2gbMtIA==',key_name='tempest-keypair-1083576033',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f29c65ac1c7649c1bc05bd790821801e',ramdisk_id='',reservation_id='r-g82jruwd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-186766721',owner_user_name='tempest-SnapshotDataIntegrityTests-186766721-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:12:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b188eb3ed1df40768c24486c0bd06235',uuid=91bdefd3-8ab1-43c2-8eb8-06d4b84eb382,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ccb4018-12aa-43f0-95d9-3021c4b8e61e", "address": "fa:16:3e:3d:dc:e9", "network": {"id": "1aa93c25-f23b-4acf-83dc-407d71f0284f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2043026175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29c65ac1c7649c1bc05bd790821801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccb4018-12", "ovs_interfaceid": "4ccb4018-12aa-43f0-95d9-3021c4b8e61e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Converting VIF {"id": "4ccb4018-12aa-43f0-95d9-3021c4b8e61e", "address": "fa:16:3e:3d:dc:e9", "network": {"id": "1aa93c25-f23b-4acf-83dc-407d71f0284f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2043026175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29c65ac1c7649c1bc05bd790821801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccb4018-12", "ovs_interfaceid": "4ccb4018-12aa-43f0-95d9-3021c4b8e61e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:dc:e9,bridge_name='br-int',has_traffic_filtering=True,id=4ccb4018-12aa-43f0-95d9-3021c4b8e61e,network=Network(1aa93c25-f23b-4acf-83dc-407d71f0284f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ccb4018-12') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.objects.instance [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lazy-loading 'pci_devices' on Instance uuid 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:12:36 user nova-compute[72809]: INFO nova.compute.manager [None req-a4cbe283-bab3-4957-b4f5-a7e2658e670f tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Unrescuing
Aug 09 07:12:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a4cbe283-bab3-4957-b4f5-a7e2658e670f tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "refresh_cache-01292d41-c87f-4ab0-8638-4aca44608f91" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a4cbe283-bab3-4957-b4f5-a7e2658e670f tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquired lock "refresh_cache-01292d41-c87f-4ab0-8638-4aca44608f91" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.network.neutron [None req-a4cbe283-bab3-4957-b4f5-a7e2658e670f tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] End _get_guest_xml xml=<domain type="kvm">
Aug 09 07:12:36 user nova-compute[72809]:   <uuid>91bdefd3-8ab1-43c2-8eb8-06d4b84eb382</uuid>
Aug 09 07:12:36 user nova-compute[72809]:   <name>instance-0000002b</name>
Aug 09 07:12:36 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 07:12:36 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 07:12:36 user nova-compute[72809]:   <metadata>
Aug 09 07:12:36 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 07:12:36 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 07:12:36 user nova-compute[72809]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-688152727</nova:name>
Aug 09 07:12:36 user nova-compute[72809]:       <nova:creationTime>2023-08-09 07:12:36</nova:creationTime>
Aug 09 07:12:36 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 07:12:36 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 07:12:36 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 07:12:36 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 07:12:36 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 07:12:36 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 07:12:36 user nova-compute[72809]:       </nova:flavor>
Aug 09 07:12:36 user nova-compute[72809]:       <nova:owner>
Aug 09 07:12:36 user nova-compute[72809]:         <nova:user uuid="b188eb3ed1df40768c24486c0bd06235">tempest-SnapshotDataIntegrityTests-186766721-project-member</nova:user>
Aug 09 07:12:36 user nova-compute[72809]:         <nova:project uuid="f29c65ac1c7649c1bc05bd790821801e">tempest-SnapshotDataIntegrityTests-186766721</nova:project>
Aug 09 07:12:36 user nova-compute[72809]:       </nova:owner>
Aug 09 07:12:36 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 07:12:36 user nova-compute[72809]:       <nova:ports>
Aug 09 07:12:36 user nova-compute[72809]:         <nova:port uuid="4ccb4018-12aa-43f0-95d9-3021c4b8e61e">
Aug 09 07:12:36 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 07:12:36 user nova-compute[72809]:         </nova:port>
Aug 09 07:12:36 user nova-compute[72809]:       </nova:ports>
Aug 09 07:12:36 user nova-compute[72809]:     </nova:instance>
Aug 09 07:12:36 user nova-compute[72809]:   </metadata>
Aug 09 07:12:36 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 07:12:36 user nova-compute[72809]:     <system>
Aug 09 07:12:36 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 07:12:36 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 07:12:36 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 07:12:36 user nova-compute[72809]:       <entry name="serial">91bdefd3-8ab1-43c2-8eb8-06d4b84eb382</entry>
Aug 09 07:12:36 user nova-compute[72809]:       <entry name="uuid">91bdefd3-8ab1-43c2-8eb8-06d4b84eb382</entry>
Aug 09 07:12:36 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 07:12:36 user nova-compute[72809]:     </system>
Aug 09 07:12:36 user nova-compute[72809]:   </sysinfo>
Aug 09 07:12:36 user nova-compute[72809]:   <os>
Aug 09 07:12:36 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 07:12:36 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 07:12:36 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 07:12:36 user nova-compute[72809]:   </os>
Aug 09 07:12:36 user nova-compute[72809]:   <features>
Aug 09 07:12:36 user nova-compute[72809]:     <acpi/>
Aug 09 07:12:36 user nova-compute[72809]:     <apic/>
Aug 09 07:12:36 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 07:12:36 user nova-compute[72809]:   </features>
Aug 09 07:12:36 user nova-compute[72809]:   <clock offset="utc">
Aug 09 07:12:36 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 07:12:36 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 07:12:36 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 07:12:36 user nova-compute[72809]:   </clock>
Aug 09 07:12:36 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 07:12:36 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 07:12:36 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 07:12:36 user nova-compute[72809]:   </cpu>
Aug 09 07:12:36 user nova-compute[72809]:   <devices>
Aug 09 07:12:36 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 07:12:36 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 07:12:36 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk"/>
Aug 09 07:12:36 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 07:12:36 user nova-compute[72809]:     </disk>
Aug 09 07:12:36 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 07:12:36 user nova-compute[72809]:       <mac address="fa:16:3e:3d:dc:e9"/>
Aug 09 07:12:36 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:12:36 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 07:12:36 user nova-compute[72809]:       <target dev="tap4ccb4018-12"/>
Aug 09 07:12:36 user nova-compute[72809]:     </interface>
Aug 09 07:12:36 user nova-compute[72809]:     <serial type="pty">
Aug 09 07:12:36 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/console.log" append="off"/>
Aug 09 07:12:36 user nova-compute[72809]:     </serial>
Aug 09 07:12:36 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 07:12:36 user nova-compute[72809]:     <video>
Aug 09 07:12:36 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:12:36 user nova-compute[72809]:     </video>
Aug 09 07:12:36 user nova-compute[72809]:     <rng model="virtio">
Aug 09 07:12:36 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 07:12:36 user nova-compute[72809]:     </rng>
Aug 09 07:12:36 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 07:12:36 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 07:12:36 user nova-compute[72809]:       <stats period="10"/>
Aug 09 07:12:36 user nova-compute[72809]:     </memballoon>
Aug 09 07:12:36 user nova-compute[72809]:   </devices>
Aug 09 07:12:36 user nova-compute[72809]: </domain>
Aug 09 07:12:36 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-688152727',display_name='tempest-SnapshotDataIntegrityTests-server-688152727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-688152727',id=43,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJ4Fy5Yb+PbuBHKTtUH+j18umyuJ8D5XYxOzU2DEUuC18bQqnnYuSrWq+0U4B4YeCUZ3J1fl9zpO7FCv7Fq+mZEG4KzK1f17jr4MPEl0YdTBVj1LFXD8V3UCtM2gbMtIA==',key_name='tempest-keypair-1083576033',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f29c65ac1c7649c1bc05bd790821801e',ramdisk_id='',reservation_id='r-g82jruwd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-186766721',owner_user_name='tempest-SnapshotDataIntegrityTests-186766721-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:12:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b188eb3ed1df40768c24486c0bd06235',uuid=91bdefd3-8ab1-43c2-8eb8-06d4b84eb382,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ccb4018-12aa-43f0-95d9-3021c4b8e61e", "address": "fa:16:3e:3d:dc:e9", "network": {"id": "1aa93c25-f23b-4acf-83dc-407d71f0284f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2043026175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29c65ac1c7649c1bc05bd790821801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccb4018-12", "ovs_interfaceid": "4ccb4018-12aa-43f0-95d9-3021c4b8e61e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Converting VIF {"id": "4ccb4018-12aa-43f0-95d9-3021c4b8e61e", "address": "fa:16:3e:3d:dc:e9", "network": {"id": "1aa93c25-f23b-4acf-83dc-407d71f0284f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2043026175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29c65ac1c7649c1bc05bd790821801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccb4018-12", "ovs_interfaceid": "4ccb4018-12aa-43f0-95d9-3021c4b8e61e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:dc:e9,bridge_name='br-int',has_traffic_filtering=True,id=4ccb4018-12aa-43f0-95d9-3021c4b8e61e,network=Network(1aa93c25-f23b-4acf-83dc-407d71f0284f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ccb4018-12') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG os_vif [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:dc:e9,bridge_name='br-int',has_traffic_filtering=True,id=4ccb4018-12aa-43f0-95d9-3021c4b8e61e,network=Network(1aa93c25-f23b-4acf-83dc-407d71f0284f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ccb4018-12') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ccb4018-12, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4ccb4018-12, col_values=(('external_ids', {'iface-id': '4ccb4018-12aa-43f0-95d9-3021c4b8e61e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:dc:e9', 'vm-uuid': '91bdefd3-8ab1-43c2-8eb8-06d4b84eb382'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:36 user nova-compute[72809]: INFO os_vif [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:dc:e9,bridge_name='br-int',has_traffic_filtering=True,id=4ccb4018-12aa-43f0-95d9-3021c4b8e61e,network=Network(1aa93c25-f23b-4acf-83dc-407d71f0284f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ccb4018-12')
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] No VIF found with MAC fa:16:3e:3d:dc:e9, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691565141.2866805, 48f0adeb-a5e8-4f81-a534-04c702c272a3 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:12:36 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] VM Stopped (Lifecycle Event)
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.compute.manager [None req-16e7e82b-5485-4586-bcd8-4376120f3d05 None None] [instance: 48f0adeb-a5e8-4f81-a534-04c702c272a3] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.network.neutron [req-7d9d4c50-6763-43ed-a93f-cbf7d8660a00 req-2102bb9a-69d6-4e69-b4b3-ba86ba4cfc67 service nova] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Updated VIF entry in instance network info cache for port 4ccb4018-12aa-43f0-95d9-3021c4b8e61e. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.network.neutron [req-7d9d4c50-6763-43ed-a93f-cbf7d8660a00 req-2102bb9a-69d6-4e69-b4b3-ba86ba4cfc67 service nova] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Updating instance_info_cache with network_info: [{"id": "4ccb4018-12aa-43f0-95d9-3021c4b8e61e", "address": "fa:16:3e:3d:dc:e9", "network": {"id": "1aa93c25-f23b-4acf-83dc-407d71f0284f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2043026175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29c65ac1c7649c1bc05bd790821801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccb4018-12", "ovs_interfaceid": "4ccb4018-12aa-43f0-95d9-3021c4b8e61e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7d9d4c50-6763-43ed-a93f-cbf7d8660a00 req-2102bb9a-69d6-4e69-b4b3-ba86ba4cfc67 service nova] Releasing lock "refresh_cache-91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.network.neutron [None req-a4cbe283-bab3-4957-b4f5-a7e2658e670f tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Updating instance_info_cache with network_info: [{"id": "61cbb890-9a23-4b5a-903c-33d4a8c6e689", "address": "fa:16:3e:a4:4b:39", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cbb890-9a", "ovs_interfaceid": "61cbb890-9a23-4b5a-903c-33d4a8c6e689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a4cbe283-bab3-4957-b4f5-a7e2658e670f tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Releasing lock "refresh_cache-01292d41-c87f-4ab0-8638-4aca44608f91" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG nova.objects.instance [None req-a4cbe283-bab3-4957-b4f5-a7e2658e670f tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lazy-loading 'flavor' on Instance uuid 01292d41-c87f-4ab0-8638-4aca44608f91 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:36 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:37 user nova-compute[72809]: DEBUG nova.compute.manager [req-001d1b70-53dc-44f4-b43a-d717d3348c76 req-7d674966-0e8e-4d60-8b38-b72846de1000 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received event network-vif-unplugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:12:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-001d1b70-53dc-44f4-b43a-d717d3348c76 req-7d674966-0e8e-4d60-8b38-b72846de1000 service nova] Acquiring lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:12:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-001d1b70-53dc-44f4-b43a-d717d3348c76 req-7d674966-0e8e-4d60-8b38-b72846de1000 service nova] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:12:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-001d1b70-53dc-44f4-b43a-d717d3348c76 req-7d674966-0e8e-4d60-8b38-b72846de1000 service nova] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:12:37 user nova-compute[72809]: DEBUG nova.compute.manager [req-001d1b70-53dc-44f4-b43a-d717d3348c76 req-7d674966-0e8e-4d60-8b38-b72846de1000 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] No waiting events found dispatching network-vif-unplugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:12:37 user nova-compute[72809]: WARNING nova.compute.manager [req-001d1b70-53dc-44f4-b43a-d717d3348c76 req-7d674966-0e8e-4d60-8b38-b72846de1000 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received unexpected event network-vif-unplugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 for instance with vm_state rescued and task_state unrescuing.
Aug 09 07:12:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:38 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Instance destroyed successfully.
Aug 09 07:12:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:38 user nova-compute[72809]: DEBUG nova.compute.manager [req-2b575b38-a85a-4ea7-82f9-c6260b63d4be req-6b4bcc2c-9884-4298-8e10-aad14e59c3d3 service nova] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Received event network-vif-plugged-4ccb4018-12aa-43f0-95d9-3021c4b8e61e {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:12:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2b575b38-a85a-4ea7-82f9-c6260b63d4be req-6b4bcc2c-9884-4298-8e10-aad14e59c3d3 service nova] Acquiring lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:12:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2b575b38-a85a-4ea7-82f9-c6260b63d4be req-6b4bcc2c-9884-4298-8e10-aad14e59c3d3 service nova] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:12:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2b575b38-a85a-4ea7-82f9-c6260b63d4be req-6b4bcc2c-9884-4298-8e10-aad14e59c3d3 service nova] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:12:38 user nova-compute[72809]: DEBUG nova.compute.manager [req-2b575b38-a85a-4ea7-82f9-c6260b63d4be req-6b4bcc2c-9884-4298-8e10-aad14e59c3d3 service nova] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] No waiting events found dispatching network-vif-plugged-4ccb4018-12aa-43f0-95d9-3021c4b8e61e {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:12:38 user nova-compute[72809]: WARNING nova.compute.manager [req-2b575b38-a85a-4ea7-82f9-c6260b63d4be req-6b4bcc2c-9884-4298-8e10-aad14e59c3d3 service nova] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Received unexpected event network-vif-plugged-4ccb4018-12aa-43f0-95d9-3021c4b8e61e for instance with vm_state building and task_state spawning.
Aug 09 07:12:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:39 user nova-compute[72809]: DEBUG nova.compute.manager [req-c2cf2990-c200-4e02-9065-53289cc915fe req-7a2bc614-5dab-42ae-8e66-75a697a0d1c6 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received event network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:12:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c2cf2990-c200-4e02-9065-53289cc915fe req-7a2bc614-5dab-42ae-8e66-75a697a0d1c6 service nova] Acquiring lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:12:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c2cf2990-c200-4e02-9065-53289cc915fe req-7a2bc614-5dab-42ae-8e66-75a697a0d1c6 service nova] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:12:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c2cf2990-c200-4e02-9065-53289cc915fe req-7a2bc614-5dab-42ae-8e66-75a697a0d1c6 service nova] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:12:39 user nova-compute[72809]: DEBUG nova.compute.manager [req-c2cf2990-c200-4e02-9065-53289cc915fe req-7a2bc614-5dab-42ae-8e66-75a697a0d1c6 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] No waiting events found dispatching network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:12:39 user nova-compute[72809]: WARNING nova.compute.manager [req-c2cf2990-c200-4e02-9065-53289cc915fe req-7a2bc614-5dab-42ae-8e66-75a697a0d1c6 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received unexpected event network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 for instance with vm_state rescued and task_state unrescuing.
Aug 09 07:12:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0346522d-3d2f-4d51-9e9d-7c554b13bc6b tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:12:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0346522d-3d2f-4d51-9e9d-7c554b13bc6b tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:12:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0346522d-3d2f-4d51-9e9d-7c554b13bc6b tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:12:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0346522d-3d2f-4d51-9e9d-7c554b13bc6b tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:12:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0346522d-3d2f-4d51-9e9d-7c554b13bc6b tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:12:39 user nova-compute[72809]: INFO nova.compute.manager [None req-0346522d-3d2f-4d51-9e9d-7c554b13bc6b tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Terminating instance
Aug 09 07:12:39 user nova-compute[72809]: DEBUG nova.compute.manager [None req-0346522d-3d2f-4d51-9e9d-7c554b13bc6b tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:12:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:40 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:40 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:40 user nova-compute[72809]: DEBUG nova.compute.manager [req-74ec204f-42ae-42e3-8a44-19d0e16e4086 req-5584fd6b-643d-43e8-937c-4bc2d0c937f8 service nova] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Received event network-vif-plugged-4ccb4018-12aa-43f0-95d9-3021c4b8e61e {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:12:40 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-74ec204f-42ae-42e3-8a44-19d0e16e4086 req-5584fd6b-643d-43e8-937c-4bc2d0c937f8 service nova] Acquiring lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:12:40 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-74ec204f-42ae-42e3-8a44-19d0e16e4086 req-5584fd6b-643d-43e8-937c-4bc2d0c937f8 service nova] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:12:40 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-74ec204f-42ae-42e3-8a44-19d0e16e4086 req-5584fd6b-643d-43e8-937c-4bc2d0c937f8 service nova] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:12:40 user nova-compute[72809]: DEBUG nova.compute.manager [req-74ec204f-42ae-42e3-8a44-19d0e16e4086 req-5584fd6b-643d-43e8-937c-4bc2d0c937f8 service nova] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] No waiting events found dispatching network-vif-plugged-4ccb4018-12aa-43f0-95d9-3021c4b8e61e {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:12:40 user nova-compute[72809]: WARNING nova.compute.manager [req-74ec204f-42ae-42e3-8a44-19d0e16e4086 req-5584fd6b-643d-43e8-937c-4bc2d0c937f8 service nova] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Received unexpected event network-vif-plugged-4ccb4018-12aa-43f0-95d9-3021c4b8e61e for instance with vm_state building and task_state spawning.
Aug 09 07:12:40 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:40 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:40 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:40 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:40 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Instance destroyed successfully.
Aug 09 07:12:40 user nova-compute[72809]: DEBUG nova.objects.instance [None req-0346522d-3d2f-4d51-9e9d-7c554b13bc6b tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lazy-loading 'resources' on Instance uuid bebd5a14-6272-4de1-a1a1-4fb45b867c7f {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:12:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-0346522d-3d2f-4d51-9e9d-7c554b13bc6b tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:56:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1180037582',display_name='tempest-ServerRescueNegativeTestJSON-server-1180037582',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1180037582',id=20,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:58:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e75b8536be334abba712e1c6f6886cdf',ramdisk_id='',reservation_id='r-6oy9lqdq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1153742012',owner_user_name='tempest-ServerRescueNegativeTestJSON-1153742012-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:58:13Z,user_data=None,user_id='740071d735364ce5b0e6a7bb0dbdffe3',uuid=bebd5a14-6272-4de1-a1a1-4fb45b867c7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "address": "fa:16:3e:95:65:6f", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c034fd-3a", "ovs_interfaceid": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:12:40 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-0346522d-3d2f-4d51-9e9d-7c554b13bc6b tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Converting VIF {"id": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "address": "fa:16:3e:95:65:6f", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c034fd-3a", "ovs_interfaceid": "f3c034fd-3aaa-4f55-a25a-e5370456135c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:12:40 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-0346522d-3d2f-4d51-9e9d-7c554b13bc6b tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:65:6f,bridge_name='br-int',has_traffic_filtering=True,id=f3c034fd-3aaa-4f55-a25a-e5370456135c,network=Network(fb9ae39b-117a-4cca-8080-683f63e8a318),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3c034fd-3a') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:12:40 user nova-compute[72809]: DEBUG os_vif [None req-0346522d-3d2f-4d51-9e9d-7c554b13bc6b tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:65:6f,bridge_name='br-int',has_traffic_filtering=True,id=f3c034fd-3aaa-4f55-a25a-e5370456135c,network=Network(fb9ae39b-117a-4cca-8080-683f63e8a318),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3c034fd-3a') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:12:40 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:40 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3c034fd-3a, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:12:40 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:40 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:40 user nova-compute[72809]: INFO os_vif [None req-0346522d-3d2f-4d51-9e9d-7c554b13bc6b tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:65:6f,bridge_name='br-int',has_traffic_filtering=True,id=f3c034fd-3aaa-4f55-a25a-e5370456135c,network=Network(fb9ae39b-117a-4cca-8080-683f63e8a318),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3c034fd-3a')
Aug 09 07:12:40 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-0346522d-3d2f-4d51-9e9d-7c554b13bc6b tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Deleting instance files /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f_del
Aug 09 07:12:40 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-0346522d-3d2f-4d51-9e9d-7c554b13bc6b tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Deletion of /opt/stack/data/nova/instances/bebd5a14-6272-4de1-a1a1-4fb45b867c7f_del complete
Aug 09 07:12:40 user nova-compute[72809]: INFO nova.compute.manager [None req-0346522d-3d2f-4d51-9e9d-7c554b13bc6b tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 09 07:12:40 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-0346522d-3d2f-4d51-9e9d-7c554b13bc6b tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:12:40 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:12:40 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG nova.compute.manager [req-6d5103d7-a992-461d-b137-f97283ebd497 req-651eaf52-9fca-42a5-8de3-eca5acb559b4 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received event network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6d5103d7-a992-461d-b137-f97283ebd497 req-651eaf52-9fca-42a5-8de3-eca5acb559b4 service nova] Acquiring lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6d5103d7-a992-461d-b137-f97283ebd497 req-651eaf52-9fca-42a5-8de3-eca5acb559b4 service nova] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6d5103d7-a992-461d-b137-f97283ebd497 req-651eaf52-9fca-42a5-8de3-eca5acb559b4 service nova] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG nova.compute.manager [req-6d5103d7-a992-461d-b137-f97283ebd497 req-651eaf52-9fca-42a5-8de3-eca5acb559b4 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] No waiting events found dispatching network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:12:41 user nova-compute[72809]: WARNING nova.compute.manager [req-6d5103d7-a992-461d-b137-f97283ebd497 req-651eaf52-9fca-42a5-8de3-eca5acb559b4 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received unexpected event network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 for instance with vm_state rescued and task_state unrescuing.
Aug 09 07:12:41 user nova-compute[72809]: DEBUG nova.compute.manager [req-6d5103d7-a992-461d-b137-f97283ebd497 req-651eaf52-9fca-42a5-8de3-eca5acb559b4 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received event network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6d5103d7-a992-461d-b137-f97283ebd497 req-651eaf52-9fca-42a5-8de3-eca5acb559b4 service nova] Acquiring lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6d5103d7-a992-461d-b137-f97283ebd497 req-651eaf52-9fca-42a5-8de3-eca5acb559b4 service nova] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6d5103d7-a992-461d-b137-f97283ebd497 req-651eaf52-9fca-42a5-8de3-eca5acb559b4 service nova] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG nova.compute.manager [req-6d5103d7-a992-461d-b137-f97283ebd497 req-651eaf52-9fca-42a5-8de3-eca5acb559b4 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] No waiting events found dispatching network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:12:41 user nova-compute[72809]: WARNING nova.compute.manager [req-6d5103d7-a992-461d-b137-f97283ebd497 req-651eaf52-9fca-42a5-8de3-eca5acb559b4 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received unexpected event network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 for instance with vm_state rescued and task_state unrescuing.
Aug 09 07:12:41 user nova-compute[72809]: DEBUG nova.compute.manager [req-6d5103d7-a992-461d-b137-f97283ebd497 req-651eaf52-9fca-42a5-8de3-eca5acb559b4 service nova] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Received event network-vif-unplugged-f3c034fd-3aaa-4f55-a25a-e5370456135c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6d5103d7-a992-461d-b137-f97283ebd497 req-651eaf52-9fca-42a5-8de3-eca5acb559b4 service nova] Acquiring lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6d5103d7-a992-461d-b137-f97283ebd497 req-651eaf52-9fca-42a5-8de3-eca5acb559b4 service nova] Lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6d5103d7-a992-461d-b137-f97283ebd497 req-651eaf52-9fca-42a5-8de3-eca5acb559b4 service nova] Lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG nova.compute.manager [req-6d5103d7-a992-461d-b137-f97283ebd497 req-651eaf52-9fca-42a5-8de3-eca5acb559b4 service nova] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] No waiting events found dispatching network-vif-unplugged-f3c034fd-3aaa-4f55-a25a-e5370456135c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG nova.compute.manager [req-6d5103d7-a992-461d-b137-f97283ebd497 req-651eaf52-9fca-42a5-8de3-eca5acb559b4 service nova] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Received event network-vif-unplugged-f3c034fd-3aaa-4f55-a25a-e5370456135c for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG nova.compute.manager [req-6d5103d7-a992-461d-b137-f97283ebd497 req-651eaf52-9fca-42a5-8de3-eca5acb559b4 service nova] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Received event network-vif-plugged-f3c034fd-3aaa-4f55-a25a-e5370456135c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6d5103d7-a992-461d-b137-f97283ebd497 req-651eaf52-9fca-42a5-8de3-eca5acb559b4 service nova] Acquiring lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6d5103d7-a992-461d-b137-f97283ebd497 req-651eaf52-9fca-42a5-8de3-eca5acb559b4 service nova] Lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6d5103d7-a992-461d-b137-f97283ebd497 req-651eaf52-9fca-42a5-8de3-eca5acb559b4 service nova] Lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG nova.compute.manager [req-6d5103d7-a992-461d-b137-f97283ebd497 req-651eaf52-9fca-42a5-8de3-eca5acb559b4 service nova] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] No waiting events found dispatching network-vif-plugged-f3c034fd-3aaa-4f55-a25a-e5370456135c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:12:41 user nova-compute[72809]: WARNING nova.compute.manager [req-6d5103d7-a992-461d-b137-f97283ebd497 req-651eaf52-9fca-42a5-8de3-eca5acb559b4 service nova] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Received unexpected event network-vif-plugged-f3c034fd-3aaa-4f55-a25a-e5370456135c for instance with vm_state rescued and task_state deleting.
Aug 09 07:12:41 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691565161.6702895, 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:12:41 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] VM Resumed (Lifecycle Event)
Aug 09 07:12:41 user nova-compute[72809]: DEBUG nova.compute.manager [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG nova.compute.manager [req-74412d9c-8749-40ab-8891-e4c9e4ab09f7 req-c71bc7a2-26a1-4286-aa63-aecb1934a3a9 service nova] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Received event network-vif-deleted-f3c034fd-3aaa-4f55-a25a-e5370456135c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:12:41 user nova-compute[72809]: INFO nova.compute.manager [req-74412d9c-8749-40ab-8891-e4c9e4ab09f7 req-c71bc7a2-26a1-4286-aa63-aecb1934a3a9 service nova] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Neutron deleted interface f3c034fd-3aaa-4f55-a25a-e5370456135c; detaching it from the instance and deleting it from the info cache
Aug 09 07:12:41 user nova-compute[72809]: DEBUG nova.network.neutron [req-74412d9c-8749-40ab-8891-e4c9e4ab09f7 req-c71bc7a2-26a1-4286-aa63-aecb1934a3a9 service nova] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:12:41 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Instance spawned successfully.
Aug 09 07:12:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG nova.compute.manager [req-74412d9c-8749-40ab-8891-e4c9e4ab09f7 req-c71bc7a2-26a1-4286-aa63-aecb1934a3a9 service nova] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Detach interface failed, port_id=f3c034fd-3aaa-4f55-a25a-e5370456135c, reason: Instance bebd5a14-6272-4de1-a1a1-4fb45b867c7f could not be found. {{(pid=72809) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 07:12:41 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Took 0.95 seconds to deallocate network for instance.
Aug 09 07:12:41 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:12:41 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691565161.6720517, 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:12:41 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] VM Started (Lifecycle Event)
Aug 09 07:12:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-339372ed-140d-4226-ba00-2cc682214d5c" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-339372ed-140d-4226-ba00-2cc682214d5c" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0346522d-3d2f-4d51-9e9d-7c554b13bc6b tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:12:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0346522d-3d2f-4d51-9e9d-7c554b13bc6b tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:12:41 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:12:41 user nova-compute[72809]: INFO nova.compute.manager [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Took 7.62 seconds to spawn the instance on the hypervisor.
Aug 09 07:12:41 user nova-compute[72809]: DEBUG nova.compute.manager [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:12:41 user nova-compute[72809]: INFO nova.compute.manager [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Took 8.35 seconds to build instance.
Aug 09 07:12:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-c0e59f1a-7f12-4ced-af73-6cf89aeb2448 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.445s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:12:42 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Removed pending event for 01292d41-c87f-4ab0-8638-4aca44608f91 due to event {{(pid=72809) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 07:12:42 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691565162.144319, 01292d41-c87f-4ab0-8638-4aca44608f91 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:12:42 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] VM Resumed (Lifecycle Event)
Aug 09 07:12:42 user nova-compute[72809]: DEBUG nova.compute.manager [None req-a4cbe283-bab3-4957-b4f5-a7e2658e670f tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:12:42 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-0346522d-3d2f-4d51-9e9d-7c554b13bc6b tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:12:42 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:12:42 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-0346522d-3d2f-4d51-9e9d-7c554b13bc6b tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:12:42 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:12:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0346522d-3d2f-4d51-9e9d-7c554b13bc6b tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.434s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:12:42 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 07:12:42 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691565162.150321, 01292d41-c87f-4ab0-8638-4aca44608f91 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:12:42 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] VM Started (Lifecycle Event)
Aug 09 07:12:42 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:12:42 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:12:42 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-0346522d-3d2f-4d51-9e9d-7c554b13bc6b tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Deleted allocations for instance bebd5a14-6272-4de1-a1a1-4fb45b867c7f
Aug 09 07:12:42 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Updating instance_info_cache with network_info: [{"id": "b50b65dc-a03d-4f22-bb35-f2b9dc67596d", "address": "fa:16:3e:67:6b:ac", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50b65dc-a0", "ovs_interfaceid": "b50b65dc-a03d-4f22-bb35-f2b9dc67596d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:12:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-339372ed-140d-4226-ba00-2cc682214d5c" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:12:42 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 07:12:42 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:12:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-0346522d-3d2f-4d51-9e9d-7c554b13bc6b tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "bebd5a14-6272-4de1-a1a1-4fb45b867c7f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.599s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:12:43 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:12:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:12:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:12:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:12:43 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 07:12:43 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:12:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:12:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:12:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:12:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:12:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:12:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:12:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:12:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:12:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:12:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:12:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:12:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d29dd60c-2a98-4d47-b11c-67e88bb17dc3/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:12:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d29dd60c-2a98-4d47-b11c-67e88bb17dc3/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:12:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d29dd60c-2a98-4d47-b11c-67e88bb17dc3/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:12:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d29dd60c-2a98-4d47-b11c-67e88bb17dc3/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:12:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:12:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:12:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:12:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:12:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:12:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:12:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:12:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:12:46 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:12:46 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:12:46 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:12:46 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:12:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=7830MB free_disk=24.912105560302734GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 07:12:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:12:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:12:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 1bde423f-0b73-448f-bdce-8d6af96d8fc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:12:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 339372ed-140d-4226-ba00-2cc682214d5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:12:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 466a8e58-5f88-4ffe-a7fd-a346003f3508 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:12:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 6e9996e8-c5eb-42c1-b88f-d75654e160c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:12:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 01292d41-c87f-4ab0-8638-4aca44608f91 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:12:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance d29dd60c-2a98-4d47-b11c-67e88bb17dc3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:12:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance b00766a3-5171-4022-8cb3-77ea9c8c5db6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:12:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:12:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 07:12:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 07:12:46 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:12:46 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:12:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 07:12:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.461s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:12:50 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:50 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:50 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:12:50 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:12:50 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:12:50 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:12:52 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:12:52 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 07:12:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:55 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691565160.651834, bebd5a14-6272-4de1-a1a1-4fb45b867c7f => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:12:55 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] VM Stopped (Lifecycle Event)
Aug 09 07:12:55 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:12:55 user nova-compute[72809]: DEBUG nova.compute.manager [None req-7f604044-b6a7-4b00-932c-5ee9c1335d6c None None] [instance: bebd5a14-6272-4de1-a1a1-4fb45b867c7f] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:12:57 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:12:58 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:12:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:13:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:13:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:13:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:13:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:13:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:13:11 user nova-compute[72809]: DEBUG nova.compute.manager [req-1155861f-e0d9-4f7e-a5c0-bea27732783d req-365a264f-3cbc-42f8-87e9-6505942499b9 service nova] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Received event network-changed-bb24be9c-c2ff-42e7-84ba-2f76b9400db2 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:13:11 user nova-compute[72809]: DEBUG nova.compute.manager [req-1155861f-e0d9-4f7e-a5c0-bea27732783d req-365a264f-3cbc-42f8-87e9-6505942499b9 service nova] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Refreshing instance network info cache due to event network-changed-bb24be9c-c2ff-42e7-84ba-2f76b9400db2. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:13:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1155861f-e0d9-4f7e-a5c0-bea27732783d req-365a264f-3cbc-42f8-87e9-6505942499b9 service nova] Acquiring lock "refresh_cache-d29dd60c-2a98-4d47-b11c-67e88bb17dc3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:13:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1155861f-e0d9-4f7e-a5c0-bea27732783d req-365a264f-3cbc-42f8-87e9-6505942499b9 service nova] Acquired lock "refresh_cache-d29dd60c-2a98-4d47-b11c-67e88bb17dc3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:13:11 user nova-compute[72809]: DEBUG nova.network.neutron [req-1155861f-e0d9-4f7e-a5c0-bea27732783d req-365a264f-3cbc-42f8-87e9-6505942499b9 service nova] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Refreshing network info cache for port bb24be9c-c2ff-42e7-84ba-2f76b9400db2 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:13:12 user nova-compute[72809]: DEBUG nova.network.neutron [req-1155861f-e0d9-4f7e-a5c0-bea27732783d req-365a264f-3cbc-42f8-87e9-6505942499b9 service nova] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Updated VIF entry in instance network info cache for port bb24be9c-c2ff-42e7-84ba-2f76b9400db2. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:13:12 user nova-compute[72809]: DEBUG nova.network.neutron [req-1155861f-e0d9-4f7e-a5c0-bea27732783d req-365a264f-3cbc-42f8-87e9-6505942499b9 service nova] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Updating instance_info_cache with network_info: [{"id": "bb24be9c-c2ff-42e7-84ba-2f76b9400db2", "address": "fa:16:3e:e8:4d:13", "network": {"id": "828c1b8f-947e-450a-b97f-d5b149941ccf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-718683445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9a141f54c4a9da74993125c9c137b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb24be9c-c2", "ovs_interfaceid": "bb24be9c-c2ff-42e7-84ba-2f76b9400db2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:13:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1155861f-e0d9-4f7e-a5c0-bea27732783d req-365a264f-3cbc-42f8-87e9-6505942499b9 service nova] Releasing lock "refresh_cache-d29dd60c-2a98-4d47-b11c-67e88bb17dc3" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:13:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Acquiring lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:13:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:13:12 user nova-compute[72809]: DEBUG nova.objects.instance [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lazy-loading 'flavor' on Instance uuid d29dd60c-2a98-4d47-b11c-67e88bb17dc3 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:13:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:13:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Acquiring lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:13:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:13:12 user nova-compute[72809]: INFO nova.compute.manager [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Attaching volume 3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 to /dev/vdb
Aug 09 07:13:12 user nova-compute[72809]: DEBUG os_brick.utils [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:13:12 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:12 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:12 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6640866f-3c30-428c-ae6a-8620be584609]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:12 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:12 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:12 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0e518c-46e1-416e-b137-e7d1b4160497]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:12 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:12 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:12 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3d97ba-452f-480d-9d36-c5777fe7af45]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:12 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbb0e3a-d3d4-43f8-84aa-628c505fc623]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:12 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:12 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:13:12 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 07:13:12 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:12 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:13:12 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 07:13:12 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[866ff0ac-6d3c-4246-be02-8dba23fb15f9]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:12 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 07:13:12 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 07:13:12 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 07:13:12 user nova-compute[72809]: DEBUG os_brick.utils [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:13:12 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Updating existing volume attachment record: 67c95948-8c54-4bab-a707-f4236b40af46 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 07:13:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:13:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:13:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:13:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:13:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:13:20 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:13:20 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EUlHfjxJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:13:21 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:13:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:13:21 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:13:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:13:21 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 07:13:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b4e83b-5068-4515-884b-4a1e971d5af2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 07:13:21 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0e126c-8d34-43ef-ab5b-277a8d37128e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0] added
Aug 09 07:13:21 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d792f16-5427-4064-b650-80a9c5e4ba1e]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[210b2e51-ed03-41bf-bea2-bf67c9e98340]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EUlHfjxJ {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EUlHfjxJ" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad414f7f-7abf-4d72-ad2b-69edb0bbfc1d]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EUlHfjxJ'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1cd371-fcb5-4496-b473-1b301b31dff2]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83af4ee-c661-4428-83d7-5b9151fc3d23]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:13:21 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:13:21 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:13:21 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:13:21 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1473fb-87d1-4520-b05d-dcc46b39458d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0, portal: 172.16.0.220,3260]
Aug 09 07:13:21 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0, portal: 172.16.0.220,3260] successful.
Aug 09 07:13:21 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb02e09-c329-4c84-9a25-752bd4646a5d]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3173c636-9bd0-42a5-aeff-6928dcbfe478]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:13:21 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:13:21 user nova-compute[72809]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 (non-flash)
Aug 09 07:13:21 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:13:21 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:13:21 user nova-compute[72809]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 (non-flash)
Aug 09 07:13:21 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d6efe1-b16d-4077-9408-ce4c3eba66ff]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:13:21 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EUlHfjxJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 07:13:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:13:22 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23130643335303966', 'path': '/dev/sdd'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:13:22 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130643335303966', 'path': '/dev/sdd'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 07:13:22 user nova-compute[72809]: DEBUG nova.objects.instance [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lazy-loading 'flavor' on Instance uuid d29dd60c-2a98-4d47-b11c-67e88bb17dc3 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:13:22 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 07:13:22 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:13:22 user nova-compute[72809]:   <source dev="/dev/sdd"/>
Aug 09 07:13:22 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:13:22 user nova-compute[72809]:   <serial>3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0</serial>
Aug 09 07:13:22 user nova-compute[72809]: </disk>
Aug 09 07:13:22 user nova-compute[72809]:  {{(pid=72809) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 07:13:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:13:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:13:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] No VIF found with MAC fa:16:3e:e8:4d:13, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:13:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-26d661a7-3aee-4a08-bd80-e5fe588e5065 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.692s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:13:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:13:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Acquiring lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:13:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:13:26 user nova-compute[72809]: DEBUG nova.objects.instance [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lazy-loading 'flavor' on Instance uuid d29dd60c-2a98-4d47-b11c-67e88bb17dc3 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:13:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:13:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Acquiring lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:13:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:13:26 user nova-compute[72809]: INFO nova.compute.manager [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Attaching volume 37250295-178a-43c1-979a-31e194d66345 to /dev/vdc
Aug 09 07:13:26 user nova-compute[72809]: DEBUG os_brick.utils [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:13:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:26 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa51d1e4-5b09-432f-9c5e-535a0557d189]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:26 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f3c3a4-01aa-4386-af2f-64aeb190751f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:26 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a264adf8-ff86-444a-be88-7a5ae35153c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:26 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6c3ab8-3d4b-4314-acb7-f801e6f5214b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:13:26 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 07:13:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:13:26 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 07:13:26 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e68da80-a240-4f7f-8900-0e049ccb0555]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:26 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 07:13:26 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 07:13:26 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 07:13:26 user nova-compute[72809]: DEBUG os_brick.utils [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:13:26 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Updating existing volume attachment record: ac5ee3a5-a604-43b5-a11c-8d2f840b27d4 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 07:13:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:13:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-976987da-e0ec-4be9-bcd3-b907397dcc5d tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:13:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-976987da-e0ec-4be9-bcd3-b907397dcc5d tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:13:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-976987da-e0ec-4be9-bcd3-b907397dcc5d tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:13:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-976987da-e0ec-4be9-bcd3-b907397dcc5d tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:13:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-976987da-e0ec-4be9-bcd3-b907397dcc5d tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:13:30 user nova-compute[72809]: INFO nova.compute.manager [None req-976987da-e0ec-4be9-bcd3-b907397dcc5d tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Terminating instance
Aug 09 07:13:30 user nova-compute[72809]: DEBUG nova.compute.manager [None req-976987da-e0ec-4be9-bcd3-b907397dcc5d tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:13:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:13:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:13:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:13:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-711b4cf3-38cc-4c32-b7a1-eb762f547e91 req-9960fc57-543b-43aa-b792-94b6d70bed87 service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Received event network-vif-unplugged-81017ed8-c816-4a5d-aa4f-eb16d863571f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:13:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-711b4cf3-38cc-4c32-b7a1-eb762f547e91 req-9960fc57-543b-43aa-b792-94b6d70bed87 service nova] Acquiring lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:13:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-711b4cf3-38cc-4c32-b7a1-eb762f547e91 req-9960fc57-543b-43aa-b792-94b6d70bed87 service nova] Lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:13:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-711b4cf3-38cc-4c32-b7a1-eb762f547e91 req-9960fc57-543b-43aa-b792-94b6d70bed87 service nova] Lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:13:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-711b4cf3-38cc-4c32-b7a1-eb762f547e91 req-9960fc57-543b-43aa-b792-94b6d70bed87 service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] No waiting events found dispatching network-vif-unplugged-81017ed8-c816-4a5d-aa4f-eb16d863571f {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:13:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-711b4cf3-38cc-4c32-b7a1-eb762f547e91 req-9960fc57-543b-43aa-b792-94b6d70bed87 service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Received event network-vif-unplugged-81017ed8-c816-4a5d-aa4f-eb16d863571f for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:13:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:13:31 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Instance destroyed successfully.
Aug 09 07:13:31 user nova-compute[72809]: DEBUG nova.objects.instance [None req-976987da-e0ec-4be9-bcd3-b907397dcc5d tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lazy-loading 'resources' on Instance uuid 1bde423f-0b73-448f-bdce-8d6af96d8fc6 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:13:31 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-976987da-e0ec-4be9-bcd3-b907397dcc5d tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:56:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1321868338',display_name='tempest-ServerRescueNegativeTestJSON-server-1321868338',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1321868338',id=19,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:01:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e75b8536be334abba712e1c6f6886cdf',ramdisk_id='',reservation_id='r-8i7rj3wa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1153742012',owner_user_name='tempest-ServerRescueNegativeTestJSON-1153742012-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:02:59Z,user_data=None,user_id='740071d735364ce5b0e6a7bb0dbdffe3',uuid=1bde423f-0b73-448f-bdce-8d6af96d8fc6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "address": "fa:16:3e:3b:e0:d8", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81017ed8-c8", "ovs_interfaceid": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:13:31 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-976987da-e0ec-4be9-bcd3-b907397dcc5d tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Converting VIF {"id": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "address": "fa:16:3e:3b:e0:d8", "network": {"id": "fb9ae39b-117a-4cca-8080-683f63e8a318", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1538472630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e75b8536be334abba712e1c6f6886cdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81017ed8-c8", "ovs_interfaceid": "81017ed8-c816-4a5d-aa4f-eb16d863571f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:13:31 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-976987da-e0ec-4be9-bcd3-b907397dcc5d tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:e0:d8,bridge_name='br-int',has_traffic_filtering=True,id=81017ed8-c816-4a5d-aa4f-eb16d863571f,network=Network(fb9ae39b-117a-4cca-8080-683f63e8a318),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81017ed8-c8') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:13:31 user nova-compute[72809]: DEBUG os_vif [None req-976987da-e0ec-4be9-bcd3-b907397dcc5d tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:e0:d8,bridge_name='br-int',has_traffic_filtering=True,id=81017ed8-c816-4a5d-aa4f-eb16d863571f,network=Network(fb9ae39b-117a-4cca-8080-683f63e8a318),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81017ed8-c8') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:13:31 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:13:31 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81017ed8-c8, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:13:31 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:13:31 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:13:31 user nova-compute[72809]: INFO os_vif [None req-976987da-e0ec-4be9-bcd3-b907397dcc5d tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:e0:d8,bridge_name='br-int',has_traffic_filtering=True,id=81017ed8-c816-4a5d-aa4f-eb16d863571f,network=Network(fb9ae39b-117a-4cca-8080-683f63e8a318),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81017ed8-c8')
Aug 09 07:13:31 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-976987da-e0ec-4be9-bcd3-b907397dcc5d tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Deleting instance files /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6_del
Aug 09 07:13:31 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-976987da-e0ec-4be9-bcd3-b907397dcc5d tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Deletion of /opt/stack/data/nova/instances/1bde423f-0b73-448f-bdce-8d6af96d8fc6_del complete
Aug 09 07:13:31 user nova-compute[72809]: INFO nova.compute.manager [None req-976987da-e0ec-4be9-bcd3-b907397dcc5d tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 09 07:13:31 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-976987da-e0ec-4be9-bcd3-b907397dcc5d tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:13:31 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:13:31 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:13:31 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:13:31 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Took 0.55 seconds to deallocate network for instance.
Aug 09 07:13:31 user nova-compute[72809]: DEBUG nova.compute.manager [req-6736b4e3-265d-4a0c-94ca-81cfcda49506 req-98720a21-2828-4b15-a4e9-c6e2cbc96e30 service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Received event network-vif-deleted-81017ed8-c816-4a5d-aa4f-eb16d863571f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:13:31 user nova-compute[72809]: INFO nova.compute.manager [req-6736b4e3-265d-4a0c-94ca-81cfcda49506 req-98720a21-2828-4b15-a4e9-c6e2cbc96e30 service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Neutron deleted interface 81017ed8-c816-4a5d-aa4f-eb16d863571f; detaching it from the instance and deleting it from the info cache
Aug 09 07:13:31 user nova-compute[72809]: DEBUG nova.network.neutron [req-6736b4e3-265d-4a0c-94ca-81cfcda49506 req-98720a21-2828-4b15-a4e9-c6e2cbc96e30 service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:13:31 user nova-compute[72809]: DEBUG nova.compute.manager [req-6736b4e3-265d-4a0c-94ca-81cfcda49506 req-98720a21-2828-4b15-a4e9-c6e2cbc96e30 service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Detach interface failed, port_id=81017ed8-c816-4a5d-aa4f-eb16d863571f, reason: Instance 1bde423f-0b73-448f-bdce-8d6af96d8fc6 could not be found. {{(pid=72809) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 07:13:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-976987da-e0ec-4be9-bcd3-b907397dcc5d tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:13:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-976987da-e0ec-4be9-bcd3-b907397dcc5d tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:13:32 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-976987da-e0ec-4be9-bcd3-b907397dcc5d tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:13:32 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-976987da-e0ec-4be9-bcd3-b907397dcc5d tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:13:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-976987da-e0ec-4be9-bcd3-b907397dcc5d tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:13:32 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-976987da-e0ec-4be9-bcd3-b907397dcc5d tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Deleted allocations for instance 1bde423f-0b73-448f-bdce-8d6af96d8fc6
Aug 09 07:13:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-976987da-e0ec-4be9-bcd3-b907397dcc5d tempest-ServerRescueNegativeTestJSON-1153742012 tempest-ServerRescueNegativeTestJSON-1153742012-project-member] Lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.972s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:13:32 user nova-compute[72809]: DEBUG nova.compute.manager [req-bf497708-9402-46a3-b71a-28592c1c9a71 req-478cf952-888b-4976-b624-4b93d7621854 service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Received event network-vif-plugged-81017ed8-c816-4a5d-aa4f-eb16d863571f {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:13:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-bf497708-9402-46a3-b71a-28592c1c9a71 req-478cf952-888b-4976-b624-4b93d7621854 service nova] Acquiring lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:13:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-bf497708-9402-46a3-b71a-28592c1c9a71 req-478cf952-888b-4976-b624-4b93d7621854 service nova] Lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:13:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-bf497708-9402-46a3-b71a-28592c1c9a71 req-478cf952-888b-4976-b624-4b93d7621854 service nova] Lock "1bde423f-0b73-448f-bdce-8d6af96d8fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:13:32 user nova-compute[72809]: DEBUG nova.compute.manager [req-bf497708-9402-46a3-b71a-28592c1c9a71 req-478cf952-888b-4976-b624-4b93d7621854 service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] No waiting events found dispatching network-vif-plugged-81017ed8-c816-4a5d-aa4f-eb16d863571f {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:13:32 user nova-compute[72809]: WARNING nova.compute.manager [req-bf497708-9402-46a3-b71a-28592c1c9a71 req-478cf952-888b-4976-b624-4b93d7621854 service nova] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Received unexpected event network-vif-plugged-81017ed8-c816-4a5d-aa4f-eb16d863571f for instance with vm_state deleted and task_state None.
Aug 09 07:13:36 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:13:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:13:41 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:13:41 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 07:13:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-466a8e58-5f88-4ffe-a7fd-a346003f3508" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:13:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-466a8e58-5f88-4ffe-a7fd-a346003f3508" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:13:41 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 07:13:42 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Updating instance_info_cache with network_info: [{"id": "8a95ff1b-0686-455d-977c-cedac8be3930", "address": "fa:16:3e:42:8d:bd", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a95ff1b-06", "ovs_interfaceid": "8a95ff1b-0686-455d-977c-cedac8be3930", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:13:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-466a8e58-5f88-4ffe-a7fd-a346003f3508" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:13:42 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 07:13:42 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:13:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:13:44 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:13:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:13:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:13:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:13:44 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 07:13:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RgcyQnCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:13:45 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:13:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:13:45 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:13:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:13:45 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345 -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f190792a-5c07-4d2c-a80a-2ed4079c7a5c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 07:13:45 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345 -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78522ec-1b40-4486-a603-41583fdc6254]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345] added
Aug 09 07:13:45 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3505d78e-8d29-4187-930f-1590adc0a6dd]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cab6ae4-22a7-4120-9cb1-a1b45311e58a]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RgcyQnCP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RgcyQnCP" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6d611d-3f78-4f26-8add-1eb2191fea83]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RgcyQnCP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01dff6e-1ff9-491e-b757-b403acd3856b]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[672a6d28-ce74-4b42-a66b-1a6eee53aa41]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:13:45 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:13:45 user nova-compute[72809]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 (non-flash)
Aug 09 07:13:45 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:13:45 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:13:45 user nova-compute[72809]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 (non-flash)
Aug 09 07:13:45 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345 -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[db115e94-4c97-4679-9097-cddf8e282043]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345, portal: 172.16.0.220,3260]
Aug 09 07:13:45 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345, portal: 172.16.0.220,3260] successful.
Aug 09 07:13:45 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc9376a-d1df-44f2-bf38-ff7df525e076]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[29384eee-4e3c-4a63-8218-4cc8e9147dec]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:13:45 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:13:45 user nova-compute[72809]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 (non-flash)
Aug 09 07:13:45 user nova-compute[72809]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345 (non-flash)
Aug 09 07:13:45 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:13:45 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:13:45 user nova-compute[72809]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 (non-flash)
Aug 09 07:13:45 user nova-compute[72809]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345 (non-flash)
Aug 09 07:13:45 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] HCTL ('36', '-', '-', 0) found on session 44 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c9037f-7292-41c9-8c7e-693a3c41e57e]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RgcyQnCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d29dd60c-2a98-4d47-b11c-67e88bb17dc3/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d29dd60c-2a98-4d47-b11c-67e88bb17dc3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d29dd60c-2a98-4d47-b11c-67e88bb17dc3/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d29dd60c-2a98-4d47-b11c-67e88bb17dc3/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:46 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:13:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:46 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691565211.1552184, 1bde423f-0b73-448f-bdce-8d6af96d8fc6 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:13:46 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] VM Stopped (Lifecycle Event)
Aug 09 07:13:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:13:46 user nova-compute[72809]: DEBUG nova.compute.manager [None req-a569f41a-25d2-43dd-9332-5612ae2349eb None None] [instance: 1bde423f-0b73-448f-bdce-8d6af96d8fc6] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:13:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:46 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:13:46 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:13:46 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:13:46 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '23264343936386539', 'path': '/dev/sde'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:13:46 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264343936386539', 'path': '/dev/sde'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 07:13:46 user nova-compute[72809]: DEBUG nova.objects.instance [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lazy-loading 'flavor' on Instance uuid d29dd60c-2a98-4d47-b11c-67e88bb17dc3 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:13:46 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 07:13:46 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:13:46 user nova-compute[72809]:   <source dev="/dev/sde"/>
Aug 09 07:13:46 user nova-compute[72809]:   <target dev="vdc" bus="virtio"/>
Aug 09 07:13:46 user nova-compute[72809]:   <serial>37250295-178a-43c1-979a-31e194d66345</serial>
Aug 09 07:13:46 user nova-compute[72809]: </disk>
Aug 09 07:13:46 user nova-compute[72809]:  {{(pid=72809) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 07:13:46 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:13:47 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:13:47 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=7838MB free_disk=24.885372161865234GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 07:13:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:13:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:13:47 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 339372ed-140d-4226-ba00-2cc682214d5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:13:47 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 466a8e58-5f88-4ffe-a7fd-a346003f3508 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:13:47 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 6e9996e8-c5eb-42c1-b88f-d75654e160c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:13:47 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 01292d41-c87f-4ab0-8638-4aca44608f91 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:13:47 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance d29dd60c-2a98-4d47-b11c-67e88bb17dc3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:13:47 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance b00766a3-5171-4022-8cb3-77ea9c8c5db6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:13:47 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:13:47 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 07:13:47 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 07:13:47 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:13:47 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:13:47 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 07:13:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.395s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:13:47 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:13:47 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:13:47 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:13:47 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] No VIF found with MAC fa:16:3e:e8:4d:13, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:13:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-df6dd47b-ecbf-4d07-9cbe-d235070e538e tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.905s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:13:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Acquiring lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:13:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:13:48 user nova-compute[72809]: INFO nova.compute.manager [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Detaching volume 37250295-178a-43c1-979a-31e194d66345
Aug 09 07:13:48 user nova-compute[72809]: INFO nova.virt.block_device [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Attempting to driver detach volume 37250295-178a-43c1-979a-31e194d66345 from mountpoint /dev/vdc
Aug 09 07:13:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Attempting to detach device vdc from instance d29dd60c-2a98-4d47-b11c-67e88bb17dc3 from the persistent domain config. {{(pid=72809) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 07:13:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:13:48 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:13:48 user nova-compute[72809]:   <source dev="/dev/sde"/>
Aug 09 07:13:48 user nova-compute[72809]:   <target dev="vdc" bus="virtio"/>
Aug 09 07:13:48 user nova-compute[72809]:   <serial>37250295-178a-43c1-979a-31e194d66345</serial>
Aug 09 07:13:48 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 07:13:48 user nova-compute[72809]: </disk>
Aug 09 07:13:48 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:13:48 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Successfully detached device vdc from instance d29dd60c-2a98-4d47-b11c-67e88bb17dc3 from the persistent domain config.
Aug 09 07:13:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance d29dd60c-2a98-4d47-b11c-67e88bb17dc3 from the live domain config. {{(pid=72809) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 07:13:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:13:48 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:13:48 user nova-compute[72809]:   <source dev="/dev/sde"/>
Aug 09 07:13:48 user nova-compute[72809]:   <target dev="vdc" bus="virtio"/>
Aug 09 07:13:48 user nova-compute[72809]:   <serial>37250295-178a-43c1-979a-31e194d66345</serial>
Aug 09 07:13:48 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 07:13:48 user nova-compute[72809]: </disk>
Aug 09 07:13:48 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:13:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Received event <DeviceRemovedEvent: 1691565228.9661558, d29dd60c-2a98-4d47-b11c-67e88bb17dc3 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72809) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 07:13:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance d29dd60c-2a98-4d47-b11c-67e88bb17dc3 {{(pid=72809) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 07:13:48 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Successfully detached device vdc from instance d29dd60c-2a98-4d47-b11c-67e88bb17dc3 from the live domain config.
Aug 09 07:13:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:13:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RgcyQnCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:13:48 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:13:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:13:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:13:48 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:13:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17d86d8-1b51-436e-b4ef-c7b259268760]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebd8a79-d2a3-4903-8d15-e7ed9f2ead2e]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:13:49 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:13:49 user nova-compute[72809]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 (non-flash)
Aug 09 07:13:49 user nova-compute[72809]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345 (non-flash)
Aug 09 07:13:49 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:13:49 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:13:49 user nova-compute[72809]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 (non-flash)
Aug 09 07:13:49 user nova-compute[72809]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345 (non-flash)
Aug 09 07:13:49 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc15832bf40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345'): ({'sde'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Removing single pathed devices sde {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0a7b14-1f26-4a95-ae5f-70c274af5461]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a68d502-7b40-4b83-9c2f-70ab1047eff9]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Flushing IO for device /dev/sde {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b0eefe-f049-4009-bdd7-10cad0257512]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55742a4-cec0-468a-abda-2d99d6893421]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] SCSI volumes sde have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[faba9853-5747-4538-a0b9-c80e61459e8c]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345 -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a691c04-e9e1-4f7c-9fe8-8f3609940181]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345, portal: 172.16.0.220,3260]
Aug 09 07:13:49 user nova-compute[72809]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345, portal: 172.16.0.220,3260] successful.
Aug 09 07:13:49 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345 -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37250295-178a-43c1-979a-31e194d66345 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2775782e-409f-4450-a18d-71198c57b4ef]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] <== disconnect_volume: return (307ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:13:49 user nova-compute[72809]: DEBUG nova.objects.instance [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lazy-loading 'flavor' on Instance uuid b00766a3-5171-4022-8cb3-77ea9c8c5db6 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:13:50 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.242s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:13:50 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:13:50 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:13:50 user nova-compute[72809]: INFO nova.compute.manager [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Attaching volume 2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 to /dev/vdb
Aug 09 07:13:50 user nova-compute[72809]: DEBUG os_brick.utils [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:13:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:50 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19ac85d-be10-4f9c-86ae-9eaa18c05fa2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:50 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecae77c-4efb-4074-9734-97f0c0551be9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:13:50 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d38e1c1-adde-4b19-8423-f9c6b1f602fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:50 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8823443-2e88-4f4e-aa38-a9ac5544893e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:13:50 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 07:13:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:13:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:13:50 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 07:13:50 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb9e240-abdd-4271-bcc9-c212bb8a0974]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:13:50 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 07:13:50 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 07:13:50 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 07:13:50 user nova-compute[72809]: DEBUG os_brick.utils [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:13:50 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Updating existing volume attachment record: 1c3f7e40-2e3d-4821-96b8-c7efdf487dcd {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 07:13:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:13:51 user nova-compute[72809]: DEBUG nova.objects.instance [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lazy-loading 'flavor' on Instance uuid d29dd60c-2a98-4d47-b11c-67e88bb17dc3 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:13:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-e3d181ac-62bb-4fae-8706-0259daef3c34 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.004s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:13:52 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:13:52 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:13:52 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:13:52 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:13:53 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:13:53 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 07:13:56 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:13:57 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:14:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMqIHPRk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:14:03 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:14:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:14:03 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:14:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:14:03 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 07:14:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c2cc3d-3f31-4d9c-ab21-be7ef1d7da26]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 07:14:03 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1526a5-e9c8-49e4-8b57-316d3ce55fd0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5] added
Aug 09 07:14:03 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9292380-2c1f-4379-862d-37aa8e5830be]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2355cab1-8849-4082-a093-31011bde1cb5]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QMqIHPRk {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QMqIHPRk" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecda4868-6b20-4afa-b26e-6ce5d9dc5b0d]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QMqIHPRk'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7547dc-30a4-4ee5-bfcb-db93ec0ba94a]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5da7c30-8733-437b-bb4c-af6a512cc3a5]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:14:03 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:14:03 user nova-compute[72809]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 (non-flash)
Aug 09 07:14:03 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:14:03 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:14:03 user nova-compute[72809]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 (non-flash)
Aug 09 07:14:03 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[409164ea-bf53-41f4-8e22-89dcf914be2d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5, portal: 172.16.0.220,3260]
Aug 09 07:14:03 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5, portal: 172.16.0.220,3260] successful.
Aug 09 07:14:03 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[70535f0c-9140-4124-92c4-a8fffba4f1e1]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbfcb27-1348-4ae4-aa4c-0c0ca3a693dc]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:14:03 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:14:03 user nova-compute[72809]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 (non-flash)
Aug 09 07:14:03 user nova-compute[72809]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)
Aug 09 07:14:03 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:14:03 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:14:03 user nova-compute[72809]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 (non-flash)
Aug 09 07:14:03 user nova-compute[72809]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)
Aug 09 07:14:03 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] HCTL ('36', '-', '-', 0) found on session 45 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3293eb6-6a9d-4df8-950b-e2a5ccfc658f]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:14:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMqIHPRk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 07:14:04 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:14:04 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23164356431613466', 'path': '/dev/sde'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:14:04 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164356431613466', 'path': '/dev/sde'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 07:14:04 user nova-compute[72809]: DEBUG nova.objects.instance [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lazy-loading 'flavor' on Instance uuid b00766a3-5171-4022-8cb3-77ea9c8c5db6 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:14:04 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 07:14:04 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:14:04 user nova-compute[72809]:   <source dev="/dev/sde"/>
Aug 09 07:14:04 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:14:04 user nova-compute[72809]:   <serial>2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5</serial>
Aug 09 07:14:04 user nova-compute[72809]: </disk>
Aug 09 07:14:04 user nova-compute[72809]:  {{(pid=72809) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 07:14:04 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:14:04 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:14:04 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] No VIF found with MAC fa:16:3e:46:ed:75, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:14:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-55a0e612-860e-4328-9b0e-1aa6029aa546 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.078s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:14:06 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:11 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:15 user nova-compute[72809]: DEBUG nova.compute.manager [req-e4dbb67f-b9a5-4a03-8302-2cb3311e2344 req-f64634a6-6585-4ce1-bf83-387001773f64 service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Received event network-changed-7319b474-9cbb-4012-992b-b6e41c507433 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:14:15 user nova-compute[72809]: DEBUG nova.compute.manager [req-e4dbb67f-b9a5-4a03-8302-2cb3311e2344 req-f64634a6-6585-4ce1-bf83-387001773f64 service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Refreshing instance network info cache due to event network-changed-7319b474-9cbb-4012-992b-b6e41c507433. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:14:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e4dbb67f-b9a5-4a03-8302-2cb3311e2344 req-f64634a6-6585-4ce1-bf83-387001773f64 service nova] Acquiring lock "refresh_cache-b00766a3-5171-4022-8cb3-77ea9c8c5db6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:14:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e4dbb67f-b9a5-4a03-8302-2cb3311e2344 req-f64634a6-6585-4ce1-bf83-387001773f64 service nova] Acquired lock "refresh_cache-b00766a3-5171-4022-8cb3-77ea9c8c5db6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:14:15 user nova-compute[72809]: DEBUG nova.network.neutron [req-e4dbb67f-b9a5-4a03-8302-2cb3311e2344 req-f64634a6-6585-4ce1-bf83-387001773f64 service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Refreshing network info cache for port 7319b474-9cbb-4012-992b-b6e41c507433 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:14:16 user nova-compute[72809]: DEBUG nova.network.neutron [req-e4dbb67f-b9a5-4a03-8302-2cb3311e2344 req-f64634a6-6585-4ce1-bf83-387001773f64 service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Updated VIF entry in instance network info cache for port 7319b474-9cbb-4012-992b-b6e41c507433. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:14:16 user nova-compute[72809]: DEBUG nova.network.neutron [req-e4dbb67f-b9a5-4a03-8302-2cb3311e2344 req-f64634a6-6585-4ce1-bf83-387001773f64 service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Updating instance_info_cache with network_info: [{"id": "7319b474-9cbb-4012-992b-b6e41c507433", "address": "fa:16:3e:46:ed:75", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7319b474-9c", "ovs_interfaceid": "7319b474-9cbb-4012-992b-b6e41c507433", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:14:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e4dbb67f-b9a5-4a03-8302-2cb3311e2344 req-f64634a6-6585-4ce1-bf83-387001773f64 service nova] Releasing lock "refresh_cache-b00766a3-5171-4022-8cb3-77ea9c8c5db6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:14:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:17 user nova-compute[72809]: DEBUG nova.compute.manager [req-4b4f463a-abcb-43d3-adfe-c0a1b1b96571 req-e3a12da1-688b-4e6d-b06a-267d15d31f9e service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Received event network-changed-7319b474-9cbb-4012-992b-b6e41c507433 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:14:17 user nova-compute[72809]: DEBUG nova.compute.manager [req-4b4f463a-abcb-43d3-adfe-c0a1b1b96571 req-e3a12da1-688b-4e6d-b06a-267d15d31f9e service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Refreshing instance network info cache due to event network-changed-7319b474-9cbb-4012-992b-b6e41c507433. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:14:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-4b4f463a-abcb-43d3-adfe-c0a1b1b96571 req-e3a12da1-688b-4e6d-b06a-267d15d31f9e service nova] Acquiring lock "refresh_cache-b00766a3-5171-4022-8cb3-77ea9c8c5db6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:14:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-4b4f463a-abcb-43d3-adfe-c0a1b1b96571 req-e3a12da1-688b-4e6d-b06a-267d15d31f9e service nova] Acquired lock "refresh_cache-b00766a3-5171-4022-8cb3-77ea9c8c5db6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:14:17 user nova-compute[72809]: DEBUG nova.network.neutron [req-4b4f463a-abcb-43d3-adfe-c0a1b1b96571 req-e3a12da1-688b-4e6d-b06a-267d15d31f9e service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Refreshing network info cache for port 7319b474-9cbb-4012-992b-b6e41c507433 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:14:18 user nova-compute[72809]: DEBUG nova.network.neutron [req-4b4f463a-abcb-43d3-adfe-c0a1b1b96571 req-e3a12da1-688b-4e6d-b06a-267d15d31f9e service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Updated VIF entry in instance network info cache for port 7319b474-9cbb-4012-992b-b6e41c507433. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:14:18 user nova-compute[72809]: DEBUG nova.network.neutron [req-4b4f463a-abcb-43d3-adfe-c0a1b1b96571 req-e3a12da1-688b-4e6d-b06a-267d15d31f9e service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Updating instance_info_cache with network_info: [{"id": "7319b474-9cbb-4012-992b-b6e41c507433", "address": "fa:16:3e:46:ed:75", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7319b474-9c", "ovs_interfaceid": "7319b474-9cbb-4012-992b-b6e41c507433", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:14:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-4b4f463a-abcb-43d3-adfe-c0a1b1b96571 req-e3a12da1-688b-4e6d-b06a-267d15d31f9e service nova] Releasing lock "refresh_cache-b00766a3-5171-4022-8cb3-77ea9c8c5db6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:14:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:21 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:14:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:14:22 user nova-compute[72809]: INFO nova.compute.manager [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Rebooting instance
Aug 09 07:14:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "refresh_cache-b00766a3-5171-4022-8cb3-77ea9c8c5db6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:14:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquired lock "refresh_cache-b00766a3-5171-4022-8cb3-77ea9c8c5db6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:14:22 user nova-compute[72809]: DEBUG nova.network.neutron [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:14:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:23 user nova-compute[72809]: DEBUG nova.network.neutron [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Updating instance_info_cache with network_info: [{"id": "7319b474-9cbb-4012-992b-b6e41c507433", "address": "fa:16:3e:46:ed:75", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7319b474-9c", "ovs_interfaceid": "7319b474-9cbb-4012-992b-b6e41c507433", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:14:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Releasing lock "refresh_cache-b00766a3-5171-4022-8cb3-77ea9c8c5db6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:14:23 user nova-compute[72809]: DEBUG nova.compute.manager [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:14:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG nova.compute.manager [req-45494de0-aafa-4b7d-a1de-c8960ab5f721 req-d9d83c67-fd03-4183-bc50-580f616962df service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Received event network-vif-unplugged-7319b474-9cbb-4012-992b-b6e41c507433 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-45494de0-aafa-4b7d-a1de-c8960ab5f721 req-d9d83c67-fd03-4183-bc50-580f616962df service nova] Acquiring lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-45494de0-aafa-4b7d-a1de-c8960ab5f721 req-d9d83c67-fd03-4183-bc50-580f616962df service nova] Lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-45494de0-aafa-4b7d-a1de-c8960ab5f721 req-d9d83c67-fd03-4183-bc50-580f616962df service nova] Lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG nova.compute.manager [req-45494de0-aafa-4b7d-a1de-c8960ab5f721 req-d9d83c67-fd03-4183-bc50-580f616962df service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] No waiting events found dispatching network-vif-unplugged-7319b474-9cbb-4012-992b-b6e41c507433 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:14:24 user nova-compute[72809]: WARNING nova.compute.manager [req-45494de0-aafa-4b7d-a1de-c8960ab5f721 req-d9d83c67-fd03-4183-bc50-580f616962df service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Received unexpected event network-vif-unplugged-7319b474-9cbb-4012-992b-b6e41c507433 for instance with vm_state active and task_state reboot_started_hard.
Aug 09 07:14:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:24 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Instance destroyed successfully.
Aug 09 07:14:24 user nova-compute[72809]: DEBUG nova.objects.instance [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lazy-loading 'resources' on Instance uuid b00766a3-5171-4022-8cb3-77ea9c8c5db6 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:11:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-275542902',display_name='tempest-TestMinimumBasicScenario-server-275542902',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-275542902',id=42,image_ref='69804617-2d9d-4732-9fa3-a2e99341612f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL66oBtNaPzlMlbKOWSTNg47DcXATsR8KBT9Ay3EFhkFcRH3fzS+FojTgaNiLQ7xi0/BINtV7FyabX+JzG2grwDO2Ln+2KY2fSwekJmdD/VuoBWBGR5Q8FWtvVx4WLi/MQ==',key_name='tempest-TestMinimumBasicScenario-838682356',keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:12:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96695e79164d4b9d836be01cad13efd8',ramdisk_id='',reservation_id='r-a2twhv46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='69804617-2d9d-4732-9fa3-a2e99341612f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1810598523',owner_user_name='tempest-TestMinimumBasicScenario-1810598523-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:14:24Z,user_data=None,user_id='ed97d2c12b4b408cb1ab70dc60b2170d',uuid=b00766a3-5171-4022-8cb3-77ea9c8c5db6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7319b474-9cbb-4012-992b-b6e41c507433", "address": "fa:16:3e:46:ed:75", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7319b474-9c", "ovs_interfaceid": "7319b474-9cbb-4012-992b-b6e41c507433", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Converting VIF {"id": "7319b474-9cbb-4012-992b-b6e41c507433", "address": "fa:16:3e:46:ed:75", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7319b474-9c", "ovs_interfaceid": "7319b474-9cbb-4012-992b-b6e41c507433", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:ed:75,bridge_name='br-int',has_traffic_filtering=True,id=7319b474-9cbb-4012-992b-b6e41c507433,network=Network(0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7319b474-9c') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG os_vif [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:ed:75,bridge_name='br-int',has_traffic_filtering=True,id=7319b474-9cbb-4012-992b-b6e41c507433,network=Network(0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7319b474-9c') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7319b474-9c, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:24 user nova-compute[72809]: INFO os_vif [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:ed:75,bridge_name='br-int',has_traffic_filtering=True,id=7319b474-9cbb-4012-992b-b6e41c507433,network=Network(0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7319b474-9c')
Aug 09 07:14:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMqIHPRk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:14:24 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:14:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[654a5cd1-fc0e-43ee-b95c-701372a505a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d5b537-b87c-4de3-a0b8-5e6b0fc8026b]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:14:24 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:14:24 user nova-compute[72809]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 (non-flash)
Aug 09 07:14:24 user nova-compute[72809]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)
Aug 09 07:14:24 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:14:24 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:14:24 user nova-compute[72809]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 (non-flash)
Aug 09 07:14:24 user nova-compute[72809]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)
Aug 09 07:14:24 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc1386ccee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5'): ({'sde'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Removing single pathed devices sde {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b518a7f-8471-48fb-b814-adf0f072bcc8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94a1a82-39de-473a-be40-6909afa63720]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Flushing IO for device /dev/sde {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65124d4-2276-4577-9afa-7d633d4f7c82]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc9e0eb-813f-4c21-aae6-149f2a6f6353]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] SCSI volumes sde have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ea06f5-9744-4640-a1c3-b4a18e4fa0b9]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.099s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d56bd7c-b846-4dfc-a805-372e02abdbd0]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5, portal: 172.16.0.220,3260]
Aug 09 07:14:24 user nova-compute[72809]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5, portal: 172.16.0.220,3260] successful.
Aug 09 07:14:24 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab51855-191e-48a0-96f9-663b9addae1d]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] <== disconnect_volume: return (343ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Start _get_guest_xml network_info=[{"id": "7319b474-9cbb-4012-992b-b6e41c507433", "address": "fa:16:3e:46:ed:75", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7319b474-9c", "ovs_interfaceid": "7319b474-9cbb-4012-992b-b6e41c507433", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=69804617-2d9d-4732-9fa3-a2e99341612f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '69804617-2d9d-4732-9fa3-a2e99341612f'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMqIHPRk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'b00766a3-5171-4022-8cb3-77ea9c8c5db6', 'attached_at': '', 'detached_at': '', 'volume_id': '2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5', 'serial': '2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': None, 'attachment_id': '1c3f7e40-2e3d-4821-96b8-c7efdf487dcd', 'volume_type': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 07:14:24 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:14:24 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:14:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=69804617-2d9d-4732-9fa3-a2e99341612f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG nova.objects.instance [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lazy-loading 'vcpu_model' on Instance uuid b00766a3-5171-4022-8cb3-77ea9c8c5db6 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMqIHPRk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:14:24 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:14:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:14:24 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:14:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:14:24 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9638599d-12ff-4c73-9c5b-3ceb272eeae6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 07:14:24 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d5f1cb-d746-416b-ab79-960685bc1483]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5] added
Aug 09 07:14:24 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG nova.compute.manager [req-eac87984-2134-4bfa-8d22-92c253cd346b req-382445fa-dba7-4f89-a19e-f503db6fa818 service nova] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Received event network-changed-4ccb4018-12aa-43f0-95d9-3021c4b8e61e {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG nova.compute.manager [req-eac87984-2134-4bfa-8d22-92c253cd346b req-382445fa-dba7-4f89-a19e-f503db6fa818 service nova] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Refreshing instance network info cache due to event network-changed-4ccb4018-12aa-43f0-95d9-3021c4b8e61e. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-eac87984-2134-4bfa-8d22-92c253cd346b req-382445fa-dba7-4f89-a19e-f503db6fa818 service nova] Acquiring lock "refresh_cache-91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-eac87984-2134-4bfa-8d22-92c253cd346b req-382445fa-dba7-4f89-a19e-f503db6fa818 service nova] Acquired lock "refresh_cache-91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG nova.network.neutron [req-eac87984-2134-4bfa-8d22-92c253cd346b req-382445fa-dba7-4f89-a19e-f503db6fa818 service nova] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Refreshing network info cache for port 4ccb4018-12aa-43f0-95d9-3021c4b8e61e {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a6a939-93e0-4c58-9f7f-b39f7227c577]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fa81dc-67b7-48d4-bfcf-e8fc6b07298d]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QMqIHPRk {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QMqIHPRk" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[613b9e29-f02a-4de6-8928-96400ec5833d]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QMqIHPRk'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:14:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[de24c711-c9e5-427b-9044-d73a390218c9]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:14:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb77f297-0ab5-47f8-9a26-320eb8c3bad6]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:14:25 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:14:25 user nova-compute[72809]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 (non-flash)
Aug 09 07:14:25 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:14:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:14:25 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:14:25 user nova-compute[72809]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 (non-flash)
Aug 09 07:14:25 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:14:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bdf1ce-a366-4866-9405-b7c4aa69c37d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5, portal: 172.16.0.220,3260]
Aug 09 07:14:25 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5, portal: 172.16.0.220,3260] successful.
Aug 09 07:14:25 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:14:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c0da43-99da-43ad-8ab8-8723775e3272]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:14:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a9228c-e802-4cdd-8a88-b93a83bc09aa]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:14:25 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:14:25 user nova-compute[72809]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 (non-flash)
Aug 09 07:14:25 user nova-compute[72809]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)
Aug 09 07:14:25 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:14:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:14:25 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:14:25 user nova-compute[72809]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 (non-flash)
Aug 09 07:14:25 user nova-compute[72809]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)
Aug 09 07:14:25 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:14:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:14:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 07:14:25 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] HCTL ('36', '-', '-', 0) found on session 46 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 07:14:25 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 07:14:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12db23a-1f0d-43a4-815f-946e86ae112c]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:25 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:14:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMqIHPRk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 07:14:25 user nova-compute[72809]: DEBUG nova.network.neutron [req-eac87984-2134-4bfa-8d22-92c253cd346b req-382445fa-dba7-4f89-a19e-f503db6fa818 service nova] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Updated VIF entry in instance network info cache for port 4ccb4018-12aa-43f0-95d9-3021c4b8e61e. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:14:25 user nova-compute[72809]: DEBUG nova.network.neutron [req-eac87984-2134-4bfa-8d22-92c253cd346b req-382445fa-dba7-4f89-a19e-f503db6fa818 service nova] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Updating instance_info_cache with network_info: [{"id": "4ccb4018-12aa-43f0-95d9-3021c4b8e61e", "address": "fa:16:3e:3d:dc:e9", "network": {"id": "1aa93c25-f23b-4acf-83dc-407d71f0284f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2043026175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29c65ac1c7649c1bc05bd790821801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccb4018-12", "ovs_interfaceid": "4ccb4018-12aa-43f0-95d9-3021c4b8e61e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:14:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-eac87984-2134-4bfa-8d22-92c253cd346b req-382445fa-dba7-4f89-a19e-f503db6fa818 service nova] Releasing lock "refresh_cache-91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:14:26 user nova-compute[72809]: DEBUG nova.compute.manager [req-35a05021-276e-48c7-8368-1e7cc1fd3787 req-97b672d8-d409-4416-9f1f-8de7a4d3372b service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Received event network-vif-plugged-7319b474-9cbb-4012-992b-b6e41c507433 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:14:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-35a05021-276e-48c7-8368-1e7cc1fd3787 req-97b672d8-d409-4416-9f1f-8de7a4d3372b service nova] Acquiring lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:14:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-35a05021-276e-48c7-8368-1e7cc1fd3787 req-97b672d8-d409-4416-9f1f-8de7a4d3372b service nova] Lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:14:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-35a05021-276e-48c7-8368-1e7cc1fd3787 req-97b672d8-d409-4416-9f1f-8de7a4d3372b service nova] Lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:14:26 user nova-compute[72809]: DEBUG nova.compute.manager [req-35a05021-276e-48c7-8368-1e7cc1fd3787 req-97b672d8-d409-4416-9f1f-8de7a4d3372b service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] No waiting events found dispatching network-vif-plugged-7319b474-9cbb-4012-992b-b6e41c507433 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:14:26 user nova-compute[72809]: WARNING nova.compute.manager [req-35a05021-276e-48c7-8368-1e7cc1fd3787 req-97b672d8-d409-4416-9f1f-8de7a4d3372b service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Received unexpected event network-vif-plugged-7319b474-9cbb-4012-992b-b6e41c507433 for instance with vm_state active and task_state reboot_started_hard.
Aug 09 07:14:26 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:14:26 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23164356431613466', 'path': '/dev/sde'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:14:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164356431613466', 'path': '/dev/sde'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 07:14:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:11:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-275542902',display_name='tempest-TestMinimumBasicScenario-server-275542902',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-275542902',id=42,image_ref='69804617-2d9d-4732-9fa3-a2e99341612f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL66oBtNaPzlMlbKOWSTNg47DcXATsR8KBT9Ay3EFhkFcRH3fzS+FojTgaNiLQ7xi0/BINtV7FyabX+JzG2grwDO2Ln+2KY2fSwekJmdD/VuoBWBGR5Q8FWtvVx4WLi/MQ==',key_name='tempest-TestMinimumBasicScenario-838682356',keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:12:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96695e79164d4b9d836be01cad13efd8',ramdisk_id='',reservation_id='r-a2twhv46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='69804617-2d9d-4732-9fa3-a2e99341612f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1810598523',owner_user_name='tempest-TestMinimumBasicScenario-1810598523-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:14:24Z,user_data=None,user_id='ed97d2c12b4b408cb1ab70dc60b2170d',uuid=b00766a3-5171-4022-8cb3-77ea9c8c5db6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7319b474-9cbb-4012-992b-b6e41c507433", "address": "fa:16:3e:46:ed:75", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7319b474-9c", "ovs_interfaceid": "7319b474-9cbb-4012-992b-b6e41c507433", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 07:14:26 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Converting VIF {"id": "7319b474-9cbb-4012-992b-b6e41c507433", "address": "fa:16:3e:46:ed:75", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7319b474-9c", "ovs_interfaceid": "7319b474-9cbb-4012-992b-b6e41c507433", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:14:26 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:ed:75,bridge_name='br-int',has_traffic_filtering=True,id=7319b474-9cbb-4012-992b-b6e41c507433,network=Network(0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7319b474-9c') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:14:26 user nova-compute[72809]: DEBUG nova.objects.instance [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lazy-loading 'pci_devices' on Instance uuid b00766a3-5171-4022-8cb3-77ea9c8c5db6 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:14:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] End _get_guest_xml xml=<domain type="kvm">
Aug 09 07:14:26 user nova-compute[72809]:   <uuid>b00766a3-5171-4022-8cb3-77ea9c8c5db6</uuid>
Aug 09 07:14:26 user nova-compute[72809]:   <name>instance-0000002a</name>
Aug 09 07:14:26 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 07:14:26 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 07:14:26 user nova-compute[72809]:   <metadata>
Aug 09 07:14:26 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 07:14:26 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 07:14:26 user nova-compute[72809]:       <nova:name>tempest-TestMinimumBasicScenario-server-275542902</nova:name>
Aug 09 07:14:26 user nova-compute[72809]:       <nova:creationTime>2023-08-09 07:14:24</nova:creationTime>
Aug 09 07:14:26 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 07:14:26 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 07:14:26 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 07:14:26 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 07:14:26 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 07:14:26 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 07:14:26 user nova-compute[72809]:       </nova:flavor>
Aug 09 07:14:26 user nova-compute[72809]:       <nova:owner>
Aug 09 07:14:26 user nova-compute[72809]:         <nova:user uuid="ed97d2c12b4b408cb1ab70dc60b2170d">tempest-TestMinimumBasicScenario-1810598523-project-member</nova:user>
Aug 09 07:14:26 user nova-compute[72809]:         <nova:project uuid="96695e79164d4b9d836be01cad13efd8">tempest-TestMinimumBasicScenario-1810598523</nova:project>
Aug 09 07:14:26 user nova-compute[72809]:       </nova:owner>
Aug 09 07:14:26 user nova-compute[72809]:       <nova:root type="image" uuid="69804617-2d9d-4732-9fa3-a2e99341612f"/>
Aug 09 07:14:26 user nova-compute[72809]:       <nova:ports>
Aug 09 07:14:26 user nova-compute[72809]:         <nova:port uuid="7319b474-9cbb-4012-992b-b6e41c507433">
Aug 09 07:14:26 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 07:14:26 user nova-compute[72809]:         </nova:port>
Aug 09 07:14:26 user nova-compute[72809]:       </nova:ports>
Aug 09 07:14:26 user nova-compute[72809]:     </nova:instance>
Aug 09 07:14:26 user nova-compute[72809]:   </metadata>
Aug 09 07:14:26 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 07:14:26 user nova-compute[72809]:     <system>
Aug 09 07:14:26 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 07:14:26 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 07:14:26 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 07:14:26 user nova-compute[72809]:       <entry name="serial">b00766a3-5171-4022-8cb3-77ea9c8c5db6</entry>
Aug 09 07:14:26 user nova-compute[72809]:       <entry name="uuid">b00766a3-5171-4022-8cb3-77ea9c8c5db6</entry>
Aug 09 07:14:26 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 07:14:26 user nova-compute[72809]:     </system>
Aug 09 07:14:26 user nova-compute[72809]:   </sysinfo>
Aug 09 07:14:26 user nova-compute[72809]:   <os>
Aug 09 07:14:26 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 07:14:26 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 07:14:26 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 07:14:26 user nova-compute[72809]:   </os>
Aug 09 07:14:26 user nova-compute[72809]:   <features>
Aug 09 07:14:26 user nova-compute[72809]:     <acpi/>
Aug 09 07:14:26 user nova-compute[72809]:     <apic/>
Aug 09 07:14:26 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 07:14:26 user nova-compute[72809]:   </features>
Aug 09 07:14:26 user nova-compute[72809]:   <clock offset="utc">
Aug 09 07:14:26 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 07:14:26 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 07:14:26 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 07:14:26 user nova-compute[72809]:   </clock>
Aug 09 07:14:26 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 07:14:26 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 07:14:26 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 07:14:26 user nova-compute[72809]:   </cpu>
Aug 09 07:14:26 user nova-compute[72809]:   <devices>
Aug 09 07:14:26 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 07:14:26 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 07:14:26 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk"/>
Aug 09 07:14:26 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 07:14:26 user nova-compute[72809]:     </disk>
Aug 09 07:14:26 user nova-compute[72809]:     <disk type="block" device="disk">
Aug 09 07:14:26 user nova-compute[72809]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:14:26 user nova-compute[72809]:       <source dev="/dev/sde"/>
Aug 09 07:14:26 user nova-compute[72809]:       <target dev="vdb" bus="virtio"/>
Aug 09 07:14:26 user nova-compute[72809]:       <serial>2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5</serial>
Aug 09 07:14:26 user nova-compute[72809]:     </disk>
Aug 09 07:14:26 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 07:14:26 user nova-compute[72809]:       <mac address="fa:16:3e:46:ed:75"/>
Aug 09 07:14:26 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:14:26 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 07:14:26 user nova-compute[72809]:       <target dev="tap7319b474-9c"/>
Aug 09 07:14:26 user nova-compute[72809]:     </interface>
Aug 09 07:14:26 user nova-compute[72809]:     <serial type="pty">
Aug 09 07:14:26 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/console.log" append="off"/>
Aug 09 07:14:26 user nova-compute[72809]:     </serial>
Aug 09 07:14:26 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 07:14:26 user nova-compute[72809]:     <video>
Aug 09 07:14:26 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:14:26 user nova-compute[72809]:     </video>
Aug 09 07:14:26 user nova-compute[72809]:     <rng model="virtio">
Aug 09 07:14:26 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 07:14:26 user nova-compute[72809]:     </rng>
Aug 09 07:14:26 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 07:14:26 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 07:14:26 user nova-compute[72809]:       <stats period="10"/>
Aug 09 07:14:26 user nova-compute[72809]:     </memballoon>
Aug 09 07:14:26 user nova-compute[72809]:   </devices>
Aug 09 07:14:26 user nova-compute[72809]: </domain>
Aug 09 07:14:26 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 07:14:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:14:26 user nova-compute[72809]: DEBUG nova.objects.instance [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lazy-loading 'trusted_certs' on Instance uuid b00766a3-5171-4022-8cb3-77ea9c8c5db6 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:14:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cf4d3cb6079987eb7a29e77c813afd5eb8d35d6 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1cf4d3cb6079987eb7a29e77c813afd5eb8d35d6 --force-share --output=json" returned: 0 in 0.153s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:26 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 07:14:26 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:27 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Cannot resize image /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 07:14:27 user nova-compute[72809]: DEBUG nova.objects.instance [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lazy-loading 'migration_context' on Instance uuid b00766a3-5171-4022-8cb3-77ea9c8c5db6 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:14:27 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:11:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-275542902',display_name='tempest-TestMinimumBasicScenario-server-275542902',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-275542902',id=42,image_ref='69804617-2d9d-4732-9fa3-a2e99341612f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL66oBtNaPzlMlbKOWSTNg47DcXATsR8KBT9Ay3EFhkFcRH3fzS+FojTgaNiLQ7xi0/BINtV7FyabX+JzG2grwDO2Ln+2KY2fSwekJmdD/VuoBWBGR5Q8FWtvVx4WLi/MQ==',key_name='tempest-TestMinimumBasicScenario-838682356',keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:12:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='96695e79164d4b9d836be01cad13efd8',ramdisk_id='',reservation_id='r-a2twhv46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='69804617-2d9d-4732-9fa3-a2e99341612f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1810598523',owner_user_name='tempest-TestMinimumBasicScenario-1810598523-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:14:24Z,user_data=None,user_id='ed97d2c12b4b408cb1ab70dc60b2170d',uuid=b00766a3-5171-4022-8cb3-77ea9c8c5db6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7319b474-9cbb-4012-992b-b6e41c507433", "address": "fa:16:3e:46:ed:75", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7319b474-9c", "ovs_interfaceid": "7319b474-9cbb-4012-992b-b6e41c507433", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 07:14:27 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Converting VIF {"id": "7319b474-9cbb-4012-992b-b6e41c507433", "address": "fa:16:3e:46:ed:75", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7319b474-9c", "ovs_interfaceid": "7319b474-9cbb-4012-992b-b6e41c507433", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:14:27 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:ed:75,bridge_name='br-int',has_traffic_filtering=True,id=7319b474-9cbb-4012-992b-b6e41c507433,network=Network(0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7319b474-9c') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:14:27 user nova-compute[72809]: DEBUG os_vif [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:ed:75,bridge_name='br-int',has_traffic_filtering=True,id=7319b474-9cbb-4012-992b-b6e41c507433,network=Network(0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7319b474-9c') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 07:14:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:14:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 07:14:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7319b474-9c, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:14:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7319b474-9c, col_values=(('external_ids', {'iface-id': '7319b474-9cbb-4012-992b-b6e41c507433', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:ed:75', 'vm-uuid': 'b00766a3-5171-4022-8cb3-77ea9c8c5db6'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:14:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:14:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:27 user nova-compute[72809]: INFO os_vif [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:ed:75,bridge_name='br-int',has_traffic_filtering=True,id=7319b474-9cbb-4012-992b-b6e41c507433,network=Network(0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7319b474-9c')
Aug 09 07:14:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "01292d41-c87f-4ab0-8638-4aca44608f91" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:14:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "01292d41-c87f-4ab0-8638-4aca44608f91" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:14:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:14:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:14:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:14:27 user nova-compute[72809]: INFO nova.compute.manager [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Terminating instance
Aug 09 07:14:27 user nova-compute[72809]: DEBUG nova.compute.manager [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:14:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:27 user nova-compute[72809]: DEBUG nova.compute.manager [req-2333cc17-6821-472f-8594-14f288a6f1ee req-779be5fd-7fa3-4c0a-859f-130860335fd7 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received event network-vif-unplugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:14:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2333cc17-6821-472f-8594-14f288a6f1ee req-779be5fd-7fa3-4c0a-859f-130860335fd7 service nova] Acquiring lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:14:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2333cc17-6821-472f-8594-14f288a6f1ee req-779be5fd-7fa3-4c0a-859f-130860335fd7 service nova] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:14:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2333cc17-6821-472f-8594-14f288a6f1ee req-779be5fd-7fa3-4c0a-859f-130860335fd7 service nova] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:14:27 user nova-compute[72809]: DEBUG nova.compute.manager [req-2333cc17-6821-472f-8594-14f288a6f1ee req-779be5fd-7fa3-4c0a-859f-130860335fd7 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] No waiting events found dispatching network-vif-unplugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:14:27 user nova-compute[72809]: DEBUG nova.compute.manager [req-2333cc17-6821-472f-8594-14f288a6f1ee req-779be5fd-7fa3-4c0a-859f-130860335fd7 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received event network-vif-unplugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:14:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:28 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Instance destroyed successfully.
Aug 09 07:14:28 user nova-compute[72809]: DEBUG nova.objects.instance [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lazy-loading 'resources' on Instance uuid 01292d41-c87f-4ab0-8638-4aca44608f91 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:08:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-538618460',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-538618460',id=39,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:10:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1903437f7ed4c14a0660f64a2e0c647',ramdisk_id='',reservation_id='r-xczy0u8d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-917311946',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:12:42Z,user_data=None,user_id='6c4c5942852b412885a5b4698552058d',uuid=01292d41-c87f-4ab0-8638-4aca44608f91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61cbb890-9a23-4b5a-903c-33d4a8c6e689", "address": "fa:16:3e:a4:4b:39", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cbb890-9a", "ovs_interfaceid": "61cbb890-9a23-4b5a-903c-33d4a8c6e689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Converting VIF {"id": "61cbb890-9a23-4b5a-903c-33d4a8c6e689", "address": "fa:16:3e:a4:4b:39", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cbb890-9a", "ovs_interfaceid": "61cbb890-9a23-4b5a-903c-33d4a8c6e689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:4b:39,bridge_name='br-int',has_traffic_filtering=True,id=61cbb890-9a23-4b5a-903c-33d4a8c6e689,network=Network(5f03b0f9-e80d-428f-b0a6-57158568e620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61cbb890-9a') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG os_vif [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:4b:39,bridge_name='br-int',has_traffic_filtering=True,id=61cbb890-9a23-4b5a-903c-33d4a8c6e689,network=Network(5f03b0f9-e80d-428f-b0a6-57158568e620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61cbb890-9a') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61cbb890-9a, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:28 user nova-compute[72809]: INFO os_vif [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:4b:39,bridge_name='br-int',has_traffic_filtering=True,id=61cbb890-9a23-4b5a-903c-33d4a8c6e689,network=Network(5f03b0f9-e80d-428f-b0a6-57158568e620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61cbb890-9a')
Aug 09 07:14:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EfZOVKhu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:14:28 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:14:28 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[21059bf6-3df3-44d7-a4e3-8f17c891a2fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38bb521-7869-460a-8ee8-80a3d7229b20]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:14:28 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:14:28 user nova-compute[72809]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 (non-flash)
Aug 09 07:14:28 user nova-compute[72809]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)
Aug 09 07:14:28 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:14:28 user nova-compute[72809]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b (non-flash)
Aug 09 07:14:28 user nova-compute[72809]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 (non-flash)
Aug 09 07:14:28 user nova-compute[72809]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)
Aug 09 07:14:28 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc13839f7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b'): ({'sdc'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Removing single pathed devices sdc {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6053b63-4b06-4783-b639-66a2c921ae26]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5649b1fa-656d-436b-85e4-2906342dfcdd]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Flushing IO for device /dev/sdc {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3986fac5-35e1-4af7-86d3-9ce7281ea56f]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[436fbad8-b5b3-47f0-b246-d7b1247eacc4]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] SCSI volumes sdc have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ade622-7ecc-4b8d-9183-ef40c1443350]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c874060-6650-443a-8c2e-d65f57aa9f9c]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b, portal: 172.16.0.220,3260]
Aug 09 07:14:28 user nova-compute[72809]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b, portal: 172.16.0.220,3260] successful.
Aug 09 07:14:28 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:29 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51cc261a-1c80-4a03-8957-14375673184b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:29 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[715643e5-50bb-4b5d-842c-99695519ac2f]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:29 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:14:29 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:14:29 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] <== disconnect_volume: return (376ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:14:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:14:29 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Deleting instance files /opt/stack/data/nova/instances/01292d41-c87f-4ab0-8638-4aca44608f91_del
Aug 09 07:14:29 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Deletion of /opt/stack/data/nova/instances/01292d41-c87f-4ab0-8638-4aca44608f91_del complete
Aug 09 07:14:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:29 user nova-compute[72809]: INFO nova.compute.manager [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Took 1.79 seconds to destroy the instance on the hypervisor.
Aug 09 07:14:29 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:14:29 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:14:29 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:14:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-90ddd064-5a6a-46ff-8e28-0d6c93395f2c req-ec1e7032-fb73-4782-ace7-d80d247d9831 service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Received event network-vif-plugged-7319b474-9cbb-4012-992b-b6e41c507433 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:14:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-90ddd064-5a6a-46ff-8e28-0d6c93395f2c req-ec1e7032-fb73-4782-ace7-d80d247d9831 service nova] Acquiring lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:14:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-90ddd064-5a6a-46ff-8e28-0d6c93395f2c req-ec1e7032-fb73-4782-ace7-d80d247d9831 service nova] Lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:14:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-90ddd064-5a6a-46ff-8e28-0d6c93395f2c req-ec1e7032-fb73-4782-ace7-d80d247d9831 service nova] Lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:14:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-90ddd064-5a6a-46ff-8e28-0d6c93395f2c req-ec1e7032-fb73-4782-ace7-d80d247d9831 service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] No waiting events found dispatching network-vif-plugged-7319b474-9cbb-4012-992b-b6e41c507433 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:14:29 user nova-compute[72809]: WARNING nova.compute.manager [req-90ddd064-5a6a-46ff-8e28-0d6c93395f2c req-ec1e7032-fb73-4782-ace7-d80d247d9831 service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Received unexpected event network-vif-plugged-7319b474-9cbb-4012-992b-b6e41c507433 for instance with vm_state active and task_state reboot_started_hard.
Aug 09 07:14:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:14:30 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Took 0.91 seconds to deallocate network for instance.
Aug 09 07:14:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-28151536-378f-4e6e-bdd2-677e22a724b7 req-52abfd71-e415-452d-8a86-355c180aa152 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received event network-vif-deleted-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquiring lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG nova.objects.instance [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lazy-loading 'flavor' on Instance uuid 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-1090d3f4-eeea-460c-89d2-55ee088d6c3b req-8c0cf4dd-8c65-489a-9885-1d37f8246819 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received event network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1090d3f4-eeea-460c-89d2-55ee088d6c3b req-8c0cf4dd-8c65-489a-9885-1d37f8246819 service nova] Acquiring lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1090d3f4-eeea-460c-89d2-55ee088d6c3b req-8c0cf4dd-8c65-489a-9885-1d37f8246819 service nova] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1090d3f4-eeea-460c-89d2-55ee088d6c3b req-8c0cf4dd-8c65-489a-9885-1d37f8246819 service nova] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-1090d3f4-eeea-460c-89d2-55ee088d6c3b req-8c0cf4dd-8c65-489a-9885-1d37f8246819 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] No waiting events found dispatching network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:14:30 user nova-compute[72809]: WARNING nova.compute.manager [req-1090d3f4-eeea-460c-89d2-55ee088d6c3b req-8c0cf4dd-8c65-489a-9885-1d37f8246819 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received unexpected event network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 for instance with vm_state active and task_state deleting.
Aug 09 07:14:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-1090d3f4-eeea-460c-89d2-55ee088d6c3b req-8c0cf4dd-8c65-489a-9885-1d37f8246819 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received event network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1090d3f4-eeea-460c-89d2-55ee088d6c3b req-8c0cf4dd-8c65-489a-9885-1d37f8246819 service nova] Acquiring lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1090d3f4-eeea-460c-89d2-55ee088d6c3b req-8c0cf4dd-8c65-489a-9885-1d37f8246819 service nova] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1090d3f4-eeea-460c-89d2-55ee088d6c3b req-8c0cf4dd-8c65-489a-9885-1d37f8246819 service nova] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-1090d3f4-eeea-460c-89d2-55ee088d6c3b req-8c0cf4dd-8c65-489a-9885-1d37f8246819 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] No waiting events found dispatching network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:14:30 user nova-compute[72809]: WARNING nova.compute.manager [req-1090d3f4-eeea-460c-89d2-55ee088d6c3b req-8c0cf4dd-8c65-489a-9885-1d37f8246819 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received unexpected event network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 for instance with vm_state active and task_state deleting.
Aug 09 07:14:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-1090d3f4-eeea-460c-89d2-55ee088d6c3b req-8c0cf4dd-8c65-489a-9885-1d37f8246819 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received event network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1090d3f4-eeea-460c-89d2-55ee088d6c3b req-8c0cf4dd-8c65-489a-9885-1d37f8246819 service nova] Acquiring lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1090d3f4-eeea-460c-89d2-55ee088d6c3b req-8c0cf4dd-8c65-489a-9885-1d37f8246819 service nova] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1090d3f4-eeea-460c-89d2-55ee088d6c3b req-8c0cf4dd-8c65-489a-9885-1d37f8246819 service nova] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-1090d3f4-eeea-460c-89d2-55ee088d6c3b req-8c0cf4dd-8c65-489a-9885-1d37f8246819 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] No waiting events found dispatching network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:14:30 user nova-compute[72809]: WARNING nova.compute.manager [req-1090d3f4-eeea-460c-89d2-55ee088d6c3b req-8c0cf4dd-8c65-489a-9885-1d37f8246819 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received unexpected event network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 for instance with vm_state active and task_state deleting.
Aug 09 07:14:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-1090d3f4-eeea-460c-89d2-55ee088d6c3b req-8c0cf4dd-8c65-489a-9885-1d37f8246819 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received event network-vif-unplugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1090d3f4-eeea-460c-89d2-55ee088d6c3b req-8c0cf4dd-8c65-489a-9885-1d37f8246819 service nova] Acquiring lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1090d3f4-eeea-460c-89d2-55ee088d6c3b req-8c0cf4dd-8c65-489a-9885-1d37f8246819 service nova] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1090d3f4-eeea-460c-89d2-55ee088d6c3b req-8c0cf4dd-8c65-489a-9885-1d37f8246819 service nova] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-1090d3f4-eeea-460c-89d2-55ee088d6c3b req-8c0cf4dd-8c65-489a-9885-1d37f8246819 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] No waiting events found dispatching network-vif-unplugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG nova.compute.manager [req-1090d3f4-eeea-460c-89d2-55ee088d6c3b req-8c0cf4dd-8c65-489a-9885-1d37f8246819 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received event network-vif-unplugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquiring lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:14:30 user nova-compute[72809]: INFO nova.compute.manager [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Attaching volume 1d73bd00-803d-40bf-8e31-6fe4414883fb to /dev/vdb
Aug 09 07:14:30 user nova-compute[72809]: DEBUG os_brick.utils [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54d06ad-6c24-45b1-9c8c-adec31bdef37]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a927dc7e-ecdf-4107-8a65-a63ef9bfce13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df661bc-3b7d-44a7-a755-e8f3ecdfbf9e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5115f44a-b905-450b-8772-5469b565943d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:14:30 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 07:14:30 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e26e4d6-27dc-44e6-8e50-fa96ab79f0db]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG os_brick.utils [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:14:30 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Updating existing volume attachment record: 16945b19-30dd-40cc-9e51-8b469f2c0061 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 07:14:30 user nova-compute[72809]: INFO nova.compute.manager [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Took 0.91 seconds to detach 1 volumes for instance.
Aug 09 07:14:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:14:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:14:31 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:14:31 user nova-compute[72809]: DEBUG nova.compute.manager [req-4b2acddd-68e7-434f-9e46-e9a7a2d8d9b4 req-043e7503-1a3a-4cdb-b17b-196ea60eebeb service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Received event network-vif-plugged-7319b474-9cbb-4012-992b-b6e41c507433 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:14:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-4b2acddd-68e7-434f-9e46-e9a7a2d8d9b4 req-043e7503-1a3a-4cdb-b17b-196ea60eebeb service nova] Acquiring lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:14:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-4b2acddd-68e7-434f-9e46-e9a7a2d8d9b4 req-043e7503-1a3a-4cdb-b17b-196ea60eebeb service nova] Lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:14:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-4b2acddd-68e7-434f-9e46-e9a7a2d8d9b4 req-043e7503-1a3a-4cdb-b17b-196ea60eebeb service nova] Lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:14:31 user nova-compute[72809]: DEBUG nova.compute.manager [req-4b2acddd-68e7-434f-9e46-e9a7a2d8d9b4 req-043e7503-1a3a-4cdb-b17b-196ea60eebeb service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] No waiting events found dispatching network-vif-plugged-7319b474-9cbb-4012-992b-b6e41c507433 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:14:31 user nova-compute[72809]: WARNING nova.compute.manager [req-4b2acddd-68e7-434f-9e46-e9a7a2d8d9b4 req-043e7503-1a3a-4cdb-b17b-196ea60eebeb service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Received unexpected event network-vif-plugged-7319b474-9cbb-4012-992b-b6e41c507433 for instance with vm_state active and task_state reboot_started_hard.
Aug 09 07:14:31 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:14:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:14:31 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Deleted allocations for instance 01292d41-c87f-4ab0-8638-4aca44608f91
Aug 09 07:14:31 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Removed pending event for b00766a3-5171-4022-8cb3-77ea9c8c5db6 due to event {{(pid=72809) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 07:14:31 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691565271.4471314, b00766a3-5171-4022-8cb3-77ea9c8c5db6 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:14:31 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] VM Resumed (Lifecycle Event)
Aug 09 07:14:31 user nova-compute[72809]: DEBUG nova.compute.manager [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 07:14:31 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Instance rebooted successfully.
Aug 09 07:14:31 user nova-compute[72809]: DEBUG nova.compute.manager [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:14:31 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:14:31 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:14:31 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 09 07:14:31 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691565271.449195, b00766a3-5171-4022-8cb3-77ea9c8c5db6 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:14:31 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] VM Started (Lifecycle Event)
Aug 09 07:14:31 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:14:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6ee7397d-18ad-4064-a182-3746d4bbe280 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.652s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:14:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-1012f0b2-3786-4324-b37d-90f01c9409c4 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "01292d41-c87f-4ab0-8638-4aca44608f91" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.253s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:14:31 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:14:32 user nova-compute[72809]: DEBUG nova.compute.manager [req-ccbf8010-2229-4fbc-8cae-e5965605af6e req-93e733cd-f4a3-4ecc-91c7-1ff034eafa95 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received event network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:14:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ccbf8010-2229-4fbc-8cae-e5965605af6e req-93e733cd-f4a3-4ecc-91c7-1ff034eafa95 service nova] Acquiring lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:14:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ccbf8010-2229-4fbc-8cae-e5965605af6e req-93e733cd-f4a3-4ecc-91c7-1ff034eafa95 service nova] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:14:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ccbf8010-2229-4fbc-8cae-e5965605af6e req-93e733cd-f4a3-4ecc-91c7-1ff034eafa95 service nova] Lock "01292d41-c87f-4ab0-8638-4aca44608f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:14:32 user nova-compute[72809]: DEBUG nova.compute.manager [req-ccbf8010-2229-4fbc-8cae-e5965605af6e req-93e733cd-f4a3-4ecc-91c7-1ff034eafa95 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] No waiting events found dispatching network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:14:32 user nova-compute[72809]: WARNING nova.compute.manager [req-ccbf8010-2229-4fbc-8cae-e5965605af6e req-93e733cd-f4a3-4ecc-91c7-1ff034eafa95 service nova] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Received unexpected event network-vif-plugged-61cbb890-9a23-4b5a-903c-33d4a8c6e689 for instance with vm_state deleted and task_state None.
Aug 09 07:14:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:34 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Acquiring lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:14:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:14:39 user nova-compute[72809]: INFO nova.compute.manager [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Detaching volume 3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0
Aug 09 07:14:39 user nova-compute[72809]: INFO nova.virt.block_device [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Attempting to driver detach volume 3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 from mountpoint /dev/vdb
Aug 09 07:14:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Attempting to detach device vdb from instance d29dd60c-2a98-4d47-b11c-67e88bb17dc3 from the persistent domain config. {{(pid=72809) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 07:14:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:14:39 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:14:39 user nova-compute[72809]:   <source dev="/dev/sdd"/>
Aug 09 07:14:39 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:14:39 user nova-compute[72809]:   <serial>3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0</serial>
Aug 09 07:14:39 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 07:14:39 user nova-compute[72809]: </disk>
Aug 09 07:14:39 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:14:39 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Successfully detached device vdb from instance d29dd60c-2a98-4d47-b11c-67e88bb17dc3 from the persistent domain config.
Aug 09 07:14:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d29dd60c-2a98-4d47-b11c-67e88bb17dc3 from the live domain config. {{(pid=72809) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 07:14:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:14:39 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:14:39 user nova-compute[72809]:   <source dev="/dev/sdd"/>
Aug 09 07:14:39 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:14:39 user nova-compute[72809]:   <serial>3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0</serial>
Aug 09 07:14:39 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 07:14:39 user nova-compute[72809]: </disk>
Aug 09 07:14:39 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:14:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Received event <DeviceRemovedEvent: 1691565279.7801147, d29dd60c-2a98-4d47-b11c-67e88bb17dc3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72809) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 07:14:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d29dd60c-2a98-4d47-b11c-67e88bb17dc3 {{(pid=72809) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 07:14:39 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Successfully detached device vdb from instance d29dd60c-2a98-4d47-b11c-67e88bb17dc3 from the live domain config.
Aug 09 07:14:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:14:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EUlHfjxJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:14:39 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:14:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:14:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:14:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:14:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[447d8a79-31dc-4e1b-afa0-69175fd9bb3c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 07:14:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZKpNsOMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:14:39 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:14:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:14:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9d24ea-9c9c-440b-a441-fcdfe2f42411]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:14:39 user nova-compute[72809]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 (non-flash)
Aug 09 07:14:39 user nova-compute[72809]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)
Aug 09 07:14:39 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:14:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:14:39 user nova-compute[72809]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 (non-flash)
Aug 09 07:14:39 user nova-compute[72809]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)
Aug 09 07:14:39 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:14:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc1586c03a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0'): ({'sdd'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:14:39 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Removing single pathed devices sdd {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:14:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e47ff6-dd92-4f53-b535-990cac094cb1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f1a3d5-51d6-45e6-94fa-c0430a57ffd8]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:39 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Flushing IO for device /dev/sdd {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:14:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[02097210-730e-4405-9241-4ed1122fa663]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:39 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:14:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7c4910-4d6f-4253-ae4c-ace99f21f245]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] SCSI volumes sdd have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f80c61-4468-454a-ada8-b35494195093]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[38688f46-cb7f-49d5-b62f-a3cabe5b01f2]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0, portal: 172.16.0.220,3260]
Aug 09 07:14:40 user nova-compute[72809]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0, portal: 172.16.0.220,3260] successful.
Aug 09 07:14:40 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8ba5f4-1076-4877-a1b0-d71dcfda9ef0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd436e46-20ae-48bc-9457-023d755cfdb9]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] <== disconnect_volume: return (340ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.272s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:14:40 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:14:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:14:40 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d1c9dd-ba00-4940-b099-2d8ce8639b41]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 07:14:40 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94e6a8e-c300-4c80-b4d4-aa80077c2529]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb] added
Aug 09 07:14:40 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9add8ed8-632b-4bb1-bf59-5dbb2c734363]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a799db-3e57-4f99-9d45-af094ac33726]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZKpNsOMG {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZKpNsOMG" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b963546-0977-44d3-b5c6-3e1b2cbf0445]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZKpNsOMG'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c489d9-4f50-46a0-9d7d-7dfc22cc6788]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b48b53-6277-4a8d-a7cd-1bb67941bf4c]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:14:40 user nova-compute[72809]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)
Aug 09 07:14:40 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:14:40 user nova-compute[72809]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)
Aug 09 07:14:40 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[83560be9-7fef-40c5-8634-2facdee05d20]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb, portal: 172.16.0.220,3260]
Aug 09 07:14:40 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb, portal: 172.16.0.220,3260] successful.
Aug 09 07:14:40 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9c0342-5e35-4a6a-868e-431f52aa356e]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9615a7-4480-4d74-ae88-2a468793f3f5]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:14:40 user nova-compute[72809]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)
Aug 09 07:14:40 user nova-compute[72809]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb (non-flash)
Aug 09 07:14:40 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:14:40 user nova-compute[72809]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)
Aug 09 07:14:40 user nova-compute[72809]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb (non-flash)
Aug 09 07:14:40 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5514500-5d71-48e1-be03-fd14b4f862b2]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:14:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZKpNsOMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 07:14:41 user nova-compute[72809]: DEBUG nova.objects.instance [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lazy-loading 'flavor' on Instance uuid d29dd60c-2a98-4d47-b11c-67e88bb17dc3 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:14:41 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d1619b74-c6e8-4955-b584-2cfe26fee8c0 tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.036s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:14:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:14:41 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] <== connect_volume: return (1643ms) {'type': 'block', 'scsi_wwn': '26363346335353132', 'path': '/dev/sdc'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:14:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363346335353132', 'path': '/dev/sdc'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 07:14:41 user nova-compute[72809]: DEBUG nova.objects.instance [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lazy-loading 'flavor' on Instance uuid 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:14:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 07:14:41 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:14:41 user nova-compute[72809]:   <source dev="/dev/sdc"/>
Aug 09 07:14:41 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:14:41 user nova-compute[72809]:   <serial>1d73bd00-803d-40bf-8e31-6fe4414883fb</serial>
Aug 09 07:14:41 user nova-compute[72809]: </disk>
Aug 09 07:14:41 user nova-compute[72809]:  {{(pid=72809) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 07:14:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:14:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:14:41 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] No VIF found with MAC fa:16:3e:3d:dc:e9, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:14:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4b5b71b0-70b5-4226-8d87-2356e5e529b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.785s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:14:43 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691565268.564135, 01292d41-c87f-4ab0-8638-4aca44608f91 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:14:43 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] VM Stopped (Lifecycle Event)
Aug 09 07:14:43 user nova-compute[72809]: DEBUG nova.compute.manager [None req-eaa75007-39ef-4c62-ac90-6f43a9517b14 None None] [instance: 01292d41-c87f-4ab0-8638-4aca44608f91] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:14:43 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:14:43 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:43 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72809) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 07:14:43 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:14:43 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:14:43 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:43 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:14:43 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 07:14:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-6e9996e8-c5eb-42c1-b88f-d75654e160c5" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:14:43 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-6e9996e8-c5eb-42c1-b88f-d75654e160c5" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:14:43 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 07:14:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:44 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Updating instance_info_cache with network_info: [{"id": "c0891ee7-fd99-4abf-96bd-9389e7032aab", "address": "fa:16:3e:09:83:0c", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0891ee7-fd", "ovs_interfaceid": "c0891ee7-fd99-4abf-96bd-9389e7032aab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:14:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-6e9996e8-c5eb-42c1-b88f-d75654e160c5" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:14:44 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 07:14:44 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:14:44 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:14:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:14:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:14:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:14:44 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 07:14:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:45 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:14:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d29dd60c-2a98-4d47-b11c-67e88bb17dc3/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d29dd60c-2a98-4d47-b11c-67e88bb17dc3/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d29dd60c-2a98-4d47-b11c-67e88bb17dc3/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d29dd60c-2a98-4d47-b11c-67e88bb17dc3/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:14:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:14:46 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:14:46 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:14:46 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:14:46 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:14:47 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=8147MB free_disk=24.87973403930664GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 07:14:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:14:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:14:47 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 339372ed-140d-4226-ba00-2cc682214d5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:14:47 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 466a8e58-5f88-4ffe-a7fd-a346003f3508 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:14:47 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 6e9996e8-c5eb-42c1-b88f-d75654e160c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:14:47 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance d29dd60c-2a98-4d47-b11c-67e88bb17dc3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:14:47 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance b00766a3-5171-4022-8cb3-77ea9c8c5db6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:14:47 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:14:47 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 07:14:47 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 07:14:47 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:14:47 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:14:47 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 07:14:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.486s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:14:47 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:14:47 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Cleaning up deleted instances {{(pid=72809) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 07:14:47 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] There are 0 instances to clean {{(pid=72809) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 07:14:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:53 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:14:53 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:14:53 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:14:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:53 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:14:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:55 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:55 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:14:55 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 07:14:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:58 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:14:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:14:59 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:15:00 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:15:00 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72809) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 07:15:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:03 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:15:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquiring lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:15:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:15:05 user nova-compute[72809]: INFO nova.compute.manager [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Detaching volume 1d73bd00-803d-40bf-8e31-6fe4414883fb
Aug 09 07:15:05 user nova-compute[72809]: INFO nova.virt.block_device [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Attempting to driver detach volume 1d73bd00-803d-40bf-8e31-6fe4414883fb from mountpoint /dev/vdb
Aug 09 07:15:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Attempting to detach device vdb from instance 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 from the persistent domain config. {{(pid=72809) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 07:15:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:15:05 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:15:05 user nova-compute[72809]:   <source dev="/dev/sdc"/>
Aug 09 07:15:05 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:15:05 user nova-compute[72809]:   <serial>1d73bd00-803d-40bf-8e31-6fe4414883fb</serial>
Aug 09 07:15:05 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 07:15:05 user nova-compute[72809]: </disk>
Aug 09 07:15:05 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:15:05 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Successfully detached device vdb from instance 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 from the persistent domain config.
Aug 09 07:15:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 from the live domain config. {{(pid=72809) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 07:15:05 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:15:05 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:15:05 user nova-compute[72809]:   <source dev="/dev/sdc"/>
Aug 09 07:15:05 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:15:05 user nova-compute[72809]:   <serial>1d73bd00-803d-40bf-8e31-6fe4414883fb</serial>
Aug 09 07:15:05 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 07:15:05 user nova-compute[72809]: </disk>
Aug 09 07:15:05 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Received event <DeviceRemovedEvent: 1691565306.3618798, 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72809) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 {{(pid=72809) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 07:15:06 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Successfully detached device vdb from instance 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 from the live domain config.
Aug 09 07:15:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZKpNsOMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:15:06 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:15:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8918824-1f9c-413e-83ad-d2c48f956102]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[207e84c4-ea00-407c-a451-5c5e2e6ed606]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:15:06 user nova-compute[72809]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)
Aug 09 07:15:06 user nova-compute[72809]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb (non-flash)
Aug 09 07:15:06 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:15:06 user nova-compute[72809]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)
Aug 09 07:15:06 user nova-compute[72809]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb (non-flash)
Aug 09 07:15:06 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc1386c5b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb'): ({'sdc'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Removing single pathed devices sdc {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f8aa6a-00ef-4567-9680-9433d29bd2b1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4236fe15-3858-454c-8620-9996be2d8f09]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Flushing IO for device /dev/sdc {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d88514-9d38-48cc-a009-081e23b73f18]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6d6314-bd1f-40ba-96db-2eb3b399901e]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] SCSI volumes sdc have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[410ee470-adc7-4c73-8444-9b485c6bfc86]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24b9813-a7c3-409d-a698-4254fa06ae0a]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb, portal: 172.16.0.220,3260]
Aug 09 07:15:06 user nova-compute[72809]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb, portal: 172.16.0.220,3260] successful.
Aug 09 07:15:06 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d73bd00-803d-40bf-8e31-6fe4414883fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bb1f7c-189a-4245-9ba9-15a289d34eab]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] <== disconnect_volume: return (291ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:15:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:15:07 user nova-compute[72809]: DEBUG nova.objects.instance [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lazy-loading 'flavor' on Instance uuid 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:15:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-13aebc33-0947-46dd-b4a6-060dc34275d7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.783s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:15:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:15 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:15:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8db96ee2-5c4f-4fd7-9f08-e0e3aef03f28 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "6e9996e8-c5eb-42c1-b88f-d75654e160c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:15:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8db96ee2-5c4f-4fd7-9f08-e0e3aef03f28 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "6e9996e8-c5eb-42c1-b88f-d75654e160c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:15:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8db96ee2-5c4f-4fd7-9f08-e0e3aef03f28 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "6e9996e8-c5eb-42c1-b88f-d75654e160c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:15:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8db96ee2-5c4f-4fd7-9f08-e0e3aef03f28 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "6e9996e8-c5eb-42c1-b88f-d75654e160c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:15:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8db96ee2-5c4f-4fd7-9f08-e0e3aef03f28 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "6e9996e8-c5eb-42c1-b88f-d75654e160c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:15:18 user nova-compute[72809]: INFO nova.compute.manager [None req-8db96ee2-5c4f-4fd7-9f08-e0e3aef03f28 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Terminating instance
Aug 09 07:15:18 user nova-compute[72809]: DEBUG nova.compute.manager [None req-8db96ee2-5c4f-4fd7-9f08-e0e3aef03f28 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:15:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:18 user nova-compute[72809]: DEBUG nova.compute.manager [req-3eb1f6be-279e-453c-88a7-cc3c426f18e5 req-00f42bc6-24b5-40cb-80fe-3277e952ffac service nova] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Received event network-vif-unplugged-c0891ee7-fd99-4abf-96bd-9389e7032aab {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:15:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3eb1f6be-279e-453c-88a7-cc3c426f18e5 req-00f42bc6-24b5-40cb-80fe-3277e952ffac service nova] Acquiring lock "6e9996e8-c5eb-42c1-b88f-d75654e160c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:15:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3eb1f6be-279e-453c-88a7-cc3c426f18e5 req-00f42bc6-24b5-40cb-80fe-3277e952ffac service nova] Lock "6e9996e8-c5eb-42c1-b88f-d75654e160c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:15:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3eb1f6be-279e-453c-88a7-cc3c426f18e5 req-00f42bc6-24b5-40cb-80fe-3277e952ffac service nova] Lock "6e9996e8-c5eb-42c1-b88f-d75654e160c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:15:18 user nova-compute[72809]: DEBUG nova.compute.manager [req-3eb1f6be-279e-453c-88a7-cc3c426f18e5 req-00f42bc6-24b5-40cb-80fe-3277e952ffac service nova] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] No waiting events found dispatching network-vif-unplugged-c0891ee7-fd99-4abf-96bd-9389e7032aab {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:15:18 user nova-compute[72809]: DEBUG nova.compute.manager [req-3eb1f6be-279e-453c-88a7-cc3c426f18e5 req-00f42bc6-24b5-40cb-80fe-3277e952ffac service nova] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Received event network-vif-unplugged-c0891ee7-fd99-4abf-96bd-9389e7032aab for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:15:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:18 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Instance destroyed successfully.
Aug 09 07:15:18 user nova-compute[72809]: DEBUG nova.objects.instance [None req-8db96ee2-5c4f-4fd7-9f08-e0e3aef03f28 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lazy-loading 'resources' on Instance uuid 6e9996e8-c5eb-42c1-b88f-d75654e160c5 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:15:18 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-8db96ee2-5c4f-4fd7-9f08-e0e3aef03f28 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:05:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1926053306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1926053306',id=36,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:06:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1903437f7ed4c14a0660f64a2e0c647',ramdisk_id='',reservation_id='r-p904gqch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-917311946',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:07:51Z,user_data=None,user_id='6c4c5942852b412885a5b4698552058d',uuid=6e9996e8-c5eb-42c1-b88f-d75654e160c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0891ee7-fd99-4abf-96bd-9389e7032aab", "address": "fa:16:3e:09:83:0c", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0891ee7-fd", "ovs_interfaceid": "c0891ee7-fd99-4abf-96bd-9389e7032aab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:15:18 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-8db96ee2-5c4f-4fd7-9f08-e0e3aef03f28 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Converting VIF {"id": "c0891ee7-fd99-4abf-96bd-9389e7032aab", "address": "fa:16:3e:09:83:0c", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0891ee7-fd", "ovs_interfaceid": "c0891ee7-fd99-4abf-96bd-9389e7032aab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:15:18 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-8db96ee2-5c4f-4fd7-9f08-e0e3aef03f28 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:83:0c,bridge_name='br-int',has_traffic_filtering=True,id=c0891ee7-fd99-4abf-96bd-9389e7032aab,network=Network(5f03b0f9-e80d-428f-b0a6-57158568e620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0891ee7-fd') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:15:18 user nova-compute[72809]: DEBUG os_vif [None req-8db96ee2-5c4f-4fd7-9f08-e0e3aef03f28 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:83:0c,bridge_name='br-int',has_traffic_filtering=True,id=c0891ee7-fd99-4abf-96bd-9389e7032aab,network=Network(5f03b0f9-e80d-428f-b0a6-57158568e620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0891ee7-fd') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:15:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0891ee7-fd, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:15:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:15:18 user nova-compute[72809]: INFO os_vif [None req-8db96ee2-5c4f-4fd7-9f08-e0e3aef03f28 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:83:0c,bridge_name='br-int',has_traffic_filtering=True,id=c0891ee7-fd99-4abf-96bd-9389e7032aab,network=Network(5f03b0f9-e80d-428f-b0a6-57158568e620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0891ee7-fd')
Aug 09 07:15:18 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-8db96ee2-5c4f-4fd7-9f08-e0e3aef03f28 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Deleting instance files /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5_del
Aug 09 07:15:18 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-8db96ee2-5c4f-4fd7-9f08-e0e3aef03f28 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Deletion of /opt/stack/data/nova/instances/6e9996e8-c5eb-42c1-b88f-d75654e160c5_del complete
Aug 09 07:15:19 user nova-compute[72809]: INFO nova.compute.manager [None req-8db96ee2-5c4f-4fd7-9f08-e0e3aef03f28 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 09 07:15:19 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-8db96ee2-5c4f-4fd7-9f08-e0e3aef03f28 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:15:19 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:15:19 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:15:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "8798d9fd-e562-4acc-b076-0f4a5d56c0a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:15:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "8798d9fd-e562-4acc-b076-0f4a5d56c0a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:15:19 user nova-compute[72809]: DEBUG nova.compute.manager [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 07:15:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:15:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:15:19 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 07:15:19 user nova-compute[72809]: INFO nova.compute.claims [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Claim successful on node user
Aug 09 07:15:19 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:15:19 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Took 0.53 seconds to deallocate network for instance.
Aug 09 07:15:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8db96ee2-5c4f-4fd7-9f08-e0e3aef03f28 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:15:19 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:15:19 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:15:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:15:19 user nova-compute[72809]: DEBUG nova.compute.manager [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 07:15:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8db96ee2-5c4f-4fd7-9f08-e0e3aef03f28 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.253s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:15:19 user nova-compute[72809]: DEBUG nova.compute.manager [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 07:15:19 user nova-compute[72809]: DEBUG nova.network.neutron [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 07:15:19 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 07:15:20 user nova-compute[72809]: DEBUG nova.compute.manager [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 07:15:20 user nova-compute[72809]: INFO nova.virt.block_device [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Booting with volume snapshot 418c0691-8338-4573-8713-baadf96b67d6 at /dev/vda
Aug 09 07:15:20 user nova-compute[72809]: DEBUG nova.policy [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a7859a38408b426eb9a14ef003483bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8241b9b47eab16a6e37a9cc5f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 07:15:20 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-8db96ee2-5c4f-4fd7-9f08-e0e3aef03f28 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:15:20 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-8db96ee2-5c4f-4fd7-9f08-e0e3aef03f28 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:15:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8db96ee2-5c4f-4fd7-9f08-e0e3aef03f28 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:15:20 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-8db96ee2-5c4f-4fd7-9f08-e0e3aef03f28 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Deleted allocations for instance 6e9996e8-c5eb-42c1-b88f-d75654e160c5
Aug 09 07:15:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8db96ee2-5c4f-4fd7-9f08-e0e3aef03f28 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "6e9996e8-c5eb-42c1-b88f-d75654e160c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.095s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:15:20 user nova-compute[72809]: DEBUG nova.compute.manager [req-17e13d55-e33a-4a96-9dc0-73c51415ce71 req-f41f601a-b5cb-4ee2-814d-97e41e16502c service nova] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Received event network-vif-plugged-c0891ee7-fd99-4abf-96bd-9389e7032aab {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:15:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-17e13d55-e33a-4a96-9dc0-73c51415ce71 req-f41f601a-b5cb-4ee2-814d-97e41e16502c service nova] Acquiring lock "6e9996e8-c5eb-42c1-b88f-d75654e160c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:15:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-17e13d55-e33a-4a96-9dc0-73c51415ce71 req-f41f601a-b5cb-4ee2-814d-97e41e16502c service nova] Lock "6e9996e8-c5eb-42c1-b88f-d75654e160c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:15:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-17e13d55-e33a-4a96-9dc0-73c51415ce71 req-f41f601a-b5cb-4ee2-814d-97e41e16502c service nova] Lock "6e9996e8-c5eb-42c1-b88f-d75654e160c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:15:20 user nova-compute[72809]: DEBUG nova.compute.manager [req-17e13d55-e33a-4a96-9dc0-73c51415ce71 req-f41f601a-b5cb-4ee2-814d-97e41e16502c service nova] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] No waiting events found dispatching network-vif-plugged-c0891ee7-fd99-4abf-96bd-9389e7032aab {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:15:20 user nova-compute[72809]: WARNING nova.compute.manager [req-17e13d55-e33a-4a96-9dc0-73c51415ce71 req-f41f601a-b5cb-4ee2-814d-97e41e16502c service nova] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Received unexpected event network-vif-plugged-c0891ee7-fd99-4abf-96bd-9389e7032aab for instance with vm_state deleted and task_state None.
Aug 09 07:15:20 user nova-compute[72809]: DEBUG nova.compute.manager [req-17e13d55-e33a-4a96-9dc0-73c51415ce71 req-f41f601a-b5cb-4ee2-814d-97e41e16502c service nova] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Received event network-vif-deleted-c0891ee7-fd99-4abf-96bd-9389e7032aab {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:15:20 user nova-compute[72809]: DEBUG nova.network.neutron [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Successfully created port: 540e5264-643d-4aa8-8119-ee69542e55af {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 07:15:21 user nova-compute[72809]: DEBUG nova.network.neutron [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Successfully updated port: 540e5264-643d-4aa8-8119-ee69542e55af {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 07:15:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "refresh_cache-8798d9fd-e562-4acc-b076-0f4a5d56c0a6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:15:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquired lock "refresh_cache-8798d9fd-e562-4acc-b076-0f4a5d56c0a6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:15:21 user nova-compute[72809]: DEBUG nova.network.neutron [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:15:21 user nova-compute[72809]: DEBUG nova.network.neutron [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 07:15:21 user nova-compute[72809]: DEBUG nova.network.neutron [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Updating instance_info_cache with network_info: [{"id": "540e5264-643d-4aa8-8119-ee69542e55af", "address": "fa:16:3e:b0:31:61", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e5264-64", "ovs_interfaceid": "540e5264-643d-4aa8-8119-ee69542e55af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:15:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Releasing lock "refresh_cache-8798d9fd-e562-4acc-b076-0f4a5d56c0a6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:15:21 user nova-compute[72809]: DEBUG nova.compute.manager [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Instance network_info: |[{"id": "540e5264-643d-4aa8-8119-ee69542e55af", "address": "fa:16:3e:b0:31:61", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e5264-64", "ovs_interfaceid": "540e5264-643d-4aa8-8119-ee69542e55af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 07:15:22 user nova-compute[72809]: DEBUG nova.compute.manager [req-3ccc4214-ecdc-4498-a7fa-ae3607fe09ca req-a1e22de5-8c0f-428f-88d1-c93d900a8f2a service nova] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Received event network-changed-540e5264-643d-4aa8-8119-ee69542e55af {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:15:22 user nova-compute[72809]: DEBUG nova.compute.manager [req-3ccc4214-ecdc-4498-a7fa-ae3607fe09ca req-a1e22de5-8c0f-428f-88d1-c93d900a8f2a service nova] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Refreshing instance network info cache due to event network-changed-540e5264-643d-4aa8-8119-ee69542e55af. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:15:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3ccc4214-ecdc-4498-a7fa-ae3607fe09ca req-a1e22de5-8c0f-428f-88d1-c93d900a8f2a service nova] Acquiring lock "refresh_cache-8798d9fd-e562-4acc-b076-0f4a5d56c0a6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:15:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3ccc4214-ecdc-4498-a7fa-ae3607fe09ca req-a1e22de5-8c0f-428f-88d1-c93d900a8f2a service nova] Acquired lock "refresh_cache-8798d9fd-e562-4acc-b076-0f4a5d56c0a6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:15:22 user nova-compute[72809]: DEBUG nova.network.neutron [req-3ccc4214-ecdc-4498-a7fa-ae3607fe09ca req-a1e22de5-8c0f-428f-88d1-c93d900a8f2a service nova] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Refreshing network info cache for port 540e5264-643d-4aa8-8119-ee69542e55af {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:15:23 user nova-compute[72809]: DEBUG nova.network.neutron [req-3ccc4214-ecdc-4498-a7fa-ae3607fe09ca req-a1e22de5-8c0f-428f-88d1-c93d900a8f2a service nova] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Updated VIF entry in instance network info cache for port 540e5264-643d-4aa8-8119-ee69542e55af. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:15:23 user nova-compute[72809]: DEBUG nova.network.neutron [req-3ccc4214-ecdc-4498-a7fa-ae3607fe09ca req-a1e22de5-8c0f-428f-88d1-c93d900a8f2a service nova] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Updating instance_info_cache with network_info: [{"id": "540e5264-643d-4aa8-8119-ee69542e55af", "address": "fa:16:3e:b0:31:61", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e5264-64", "ovs_interfaceid": "540e5264-643d-4aa8-8119-ee69542e55af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:15:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3ccc4214-ecdc-4498-a7fa-ae3607fe09ca req-a1e22de5-8c0f-428f-88d1-c93d900a8f2a service nova] Releasing lock "refresh_cache-8798d9fd-e562-4acc-b076-0f4a5d56c0a6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:15:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:25 user nova-compute[72809]: DEBUG os_brick.utils [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:15:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:15:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:15:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91d088f-e864-44b3-8ce0-82a0f1b8e1f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:15:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:15:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:15:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[10681ab1-fafc-454f-b46f-f2d7f6fd7712]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:15:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:15:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:15:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[178a74e1-6246-4e24-a0c2-5892f52a5ceb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:15:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e969c9c6-ebe5-4691-9908-6d36149d2552]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:15:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:15:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:15:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 07:15:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:15:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:15:25 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 07:15:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[264d4f13-379d-45e7-aa4d-2db8e038071a]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:15:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 07:15:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 07:15:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 07:15:25 user nova-compute[72809]: DEBUG os_brick.utils [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:15:25 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Updating existing volume attachment record: 00927679-3302-419f-9f4b-1e5e0603d2c2 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 07:15:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:15:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-5c3c04cf-c5e6-406d-9d92-97eca84e326d tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Acquiring lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:15:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-5c3c04cf-c5e6-406d-9d92-97eca84e326d tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:15:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-5c3c04cf-c5e6-406d-9d92-97eca84e326d tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Acquiring lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:15:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-5c3c04cf-c5e6-406d-9d92-97eca84e326d tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:15:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-5c3c04cf-c5e6-406d-9d92-97eca84e326d tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:15:29 user nova-compute[72809]: INFO nova.compute.manager [None req-5c3c04cf-c5e6-406d-9d92-97eca84e326d tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Terminating instance
Aug 09 07:15:29 user nova-compute[72809]: DEBUG nova.compute.manager [None req-5c3c04cf-c5e6-406d-9d92-97eca84e326d tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:15:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-e2027cea-13bd-4908-8c77-f55c6dc21e55 req-5367ab0a-f85d-4941-a837-c871605b6182 service nova] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Received event network-vif-unplugged-bb24be9c-c2ff-42e7-84ba-2f76b9400db2 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:15:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e2027cea-13bd-4908-8c77-f55c6dc21e55 req-5367ab0a-f85d-4941-a837-c871605b6182 service nova] Acquiring lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:15:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e2027cea-13bd-4908-8c77-f55c6dc21e55 req-5367ab0a-f85d-4941-a837-c871605b6182 service nova] Lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:15:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e2027cea-13bd-4908-8c77-f55c6dc21e55 req-5367ab0a-f85d-4941-a837-c871605b6182 service nova] Lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:15:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-e2027cea-13bd-4908-8c77-f55c6dc21e55 req-5367ab0a-f85d-4941-a837-c871605b6182 service nova] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] No waiting events found dispatching network-vif-unplugged-bb24be9c-c2ff-42e7-84ba-2f76b9400db2 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:15:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-e2027cea-13bd-4908-8c77-f55c6dc21e55 req-5367ab0a-f85d-4941-a837-c871605b6182 service nova] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Received event network-vif-unplugged-bb24be9c-c2ff-42e7-84ba-2f76b9400db2 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:15:30 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Instance destroyed successfully.
Aug 09 07:15:30 user nova-compute[72809]: DEBUG nova.objects.instance [None req-5c3c04cf-c5e6-406d-9d92-97eca84e326d tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lazy-loading 'resources' on Instance uuid d29dd60c-2a98-4d47-b11c-67e88bb17dc3 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:15:30 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-5c3c04cf-c5e6-406d-9d92-97eca84e326d tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:11:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-300120339',display_name='tempest-TestServerVolumeAttachmentScenario-server-300120339',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-300120339',id=41,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDO5zCMnu9F3in7/6k3DMBofuZf8GGZoxh92ERiSsEhc3YVzSF2IlXp3KzAguGW7YqPTbiIAxY60KFKK+TqMF01ko/2kWkkVaOOgUMcH6g2nrOeAxRl+TL4f+qm8SMqGQ==',key_name='tempest-keypair-1499573665',keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:11:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25a9a141f54c4a9da74993125c9c137b',ramdisk_id='',reservation_id='r-16evibcs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1603584851',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1603584851-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:11:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00d76eca58cf4ada8c8d9843110db8b5',uuid=d29dd60c-2a98-4d47-b11c-67e88bb17dc3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb24be9c-c2ff-42e7-84ba-2f76b9400db2", "address": "fa:16:3e:e8:4d:13", "network": {"id": "828c1b8f-947e-450a-b97f-d5b149941ccf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-718683445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9a141f54c4a9da74993125c9c137b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb24be9c-c2", "ovs_interfaceid": "bb24be9c-c2ff-42e7-84ba-2f76b9400db2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:15:30 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-5c3c04cf-c5e6-406d-9d92-97eca84e326d tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Converting VIF {"id": "bb24be9c-c2ff-42e7-84ba-2f76b9400db2", "address": "fa:16:3e:e8:4d:13", "network": {"id": "828c1b8f-947e-450a-b97f-d5b149941ccf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-718683445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25a9a141f54c4a9da74993125c9c137b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb24be9c-c2", "ovs_interfaceid": "bb24be9c-c2ff-42e7-84ba-2f76b9400db2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:15:30 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-5c3c04cf-c5e6-406d-9d92-97eca84e326d tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:4d:13,bridge_name='br-int',has_traffic_filtering=True,id=bb24be9c-c2ff-42e7-84ba-2f76b9400db2,network=Network(828c1b8f-947e-450a-b97f-d5b149941ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb24be9c-c2') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:15:30 user nova-compute[72809]: DEBUG os_vif [None req-5c3c04cf-c5e6-406d-9d92-97eca84e326d tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:4d:13,bridge_name='br-int',has_traffic_filtering=True,id=bb24be9c-c2ff-42e7-84ba-2f76b9400db2,network=Network(828c1b8f-947e-450a-b97f-d5b149941ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb24be9c-c2') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:15:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb24be9c-c2, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:15:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:15:30 user nova-compute[72809]: INFO os_vif [None req-5c3c04cf-c5e6-406d-9d92-97eca84e326d tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:4d:13,bridge_name='br-int',has_traffic_filtering=True,id=bb24be9c-c2ff-42e7-84ba-2f76b9400db2,network=Network(828c1b8f-947e-450a-b97f-d5b149941ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb24be9c-c2')
Aug 09 07:15:30 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-5c3c04cf-c5e6-406d-9d92-97eca84e326d tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Deleting instance files /opt/stack/data/nova/instances/d29dd60c-2a98-4d47-b11c-67e88bb17dc3_del
Aug 09 07:15:30 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-5c3c04cf-c5e6-406d-9d92-97eca84e326d tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Deletion of /opt/stack/data/nova/instances/d29dd60c-2a98-4d47-b11c-67e88bb17dc3_del complete
Aug 09 07:15:30 user nova-compute[72809]: INFO nova.compute.manager [None req-5c3c04cf-c5e6-406d-9d92-97eca84e326d tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 09 07:15:30 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-5c3c04cf-c5e6-406d-9d92-97eca84e326d tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:15:30 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:15:30 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:15:31 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:15:31 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Took 1.21 seconds to deallocate network for instance.
Aug 09 07:15:31 user nova-compute[72809]: DEBUG nova.compute.manager [req-c258186a-3686-427d-b6da-3c24e1fa6c81 req-169c040e-27e5-47a8-8b9c-22582ef6d032 service nova] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Received event network-vif-deleted-bb24be9c-c2ff-42e7-84ba-2f76b9400db2 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:15:31 user nova-compute[72809]: INFO nova.compute.manager [req-c258186a-3686-427d-b6da-3c24e1fa6c81 req-169c040e-27e5-47a8-8b9c-22582ef6d032 service nova] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Neutron deleted interface bb24be9c-c2ff-42e7-84ba-2f76b9400db2; detaching it from the instance and deleting it from the info cache
Aug 09 07:15:31 user nova-compute[72809]: DEBUG nova.network.neutron [req-c258186a-3686-427d-b6da-3c24e1fa6c81 req-169c040e-27e5-47a8-8b9c-22582ef6d032 service nova] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:15:31 user nova-compute[72809]: DEBUG nova.compute.manager [req-c258186a-3686-427d-b6da-3c24e1fa6c81 req-169c040e-27e5-47a8-8b9c-22582ef6d032 service nova] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Detach interface failed, port_id=bb24be9c-c2ff-42e7-84ba-2f76b9400db2, reason: Instance d29dd60c-2a98-4d47-b11c-67e88bb17dc3 could not be found. {{(pid=72809) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 07:15:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-5c3c04cf-c5e6-406d-9d92-97eca84e326d tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:15:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-5c3c04cf-c5e6-406d-9d92-97eca84e326d tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:15:31 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-5c3c04cf-c5e6-406d-9d92-97eca84e326d tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:15:31 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-5c3c04cf-c5e6-406d-9d92-97eca84e326d tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:15:31 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-5c3c04cf-c5e6-406d-9d92-97eca84e326d tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.217s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:15:31 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-5c3c04cf-c5e6-406d-9d92-97eca84e326d tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Deleted allocations for instance d29dd60c-2a98-4d47-b11c-67e88bb17dc3
Aug 09 07:15:32 user nova-compute[72809]: DEBUG nova.compute.manager [req-c86e7e33-011c-4a19-b5ba-4205d0908dd9 req-9e34c6b3-fd50-48ad-9686-9613dae68cf2 service nova] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Received event network-vif-plugged-bb24be9c-c2ff-42e7-84ba-2f76b9400db2 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:15:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c86e7e33-011c-4a19-b5ba-4205d0908dd9 req-9e34c6b3-fd50-48ad-9686-9613dae68cf2 service nova] Acquiring lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:15:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c86e7e33-011c-4a19-b5ba-4205d0908dd9 req-9e34c6b3-fd50-48ad-9686-9613dae68cf2 service nova] Lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:15:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c86e7e33-011c-4a19-b5ba-4205d0908dd9 req-9e34c6b3-fd50-48ad-9686-9613dae68cf2 service nova] Lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:15:32 user nova-compute[72809]: DEBUG nova.compute.manager [req-c86e7e33-011c-4a19-b5ba-4205d0908dd9 req-9e34c6b3-fd50-48ad-9686-9613dae68cf2 service nova] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] No waiting events found dispatching network-vif-plugged-bb24be9c-c2ff-42e7-84ba-2f76b9400db2 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:15:32 user nova-compute[72809]: WARNING nova.compute.manager [req-c86e7e33-011c-4a19-b5ba-4205d0908dd9 req-9e34c6b3-fd50-48ad-9686-9613dae68cf2 service nova] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Received unexpected event network-vif-plugged-bb24be9c-c2ff-42e7-84ba-2f76b9400db2 for instance with vm_state deleted and task_state None.
Aug 09 07:15:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-5c3c04cf-c5e6-406d-9d92-97eca84e326d tempest-TestServerVolumeAttachmentScenario-1603584851 tempest-TestServerVolumeAttachmentScenario-1603584851-project-member] Lock "d29dd60c-2a98-4d47-b11c-67e88bb17dc3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.467s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG nova.compute.manager [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 07:15:33 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Creating image(s)
Aug 09 07:15:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Did not create local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Ensure instance console log exists: /opt/stack/data/nova/instances/8798d9fd-e562-4acc-b076-0f4a5d56c0a6/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Start _get_guest_xml network_info=[{"id": "540e5264-643d-4aa8-8119-ee69542e55af", "address": "fa:16:3e:b0:31:61", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e5264-64", "ovs_interfaceid": "540e5264-643d-4aa8-8119-ee69542e55af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Udfiuonr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8798d9fd-e562-4acc-b076-0f4a5d56c0a6', 'attached_at': '', 'detached_at': '', 'volume_id': '7e8f01dd-e3a1-4e44-b862-4bf5f385db0f', 'serial': '7e8f01dd-e3a1-4e44-b862-4bf5f385db0f'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'boot_index': 0, 'attachment_id': '00927679-3302-419f-9f4b-1e5e0603d2c2', 'volume_type': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 07:15:33 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:15:33 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:15:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Udfiuonr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:15:33 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:15:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:15:33 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:15:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:15:33 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 07:15:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc761870-23a5-4a88-b8ed-5667979a59dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 07:15:33 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f431a9-fed5-40f1-a026-a9e422ff5943]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f] added
Aug 09 07:15:33 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[89703af4-9d53-4aca-93ca-9c2e023d8733]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26bfc94-4e67-43d7-9794-19668cb9c688]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Udfiuonr {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691565318.94502, 6e9996e8-c5eb-42c1-b88f-d75654e160c5 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:15:33 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] VM Stopped (Lifecycle Event)
Aug 09 07:15:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Udfiuonr" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fee958-2b75-4e58-b39f-b3894bd715b1]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Udfiuonr'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG nova.compute.manager [None req-002c79fd-32f9-4635-b5e0-b5878e1dd09c None None] [instance: 6e9996e8-c5eb-42c1-b88f-d75654e160c5] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[13db6c56-0b11-4f2e-b573-21f1eb809b33]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5214c6a1-614d-49b9-8e04-bbf03d7d42f2]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:15:33 user nova-compute[72809]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)
Aug 09 07:15:33 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:15:33 user nova-compute[72809]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)
Aug 09 07:15:33 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:15:33 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:15:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:15:34 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed17381-5cbd-4ff7-bb5d-463d0d926788]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:15:34 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f, portal: 172.16.0.220,3260]
Aug 09 07:15:34 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f, portal: 172.16.0.220,3260] successful.
Aug 09 07:15:34 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:15:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:15:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:15:34 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73a6441-7441-4141-8790-03ba3a294bdf]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:15:34 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:15:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:15:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:15:34 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[1842061f-1a1b-43e8-8cff-3460fdeb0716]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:15:34 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:15:34 user nova-compute[72809]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)
Aug 09 07:15:34 user nova-compute[72809]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f (non-flash)
Aug 09 07:15:34 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:15:34 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:15:34 user nova-compute[72809]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)
Aug 09 07:15:34 user nova-compute[72809]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f (non-flash)
Aug 09 07:15:34 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:15:34 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:15:34 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 07:15:34 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 07:15:34 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 07:15:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:15:34 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:15:34 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b8d835-6394-4b40-8a76-254e35341268]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:15:34 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:15:34 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Udfiuonr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 07:15:34 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:35 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:15:35 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23333666639386539', 'path': '/dev/sdc'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:15:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333666639386539', 'path': '/dev/sdc'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 07:15:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:15:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-980317520',display_name='tempest-TestVolumeBootPattern-server-980317520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-980317520',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cdcd8241b9b47eab16a6e37a9cc5f54',ramdisk_id='',reservation_id='r-vi8eu9ra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-224847517',owner_user_name='tempest-TestVolumeBootPattern-224847517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:15:20Z,user_data=None,user_id='a7859a38408b426eb9a14ef003483bd3',uuid=8798d9fd-e562-4acc-b076-0f4a5d56c0a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "540e5264-643d-4aa8-8119-ee69542e55af", "address": "fa:16:3e:b0:31:61", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e5264-64", "ovs_interfaceid": "540e5264-643d-4aa8-8119-ee69542e55af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 07:15:35 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converting VIF {"id": "540e5264-643d-4aa8-8119-ee69542e55af", "address": "fa:16:3e:b0:31:61", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e5264-64", "ovs_interfaceid": "540e5264-643d-4aa8-8119-ee69542e55af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:15:35 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:31:61,bridge_name='br-int',has_traffic_filtering=True,id=540e5264-643d-4aa8-8119-ee69542e55af,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap540e5264-64') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:15:35 user nova-compute[72809]: DEBUG nova.objects.instance [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lazy-loading 'pci_devices' on Instance uuid 8798d9fd-e562-4acc-b076-0f4a5d56c0a6 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:15:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] End _get_guest_xml xml=<domain type="kvm">
Aug 09 07:15:35 user nova-compute[72809]:   <uuid>8798d9fd-e562-4acc-b076-0f4a5d56c0a6</uuid>
Aug 09 07:15:35 user nova-compute[72809]:   <name>instance-0000002c</name>
Aug 09 07:15:35 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 07:15:35 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 07:15:35 user nova-compute[72809]:   <metadata>
Aug 09 07:15:35 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 07:15:35 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 07:15:35 user nova-compute[72809]:       <nova:name>tempest-TestVolumeBootPattern-server-980317520</nova:name>
Aug 09 07:15:35 user nova-compute[72809]:       <nova:creationTime>2023-08-09 07:15:33</nova:creationTime>
Aug 09 07:15:35 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 07:15:35 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 07:15:35 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 07:15:35 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 07:15:35 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 07:15:35 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 07:15:35 user nova-compute[72809]:       </nova:flavor>
Aug 09 07:15:35 user nova-compute[72809]:       <nova:owner>
Aug 09 07:15:35 user nova-compute[72809]:         <nova:user uuid="a7859a38408b426eb9a14ef003483bd3">tempest-TestVolumeBootPattern-224847517-project-member</nova:user>
Aug 09 07:15:35 user nova-compute[72809]:         <nova:project uuid="8cdcd8241b9b47eab16a6e37a9cc5f54">tempest-TestVolumeBootPattern-224847517</nova:project>
Aug 09 07:15:35 user nova-compute[72809]:       </nova:owner>
Aug 09 07:15:35 user nova-compute[72809]:       <nova:ports>
Aug 09 07:15:35 user nova-compute[72809]:         <nova:port uuid="540e5264-643d-4aa8-8119-ee69542e55af">
Aug 09 07:15:35 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 07:15:35 user nova-compute[72809]:         </nova:port>
Aug 09 07:15:35 user nova-compute[72809]:       </nova:ports>
Aug 09 07:15:35 user nova-compute[72809]:     </nova:instance>
Aug 09 07:15:35 user nova-compute[72809]:   </metadata>
Aug 09 07:15:35 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 07:15:35 user nova-compute[72809]:     <system>
Aug 09 07:15:35 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 07:15:35 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 07:15:35 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 07:15:35 user nova-compute[72809]:       <entry name="serial">8798d9fd-e562-4acc-b076-0f4a5d56c0a6</entry>
Aug 09 07:15:35 user nova-compute[72809]:       <entry name="uuid">8798d9fd-e562-4acc-b076-0f4a5d56c0a6</entry>
Aug 09 07:15:35 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 07:15:35 user nova-compute[72809]:     </system>
Aug 09 07:15:35 user nova-compute[72809]:   </sysinfo>
Aug 09 07:15:35 user nova-compute[72809]:   <os>
Aug 09 07:15:35 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 07:15:35 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 07:15:35 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 07:15:35 user nova-compute[72809]:   </os>
Aug 09 07:15:35 user nova-compute[72809]:   <features>
Aug 09 07:15:35 user nova-compute[72809]:     <acpi/>
Aug 09 07:15:35 user nova-compute[72809]:     <apic/>
Aug 09 07:15:35 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 07:15:35 user nova-compute[72809]:   </features>
Aug 09 07:15:35 user nova-compute[72809]:   <clock offset="utc">
Aug 09 07:15:35 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 07:15:35 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 07:15:35 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 07:15:35 user nova-compute[72809]:   </clock>
Aug 09 07:15:35 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 07:15:35 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 07:15:35 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 07:15:35 user nova-compute[72809]:   </cpu>
Aug 09 07:15:35 user nova-compute[72809]:   <devices>
Aug 09 07:15:35 user nova-compute[72809]:     <disk type="block" device="disk">
Aug 09 07:15:35 user nova-compute[72809]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:15:35 user nova-compute[72809]:       <source dev="/dev/sdc"/>
Aug 09 07:15:35 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 07:15:35 user nova-compute[72809]:       <serial>7e8f01dd-e3a1-4e44-b862-4bf5f385db0f</serial>
Aug 09 07:15:35 user nova-compute[72809]:     </disk>
Aug 09 07:15:35 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 07:15:35 user nova-compute[72809]:       <mac address="fa:16:3e:b0:31:61"/>
Aug 09 07:15:35 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:15:35 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 07:15:35 user nova-compute[72809]:       <target dev="tap540e5264-64"/>
Aug 09 07:15:35 user nova-compute[72809]:     </interface>
Aug 09 07:15:35 user nova-compute[72809]:     <serial type="pty">
Aug 09 07:15:35 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/8798d9fd-e562-4acc-b076-0f4a5d56c0a6/console.log" append="off"/>
Aug 09 07:15:35 user nova-compute[72809]:     </serial>
Aug 09 07:15:35 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 07:15:35 user nova-compute[72809]:     <video>
Aug 09 07:15:35 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:15:35 user nova-compute[72809]:     </video>
Aug 09 07:15:35 user nova-compute[72809]:     <rng model="virtio">
Aug 09 07:15:35 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 07:15:35 user nova-compute[72809]:     </rng>
Aug 09 07:15:35 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 07:15:35 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 07:15:35 user nova-compute[72809]:       <stats period="10"/>
Aug 09 07:15:35 user nova-compute[72809]:     </memballoon>
Aug 09 07:15:35 user nova-compute[72809]:   </devices>
Aug 09 07:15:35 user nova-compute[72809]: </domain>
Aug 09 07:15:35 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 07:15:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:15:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-980317520',display_name='tempest-TestVolumeBootPattern-server-980317520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-980317520',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cdcd8241b9b47eab16a6e37a9cc5f54',ramdisk_id='',reservation_id='r-vi8eu9ra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-224847517',owner_user_name='tempest-TestVolumeBootPattern-224847517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:15:20Z,user_data=None,user_id='a7859a38408b426eb9a14ef003483bd3',uuid=8798d9fd-e562-4acc-b076-0f4a5d56c0a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "540e5264-643d-4aa8-8119-ee69542e55af", "address": "fa:16:3e:b0:31:61", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e5264-64", "ovs_interfaceid": "540e5264-643d-4aa8-8119-ee69542e55af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 07:15:35 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converting VIF {"id": "540e5264-643d-4aa8-8119-ee69542e55af", "address": "fa:16:3e:b0:31:61", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e5264-64", "ovs_interfaceid": "540e5264-643d-4aa8-8119-ee69542e55af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:15:35 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:31:61,bridge_name='br-int',has_traffic_filtering=True,id=540e5264-643d-4aa8-8119-ee69542e55af,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap540e5264-64') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:15:35 user nova-compute[72809]: DEBUG os_vif [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:31:61,bridge_name='br-int',has_traffic_filtering=True,id=540e5264-643d-4aa8-8119-ee69542e55af,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap540e5264-64') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 07:15:35 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:35 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:15:35 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 07:15:35 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:35 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap540e5264-64, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:15:35 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap540e5264-64, col_values=(('external_ids', {'iface-id': '540e5264-643d-4aa8-8119-ee69542e55af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:31:61', 'vm-uuid': '8798d9fd-e562-4acc-b076-0f4a5d56c0a6'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:15:35 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:35 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:15:35 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:35 user nova-compute[72809]: INFO os_vif [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:31:61,bridge_name='br-int',has_traffic_filtering=True,id=540e5264-643d-4aa8-8119-ee69542e55af,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap540e5264-64')
Aug 09 07:15:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:15:35 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] No VIF found with MAC fa:16:3e:b0:31:61, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:15:36 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:36 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:36 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:36 user nova-compute[72809]: DEBUG nova.compute.manager [req-80b91ba7-8eee-4ea7-8f83-eca8314eb07b req-690ad341-cd2c-47cd-90f3-da1ccd02d920 service nova] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Received event network-vif-plugged-540e5264-643d-4aa8-8119-ee69542e55af {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:15:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-80b91ba7-8eee-4ea7-8f83-eca8314eb07b req-690ad341-cd2c-47cd-90f3-da1ccd02d920 service nova] Acquiring lock "8798d9fd-e562-4acc-b076-0f4a5d56c0a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:15:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-80b91ba7-8eee-4ea7-8f83-eca8314eb07b req-690ad341-cd2c-47cd-90f3-da1ccd02d920 service nova] Lock "8798d9fd-e562-4acc-b076-0f4a5d56c0a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:15:36 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-80b91ba7-8eee-4ea7-8f83-eca8314eb07b req-690ad341-cd2c-47cd-90f3-da1ccd02d920 service nova] Lock "8798d9fd-e562-4acc-b076-0f4a5d56c0a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:15:36 user nova-compute[72809]: DEBUG nova.compute.manager [req-80b91ba7-8eee-4ea7-8f83-eca8314eb07b req-690ad341-cd2c-47cd-90f3-da1ccd02d920 service nova] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] No waiting events found dispatching network-vif-plugged-540e5264-643d-4aa8-8119-ee69542e55af {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:15:36 user nova-compute[72809]: WARNING nova.compute.manager [req-80b91ba7-8eee-4ea7-8f83-eca8314eb07b req-690ad341-cd2c-47cd-90f3-da1ccd02d920 service nova] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Received unexpected event network-vif-plugged-540e5264-643d-4aa8-8119-ee69542e55af for instance with vm_state building and task_state spawning.
Aug 09 07:15:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:38 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691565338.7343047, 8798d9fd-e562-4acc-b076-0f4a5d56c0a6 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:15:38 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] VM Resumed (Lifecycle Event)
Aug 09 07:15:38 user nova-compute[72809]: DEBUG nova.compute.manager [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 07:15:38 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 07:15:38 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Instance spawned successfully.
Aug 09 07:15:38 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 07:15:38 user nova-compute[72809]: DEBUG nova.compute.manager [req-945cf23c-e9f2-40ee-a435-f52085027878 req-4e8cd19a-71e4-470e-a88d-af76c94051cd service nova] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Received event network-vif-plugged-540e5264-643d-4aa8-8119-ee69542e55af {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:15:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-945cf23c-e9f2-40ee-a435-f52085027878 req-4e8cd19a-71e4-470e-a88d-af76c94051cd service nova] Acquiring lock "8798d9fd-e562-4acc-b076-0f4a5d56c0a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:15:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-945cf23c-e9f2-40ee-a435-f52085027878 req-4e8cd19a-71e4-470e-a88d-af76c94051cd service nova] Lock "8798d9fd-e562-4acc-b076-0f4a5d56c0a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:15:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-945cf23c-e9f2-40ee-a435-f52085027878 req-4e8cd19a-71e4-470e-a88d-af76c94051cd service nova] Lock "8798d9fd-e562-4acc-b076-0f4a5d56c0a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:15:38 user nova-compute[72809]: DEBUG nova.compute.manager [req-945cf23c-e9f2-40ee-a435-f52085027878 req-4e8cd19a-71e4-470e-a88d-af76c94051cd service nova] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] No waiting events found dispatching network-vif-plugged-540e5264-643d-4aa8-8119-ee69542e55af {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:15:38 user nova-compute[72809]: WARNING nova.compute.manager [req-945cf23c-e9f2-40ee-a435-f52085027878 req-4e8cd19a-71e4-470e-a88d-af76c94051cd service nova] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Received unexpected event network-vif-plugged-540e5264-643d-4aa8-8119-ee69542e55af for instance with vm_state building and task_state spawning.
Aug 09 07:15:38 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:15:38 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:15:38 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:15:38 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:15:38 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:15:38 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:15:38 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:15:38 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:15:38 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:15:38 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691565338.7387311, 8798d9fd-e562-4acc-b076-0f4a5d56c0a6 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:15:38 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] VM Started (Lifecycle Event)
Aug 09 07:15:38 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:15:38 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:15:38 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:15:38 user nova-compute[72809]: INFO nova.compute.manager [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Took 5.14 seconds to spawn the instance on the hypervisor.
Aug 09 07:15:38 user nova-compute[72809]: DEBUG nova.compute.manager [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:15:38 user nova-compute[72809]: INFO nova.compute.manager [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Took 19.48 seconds to build instance.
Aug 09 07:15:38 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-74f2c6cd-6ab6-443d-89b6-3b8f8c2d74b4 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "8798d9fd-e562-4acc-b076-0f4a5d56c0a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.579s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:15:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:39 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._sync_power_states {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:15:39 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Triggering sync for uuid 339372ed-140d-4226-ba00-2cc682214d5c {{(pid=72809) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 07:15:39 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Triggering sync for uuid 466a8e58-5f88-4ffe-a7fd-a346003f3508 {{(pid=72809) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 07:15:39 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Triggering sync for uuid b00766a3-5171-4022-8cb3-77ea9c8c5db6 {{(pid=72809) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 07:15:39 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Triggering sync for uuid 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 {{(pid=72809) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 07:15:39 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Triggering sync for uuid 8798d9fd-e562-4acc-b076-0f4a5d56c0a6 {{(pid=72809) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 07:15:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "339372ed-140d-4226-ba00-2cc682214d5c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:15:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "339372ed-140d-4226-ba00-2cc682214d5c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:15:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "466a8e58-5f88-4ffe-a7fd-a346003f3508" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:15:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:15:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:15:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:15:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:15:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:15:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "8798d9fd-e562-4acc-b076-0f4a5d56c0a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:15:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "8798d9fd-e562-4acc-b076-0f4a5d56c0a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:15:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "339372ed-140d-4226-ba00-2cc682214d5c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:15:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:15:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:15:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:15:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "8798d9fd-e562-4acc-b076-0f4a5d56c0a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:15:40 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:43 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:15:43 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 07:15:43 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Didn't find any instances for network info cache update. {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 07:15:43 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:15:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:44 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:15:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:15:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:15:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:15:44 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 07:15:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:15:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:15:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:15:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:15:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:15:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:15:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:15:45 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691565330.328702, d29dd60c-2a98-4d47-b11c-67e88bb17dc3 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:15:45 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] VM Stopped (Lifecycle Event)
Aug 09 07:15:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.397s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:15:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:15:45 user nova-compute[72809]: DEBUG nova.compute.manager [None req-90371cdf-e3c2-4886-a5a9-34570310316e None None] [instance: d29dd60c-2a98-4d47-b11c-67e88bb17dc3] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:15:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:15:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:15:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:15:45 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:15:45 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:15:45 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:15:46 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:15:46 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:15:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=8149MB free_disk=25.02112579345703GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 07:15:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:15:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:15:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 339372ed-140d-4226-ba00-2cc682214d5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:15:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 466a8e58-5f88-4ffe-a7fd-a346003f3508 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:15:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance b00766a3-5171-4022-8cb3-77ea9c8c5db6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:15:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:15:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 8798d9fd-e562-4acc-b076-0f4a5d56c0a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:15:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 07:15:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 07:15:46 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Refreshing inventories for resource provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 07:15:46 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Updating ProviderTree inventory for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 07:15:46 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Updating inventory in ProviderTree for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 07:15:46 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Refreshing aggregate associations for resource provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3, aggregates: None {{(pid=72809) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 07:15:46 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Refreshing trait associations for resource provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI {{(pid=72809) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 07:15:46 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:15:46 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:15:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 07:15:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.461s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:15:50 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:54 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:15:54 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:15:54 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:15:55 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:55 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:15:57 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:15:57 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 07:15:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:15:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquiring lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:15:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:15:59 user nova-compute[72809]: DEBUG nova.objects.instance [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lazy-loading 'flavor' on Instance uuid 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:15:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:16:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquiring lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:16:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:16:00 user nova-compute[72809]: INFO nova.compute.manager [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Attaching volume 52afef59-a254-4156-a7d5-ea390afaf41b to /dev/vdb
Aug 09 07:16:00 user nova-compute[72809]: DEBUG os_brick.utils [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:16:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:00 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[920803fd-d7ce-4f9d-83cf-bf6a49154d45]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:00 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4adbc58-047d-4f7a-be6e-31b48ef3ead8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:16:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:00 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77af352-cff9-4d9d-a057-80e468a53941]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:00 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[664a0ed3-c4dc-404e-af1d-8a9bb1dd2eea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:16:00 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 07:16:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:00 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:16:00 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 07:16:00 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2b636c-87f7-48f8-8844-500323188bb5]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:00 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 07:16:00 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 07:16:00 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 07:16:00 user nova-compute[72809]: DEBUG os_brick.utils [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:16:00 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Updating existing volume attachment record: 6cea04bd-ca7c-417d-8d62-819d9089dbec {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 07:16:01 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:16:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:16:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGrVkWSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:16:08 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:16:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:16:08 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:16:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:16:08 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4956f2-acb7-46d3-9ebf-28a5d49f7ab3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 07:16:08 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[092fd771-3f0e-475c-a694-eb8d87b18488]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b] added
Aug 09 07:16:08 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f505a5-eb86-4c1a-904e-e14f949d05f9]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8d493e-0cb6-4435-adbf-f7f37b104b9e]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FGrVkWSs {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FGrVkWSs" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b003c0-fb4b-4fb4-8ba1-21ba80939e3c]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FGrVkWSs'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b390c4d-634e-4ef9-86e3-c694bfc23639]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[59280d5e-d279-4cb3-a9a1-58dfa347b2c3]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:16:08 user nova-compute[72809]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)
Aug 09 07:16:08 user nova-compute[72809]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f (non-flash)
Aug 09 07:16:08 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:16:08 user nova-compute[72809]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)
Aug 09 07:16:08 user nova-compute[72809]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f (non-flash)
Aug 09 07:16:08 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d371c94-8380-4111-9ffd-a7b25d544fcf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b, portal: 172.16.0.220,3260]
Aug 09 07:16:08 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b, portal: 172.16.0.220,3260] successful.
Aug 09 07:16:08 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a0cab2-6e58-4fc5-9dba-9e52642bc66a]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[14dca33f-7e3c-4b1e-8344-dad67e3265d1]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:16:08 user nova-compute[72809]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)
Aug 09 07:16:08 user nova-compute[72809]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f (non-flash)
Aug 09 07:16:08 user nova-compute[72809]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b (non-flash)
Aug 09 07:16:08 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:16:08 user nova-compute[72809]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)
Aug 09 07:16:08 user nova-compute[72809]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f (non-flash)
Aug 09 07:16:08 user nova-compute[72809]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b (non-flash)
Aug 09 07:16:08 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f598690a-6f57-446d-9057-d59efa2987bb]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGrVkWSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "466a8e58-5f88-4ffe-a7fd-a346003f3508" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:16:08 user nova-compute[72809]: INFO nova.compute.manager [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Terminating instance
Aug 09 07:16:08 user nova-compute[72809]: DEBUG nova.compute.manager [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:16:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG nova.compute.manager [req-36dff48a-2ed9-4ec9-a509-1e91807df3b6 req-3c673a82-956f-4556-8469-1a5f370303e4 service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Received event network-vif-unplugged-8a95ff1b-0686-455d-977c-cedac8be3930 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-36dff48a-2ed9-4ec9-a509-1e91807df3b6 req-3c673a82-956f-4556-8469-1a5f370303e4 service nova] Acquiring lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-36dff48a-2ed9-4ec9-a509-1e91807df3b6 req-3c673a82-956f-4556-8469-1a5f370303e4 service nova] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-36dff48a-2ed9-4ec9-a509-1e91807df3b6 req-3c673a82-956f-4556-8469-1a5f370303e4 service nova] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG nova.compute.manager [req-36dff48a-2ed9-4ec9-a509-1e91807df3b6 req-3c673a82-956f-4556-8469-1a5f370303e4 service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] No waiting events found dispatching network-vif-unplugged-8a95ff1b-0686-455d-977c-cedac8be3930 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG nova.compute.manager [req-36dff48a-2ed9-4ec9-a509-1e91807df3b6 req-3c673a82-956f-4556-8469-1a5f370303e4 service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Received event network-vif-unplugged-8a95ff1b-0686-455d-977c-cedac8be3930 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:16:09 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Instance destroyed successfully.
Aug 09 07:16:09 user nova-compute[72809]: DEBUG nova.objects.instance [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lazy-loading 'resources' on Instance uuid 466a8e58-5f88-4ffe-a7fd-a346003f3508 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:00:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1511604475',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1511604475',id=29,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:02:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1903437f7ed4c14a0660f64a2e0c647',ramdisk_id='',reservation_id='r-n0o0w0e3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-917311946',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:04:07Z,user_data=None,user_id='6c4c5942852b412885a5b4698552058d',uuid=466a8e58-5f88-4ffe-a7fd-a346003f3508,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a95ff1b-0686-455d-977c-cedac8be3930", "address": "fa:16:3e:42:8d:bd", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a95ff1b-06", "ovs_interfaceid": "8a95ff1b-0686-455d-977c-cedac8be3930", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Converting VIF {"id": "8a95ff1b-0686-455d-977c-cedac8be3930", "address": "fa:16:3e:42:8d:bd", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a95ff1b-06", "ovs_interfaceid": "8a95ff1b-0686-455d-977c-cedac8be3930", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:8d:bd,bridge_name='br-int',has_traffic_filtering=True,id=8a95ff1b-0686-455d-977c-cedac8be3930,network=Network(5f03b0f9-e80d-428f-b0a6-57158568e620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a95ff1b-06') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG os_vif [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:8d:bd,bridge_name='br-int',has_traffic_filtering=True,id=8a95ff1b-0686-455d-977c-cedac8be3930,network=Network(5f03b0f9-e80d-428f-b0a6-57158568e620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a95ff1b-06') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a95ff1b-06, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:16:09 user nova-compute[72809]: INFO os_vif [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:8d:bd,bridge_name='br-int',has_traffic_filtering=True,id=8a95ff1b-0686-455d-977c-cedac8be3930,network=Network(5f03b0f9-e80d-428f-b0a6-57158568e620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a95ff1b-06')
Aug 09 07:16:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eqKCHkSV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:16:09 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:16:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '26336656533323665', 'path': '/dev/sdd'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336656533323665', 'path': '/dev/sdd'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.170s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG nova.objects.instance [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lazy-loading 'flavor' on Instance uuid 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[09beaaed-a33e-4481-a0ef-f5f12d47ff35]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[354f65f2-786a-49bc-a2e8-73f6c65350f7]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:16:09 user nova-compute[72809]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)
Aug 09 07:16:09 user nova-compute[72809]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f (non-flash)
Aug 09 07:16:09 user nova-compute[72809]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b (non-flash)
Aug 09 07:16:09 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 (non-flash)
Aug 09 07:16:09 user nova-compute[72809]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)
Aug 09 07:16:09 user nova-compute[72809]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f (non-flash)
Aug 09 07:16:09 user nova-compute[72809]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b (non-flash)
Aug 09 07:16:09 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc138512ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64'): ({'sdb'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Removing single pathed devices sdb {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49df9d0-5af4-4bea-aec1-6c6a0ae0bf81]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 07:16:09 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:16:09 user nova-compute[72809]:   <source dev="/dev/sdd"/>
Aug 09 07:16:09 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:16:09 user nova-compute[72809]:   <serial>52afef59-a254-4156-a7d5-ea390afaf41b</serial>
Aug 09 07:16:09 user nova-compute[72809]: </disk>
Aug 09 07:16:09 user nova-compute[72809]:  {{(pid=72809) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f184ead-8e47-4985-84e8-3d424f48ddca]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Flushing IO for device /dev/sdb {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01091c6-572d-4c48-b591-a66afb18554d]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ac367f-e1fd-464e-9963-bc3e95360fcc]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] SCSI volumes sdb have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8971d9-a7e8-487a-b1b5-839380a1b2c9]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad842d52-48a0-497e-82e8-30e959baf6b2]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64, portal: 172.16.0.220,3260]
Aug 09 07:16:09 user nova-compute[72809]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64, portal: 172.16.0.220,3260] successful.
Aug 09 07:16:09 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2b861e9-396c-49cb-92d7-a7efb0adbf64 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56ca3da-b690-4d21-87f6-c1dd7d5f81f8]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] <== disconnect_volume: return (458ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:16:09 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Deleting instance files /opt/stack/data/nova/instances/466a8e58-5f88-4ffe-a7fd-a346003f3508_del
Aug 09 07:16:09 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Deletion of /opt/stack/data/nova/instances/466a8e58-5f88-4ffe-a7fd-a346003f3508_del complete
Aug 09 07:16:09 user nova-compute[72809]: INFO nova.compute.manager [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Took 1.10 seconds to destroy the instance on the hypervisor.
Aug 09 07:16:09 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:16:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] No VIF found with MAC fa:16:3e:3d:dc:e9, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:16:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cedfa188-e3da-4bcd-bca6-58873bfd6d6e tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.896s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:16:10 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:16:10 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Took 0.44 seconds to deallocate network for instance.
Aug 09 07:16:10 user nova-compute[72809]: INFO nova.compute.manager [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Took 0.71 seconds to detach 1 volumes for instance.
Aug 09 07:16:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:16:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:16:11 user nova-compute[72809]: DEBUG nova.compute.manager [req-9e75ef66-8875-4c45-9f17-24140ea89011 req-7be30097-b4c7-4c96-ac62-b28802658666 service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Received event network-vif-plugged-8a95ff1b-0686-455d-977c-cedac8be3930 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:16:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9e75ef66-8875-4c45-9f17-24140ea89011 req-7be30097-b4c7-4c96-ac62-b28802658666 service nova] Acquiring lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:16:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9e75ef66-8875-4c45-9f17-24140ea89011 req-7be30097-b4c7-4c96-ac62-b28802658666 service nova] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:16:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9e75ef66-8875-4c45-9f17-24140ea89011 req-7be30097-b4c7-4c96-ac62-b28802658666 service nova] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:16:11 user nova-compute[72809]: DEBUG nova.compute.manager [req-9e75ef66-8875-4c45-9f17-24140ea89011 req-7be30097-b4c7-4c96-ac62-b28802658666 service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] No waiting events found dispatching network-vif-plugged-8a95ff1b-0686-455d-977c-cedac8be3930 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:16:11 user nova-compute[72809]: WARNING nova.compute.manager [req-9e75ef66-8875-4c45-9f17-24140ea89011 req-7be30097-b4c7-4c96-ac62-b28802658666 service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Received unexpected event network-vif-plugged-8a95ff1b-0686-455d-977c-cedac8be3930 for instance with vm_state deleted and task_state None.
Aug 09 07:16:11 user nova-compute[72809]: DEBUG nova.compute.manager [req-9e75ef66-8875-4c45-9f17-24140ea89011 req-7be30097-b4c7-4c96-ac62-b28802658666 service nova] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Received event network-vif-deleted-8a95ff1b-0686-455d-977c-cedac8be3930 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:16:11 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:16:11 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:16:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.197s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:16:11 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Deleted allocations for instance 466a8e58-5f88-4ffe-a7fd-a346003f3508
Aug 09 07:16:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9e1fc793-cecf-49b8-9917-093429852156 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "466a8e58-5f88-4ffe-a7fd-a346003f3508" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.648s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:16:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquiring lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:16:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:16:12 user nova-compute[72809]: INFO nova.compute.manager [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Detaching volume 52afef59-a254-4156-a7d5-ea390afaf41b
Aug 09 07:16:12 user nova-compute[72809]: INFO nova.virt.block_device [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Attempting to driver detach volume 52afef59-a254-4156-a7d5-ea390afaf41b from mountpoint /dev/vdb
Aug 09 07:16:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Attempting to detach device vdb from instance 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 from the persistent domain config. {{(pid=72809) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 07:16:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:16:12 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:16:12 user nova-compute[72809]:   <source dev="/dev/sdd"/>
Aug 09 07:16:12 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:16:12 user nova-compute[72809]:   <serial>52afef59-a254-4156-a7d5-ea390afaf41b</serial>
Aug 09 07:16:12 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 07:16:12 user nova-compute[72809]: </disk>
Aug 09 07:16:12 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:16:12 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Successfully detached device vdb from instance 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 from the persistent domain config.
Aug 09 07:16:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 from the live domain config. {{(pid=72809) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 07:16:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:16:12 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:16:12 user nova-compute[72809]:   <source dev="/dev/sdd"/>
Aug 09 07:16:12 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:16:12 user nova-compute[72809]:   <serial>52afef59-a254-4156-a7d5-ea390afaf41b</serial>
Aug 09 07:16:12 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 07:16:12 user nova-compute[72809]: </disk>
Aug 09 07:16:12 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:16:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Received event <DeviceRemovedEvent: 1691565372.8847313, 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72809) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 07:16:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 {{(pid=72809) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 07:16:12 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Successfully detached device vdb from instance 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 from the live domain config.
Aug 09 07:16:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:16:12 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGrVkWSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:16:12 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:16:12 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:16:12 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:16:12 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:16:12 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:12 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:12 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26e8f33-1af8-457c-95a5-cd2a9b347d9d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:12 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:12 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:12 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f026f175-7b37-45d9-a507-f2c23cb60f2c]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:12 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)
Aug 09 07:16:12 user nova-compute[72809]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f (non-flash)
Aug 09 07:16:12 user nova-compute[72809]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b (non-flash)
Aug 09 07:16:12 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:16:12 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)
Aug 09 07:16:12 user nova-compute[72809]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f (non-flash)
Aug 09 07:16:12 user nova-compute[72809]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b (non-flash)
Aug 09 07:16:12 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:16:12 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc1383860e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b'): ({'sdd'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:16:12 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Removing single pathed devices sdd {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:16:12 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:12 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:12 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[685533b0-376d-400b-bc86-961b1c28a4ba]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:12 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:12 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:12 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9510a508-74b5-4c28-ba34-c4674cb3a41e]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:12 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Flushing IO for device /dev/sdd {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:16:12 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:13 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c91567-df23-4144-8891-08e351b0b11f]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:13 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:16:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:13 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[50341794-3d9b-4c13-a078-0e3b804437f6]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:13 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:16:13 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] SCSI volumes sdd have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:16:13 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:16:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:13 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bafe80c-7e2e-436e-ac46-6bbfcfb061d3]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:13 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:16:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:13 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[db509f96-dcbc-43fd-b896-123657a126af]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:13 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b, portal: 172.16.0.220,3260]
Aug 09 07:16:13 user nova-compute[72809]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b, portal: 172.16.0.220,3260] successful.
Aug 09 07:16:13 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:16:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:13 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52afef59-a254-4156-a7d5-ea390afaf41b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:13 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa0aca4-19d5-44a2-b457-080a6f7d1864]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:13 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:16:13 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:16:13 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] <== disconnect_volume: return (275ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:16:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:16:13 user nova-compute[72809]: DEBUG nova.objects.instance [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lazy-loading 'flavor' on Instance uuid 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:16:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4af1296f-3bce-439d-b094-3b26d335e7f7 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.530s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:16:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:16:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:16:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:16:14 user nova-compute[72809]: DEBUG nova.compute.manager [req-5c682ae6-cfe5-410d-85ed-12285ff13aab req-0223dae3-829c-4651-bb4f-ca7b98ad4923 service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Received event network-changed-7319b474-9cbb-4012-992b-b6e41c507433 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:16:14 user nova-compute[72809]: DEBUG nova.compute.manager [req-5c682ae6-cfe5-410d-85ed-12285ff13aab req-0223dae3-829c-4651-bb4f-ca7b98ad4923 service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Refreshing instance network info cache due to event network-changed-7319b474-9cbb-4012-992b-b6e41c507433. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:16:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5c682ae6-cfe5-410d-85ed-12285ff13aab req-0223dae3-829c-4651-bb4f-ca7b98ad4923 service nova] Acquiring lock "refresh_cache-b00766a3-5171-4022-8cb3-77ea9c8c5db6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:16:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5c682ae6-cfe5-410d-85ed-12285ff13aab req-0223dae3-829c-4651-bb4f-ca7b98ad4923 service nova] Acquired lock "refresh_cache-b00766a3-5171-4022-8cb3-77ea9c8c5db6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:16:14 user nova-compute[72809]: DEBUG nova.network.neutron [req-5c682ae6-cfe5-410d-85ed-12285ff13aab req-0223dae3-829c-4651-bb4f-ca7b98ad4923 service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Refreshing network info cache for port 7319b474-9cbb-4012-992b-b6e41c507433 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:16:15 user nova-compute[72809]: DEBUG nova.network.neutron [req-5c682ae6-cfe5-410d-85ed-12285ff13aab req-0223dae3-829c-4651-bb4f-ca7b98ad4923 service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Updated VIF entry in instance network info cache for port 7319b474-9cbb-4012-992b-b6e41c507433. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:16:15 user nova-compute[72809]: DEBUG nova.network.neutron [req-5c682ae6-cfe5-410d-85ed-12285ff13aab req-0223dae3-829c-4651-bb4f-ca7b98ad4923 service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Updating instance_info_cache with network_info: [{"id": "7319b474-9cbb-4012-992b-b6e41c507433", "address": "fa:16:3e:46:ed:75", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7319b474-9c", "ovs_interfaceid": "7319b474-9cbb-4012-992b-b6e41c507433", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:16:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5c682ae6-cfe5-410d-85ed-12285ff13aab req-0223dae3-829c-4651-bb4f-ca7b98ad4923 service nova] Releasing lock "refresh_cache-b00766a3-5171-4022-8cb3-77ea9c8c5db6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:16:15 user nova-compute[72809]: DEBUG nova.compute.manager [req-69f3ba5e-9859-401b-a3f3-534d4231c31d req-0aa5f0dd-60cf-4149-9a10-4ee15432e57f service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Received event network-changed-7319b474-9cbb-4012-992b-b6e41c507433 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:16:15 user nova-compute[72809]: DEBUG nova.compute.manager [req-69f3ba5e-9859-401b-a3f3-534d4231c31d req-0aa5f0dd-60cf-4149-9a10-4ee15432e57f service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Refreshing instance network info cache due to event network-changed-7319b474-9cbb-4012-992b-b6e41c507433. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:16:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-69f3ba5e-9859-401b-a3f3-534d4231c31d req-0aa5f0dd-60cf-4149-9a10-4ee15432e57f service nova] Acquiring lock "refresh_cache-b00766a3-5171-4022-8cb3-77ea9c8c5db6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:16:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-69f3ba5e-9859-401b-a3f3-534d4231c31d req-0aa5f0dd-60cf-4149-9a10-4ee15432e57f service nova] Acquired lock "refresh_cache-b00766a3-5171-4022-8cb3-77ea9c8c5db6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:16:15 user nova-compute[72809]: DEBUG nova.network.neutron [req-69f3ba5e-9859-401b-a3f3-534d4231c31d req-0aa5f0dd-60cf-4149-9a10-4ee15432e57f service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Refreshing network info cache for port 7319b474-9cbb-4012-992b-b6e41c507433 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:16:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:16:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:16:15 user nova-compute[72809]: INFO nova.compute.manager [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Detaching volume 2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5
Aug 09 07:16:15 user nova-compute[72809]: INFO nova.virt.block_device [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Attempting to driver detach volume 2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 from mountpoint /dev/vdb
Aug 09 07:16:15 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Attempting to detach device vdb from instance b00766a3-5171-4022-8cb3-77ea9c8c5db6 from the persistent domain config. {{(pid=72809) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 07:16:15 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:16:15 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:16:15 user nova-compute[72809]:   <source dev="/dev/sde"/>
Aug 09 07:16:15 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:16:15 user nova-compute[72809]:   <serial>2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5</serial>
Aug 09 07:16:15 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 07:16:15 user nova-compute[72809]: </disk>
Aug 09 07:16:15 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:16:15 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Successfully detached device vdb from instance b00766a3-5171-4022-8cb3-77ea9c8c5db6 from the persistent domain config.
Aug 09 07:16:15 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b00766a3-5171-4022-8cb3-77ea9c8c5db6 from the live domain config. {{(pid=72809) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 07:16:15 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:16:15 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:16:15 user nova-compute[72809]:   <source dev="/dev/sde"/>
Aug 09 07:16:15 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:16:15 user nova-compute[72809]:   <serial>2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5</serial>
Aug 09 07:16:15 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 07:16:15 user nova-compute[72809]: </disk>
Aug 09 07:16:15 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:16:15 user nova-compute[72809]: DEBUG nova.network.neutron [req-69f3ba5e-9859-401b-a3f3-534d4231c31d req-0aa5f0dd-60cf-4149-9a10-4ee15432e57f service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Updated VIF entry in instance network info cache for port 7319b474-9cbb-4012-992b-b6e41c507433. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:16:15 user nova-compute[72809]: DEBUG nova.network.neutron [req-69f3ba5e-9859-401b-a3f3-534d4231c31d req-0aa5f0dd-60cf-4149-9a10-4ee15432e57f service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Updating instance_info_cache with network_info: [{"id": "7319b474-9cbb-4012-992b-b6e41c507433", "address": "fa:16:3e:46:ed:75", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7319b474-9c", "ovs_interfaceid": "7319b474-9cbb-4012-992b-b6e41c507433", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:16:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-69f3ba5e-9859-401b-a3f3-534d4231c31d req-0aa5f0dd-60cf-4149-9a10-4ee15432e57f service nova] Releasing lock "refresh_cache-b00766a3-5171-4022-8cb3-77ea9c8c5db6" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Received event <DeviceRemovedEvent: 1691565376.201829, b00766a3-5171-4022-8cb3-77ea9c8c5db6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72809) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b00766a3-5171-4022-8cb3-77ea9c8c5db6 {{(pid=72809) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 07:16:16 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Successfully detached device vdb from instance b00766a3-5171-4022-8cb3-77ea9c8c5db6 from the live domain config.
Aug 09 07:16:16 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMqIHPRk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:16:16 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:16:16 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5325f01-ed7e-4250-a651-214cc684d727]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f281657a-b169-4d53-ad6f-9d876067870d]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)
Aug 09 07:16:16 user nova-compute[72809]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f (non-flash)
Aug 09 07:16:16 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 (non-flash)
Aug 09 07:16:16 user nova-compute[72809]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f (non-flash)
Aug 09 07:16:16 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc13851ea70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5'): ({'sde'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Removing single pathed devices sde {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[747db650-dec4-4aac-8593-ca344863ccf1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c992ae12-41ba-47ac-87c8-822d73874614]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Flushing IO for device /dev/sde {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afb93fa-0f52-4f8c-a9f4-d18aed946b1f]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.031s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6fd927-ba2f-4f71-8970-27798201ea72]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] SCSI volumes sde have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c09074-f133-4554-a281-eb4fd72122ec]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[1376d57e-be99-4009-84af-97047c11be65]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5, portal: 172.16.0.220,3260]
Aug 09 07:16:16 user nova-compute[72809]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5, portal: 172.16.0.220,3260] successful.
Aug 09 07:16:16 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b180ce9-19d2-4e8d-b266-cec1e7ff0cb5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3262073a-a3fa-49e8-b002-2cc0e5bac424]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.246s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] <== disconnect_volume: return (247ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:16:16 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:16:17 user nova-compute[72809]: DEBUG nova.objects.instance [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lazy-loading 'flavor' on Instance uuid b00766a3-5171-4022-8cb3-77ea9c8c5db6 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:16:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-6027fee7-037d-4960-84a3-97ffe6fc2824 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.567s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:16:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:16:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:16:24 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691565369.156759, 466a8e58-5f88-4ffe-a7fd-a346003f3508 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:16:24 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] VM Stopped (Lifecycle Event)
Aug 09 07:16:24 user nova-compute[72809]: DEBUG nova.compute.manager [None req-5bc95399-cd23-473d-84db-1f0347d27f08 None None] [instance: 466a8e58-5f88-4ffe-a7fd-a346003f3508] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:16:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:16:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:16:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72809) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 07:16:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:16:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:16:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:16:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:16:34 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:16:35 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:16:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:16:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:16:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:16:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:16:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72809) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 07:16:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:16:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:16:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:16:44 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:16:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:16:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:16:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:16:44 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 07:16:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:16:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:16:45 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:16:46 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:16:46 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:16:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=8246MB free_disk=25.01865005493164GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 07:16:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:16:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:16:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 339372ed-140d-4226-ba00-2cc682214d5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:16:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance b00766a3-5171-4022-8cb3-77ea9c8c5db6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:16:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:16:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 8798d9fd-e562-4acc-b076-0f4a5d56c0a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:16:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 07:16:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 07:16:46 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:16:46 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:16:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 07:16:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:16:47 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:16:47 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 07:16:47 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Rebuilding the list of instances to heal {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 07:16:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-339372ed-140d-4226-ba00-2cc682214d5c" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:16:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-339372ed-140d-4226-ba00-2cc682214d5c" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:16:47 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 07:16:47 user nova-compute[72809]: DEBUG nova.objects.instance [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lazy-loading 'info_cache' on Instance uuid 339372ed-140d-4226-ba00-2cc682214d5c {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:16:47 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Updating instance_info_cache with network_info: [{"id": "b50b65dc-a03d-4f22-bb35-f2b9dc67596d", "address": "fa:16:3e:67:6b:ac", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50b65dc-a0", "ovs_interfaceid": "b50b65dc-a03d-4f22-bb35-f2b9dc67596d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:16:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-339372ed-140d-4226-ba00-2cc682214d5c" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:16:47 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 07:16:47 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:16:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:16:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:16:54 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:16:54 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:16:55 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:16:57 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:16:58 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:16:58 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 07:16:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:16:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9c5ea1d7-139b-4cb3-b573-2c996fe98969 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "339372ed-140d-4226-ba00-2cc682214d5c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:16:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9c5ea1d7-139b-4cb3-b573-2c996fe98969 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "339372ed-140d-4226-ba00-2cc682214d5c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:16:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9c5ea1d7-139b-4cb3-b573-2c996fe98969 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "339372ed-140d-4226-ba00-2cc682214d5c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:16:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9c5ea1d7-139b-4cb3-b573-2c996fe98969 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "339372ed-140d-4226-ba00-2cc682214d5c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:16:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9c5ea1d7-139b-4cb3-b573-2c996fe98969 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "339372ed-140d-4226-ba00-2cc682214d5c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:16:59 user nova-compute[72809]: INFO nova.compute.manager [None req-9c5ea1d7-139b-4cb3-b573-2c996fe98969 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Terminating instance
Aug 09 07:16:59 user nova-compute[72809]: DEBUG nova.compute.manager [None req-9c5ea1d7-139b-4cb3-b573-2c996fe98969 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:16:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:16:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:16:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:16:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:17:00 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Instance destroyed successfully.
Aug 09 07:17:00 user nova-compute[72809]: DEBUG nova.objects.instance [None req-9c5ea1d7-139b-4cb3-b573-2c996fe98969 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lazy-loading 'resources' on Instance uuid 339372ed-140d-4226-ba00-2cc682214d5c {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:17:00 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-9c5ea1d7-139b-4cb3-b573-2c996fe98969 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T06:57:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-908521016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-908521016',id=22,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T06:57:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1903437f7ed4c14a0660f64a2e0c647',ramdisk_id='',reservation_id='r-d41q0ihr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-917311946',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T06:59:18Z,user_data=None,user_id='6c4c5942852b412885a5b4698552058d',uuid=339372ed-140d-4226-ba00-2cc682214d5c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b50b65dc-a03d-4f22-bb35-f2b9dc67596d", "address": "fa:16:3e:67:6b:ac", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50b65dc-a0", "ovs_interfaceid": "b50b65dc-a03d-4f22-bb35-f2b9dc67596d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:17:00 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-9c5ea1d7-139b-4cb3-b573-2c996fe98969 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Converting VIF {"id": "b50b65dc-a03d-4f22-bb35-f2b9dc67596d", "address": "fa:16:3e:67:6b:ac", "network": {"id": "5f03b0f9-e80d-428f-b0a6-57158568e620", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1285101977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1903437f7ed4c14a0660f64a2e0c647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50b65dc-a0", "ovs_interfaceid": "b50b65dc-a03d-4f22-bb35-f2b9dc67596d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:17:00 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-9c5ea1d7-139b-4cb3-b573-2c996fe98969 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:6b:ac,bridge_name='br-int',has_traffic_filtering=True,id=b50b65dc-a03d-4f22-bb35-f2b9dc67596d,network=Network(5f03b0f9-e80d-428f-b0a6-57158568e620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb50b65dc-a0') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:17:00 user nova-compute[72809]: DEBUG os_vif [None req-9c5ea1d7-139b-4cb3-b573-2c996fe98969 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:6b:ac,bridge_name='br-int',has_traffic_filtering=True,id=b50b65dc-a03d-4f22-bb35-f2b9dc67596d,network=Network(5f03b0f9-e80d-428f-b0a6-57158568e620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb50b65dc-a0') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:17:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:17:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb50b65dc-a0, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:17:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:17:00 user nova-compute[72809]: INFO os_vif [None req-9c5ea1d7-139b-4cb3-b573-2c996fe98969 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:6b:ac,bridge_name='br-int',has_traffic_filtering=True,id=b50b65dc-a03d-4f22-bb35-f2b9dc67596d,network=Network(5f03b0f9-e80d-428f-b0a6-57158568e620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb50b65dc-a0')
Aug 09 07:17:00 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-9c5ea1d7-139b-4cb3-b573-2c996fe98969 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Deleting instance files /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c_del
Aug 09 07:17:00 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-9c5ea1d7-139b-4cb3-b573-2c996fe98969 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Deletion of /opt/stack/data/nova/instances/339372ed-140d-4226-ba00-2cc682214d5c_del complete
Aug 09 07:17:00 user nova-compute[72809]: INFO nova.compute.manager [None req-9c5ea1d7-139b-4cb3-b573-2c996fe98969 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Took 0.66 seconds to destroy the instance on the hypervisor.
Aug 09 07:17:00 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-9c5ea1d7-139b-4cb3-b573-2c996fe98969 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:17:00 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:17:00 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:17:00 user nova-compute[72809]: DEBUG nova.compute.manager [req-a53e4ab7-c460-4894-b67e-539da80221e1 req-8568cdcb-3b94-4a52-b325-869667cd7a05 service nova] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Received event network-vif-unplugged-b50b65dc-a03d-4f22-bb35-f2b9dc67596d {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:17:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a53e4ab7-c460-4894-b67e-539da80221e1 req-8568cdcb-3b94-4a52-b325-869667cd7a05 service nova] Acquiring lock "339372ed-140d-4226-ba00-2cc682214d5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:17:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a53e4ab7-c460-4894-b67e-539da80221e1 req-8568cdcb-3b94-4a52-b325-869667cd7a05 service nova] Lock "339372ed-140d-4226-ba00-2cc682214d5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:17:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a53e4ab7-c460-4894-b67e-539da80221e1 req-8568cdcb-3b94-4a52-b325-869667cd7a05 service nova] Lock "339372ed-140d-4226-ba00-2cc682214d5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:17:00 user nova-compute[72809]: DEBUG nova.compute.manager [req-a53e4ab7-c460-4894-b67e-539da80221e1 req-8568cdcb-3b94-4a52-b325-869667cd7a05 service nova] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] No waiting events found dispatching network-vif-unplugged-b50b65dc-a03d-4f22-bb35-f2b9dc67596d {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:17:00 user nova-compute[72809]: DEBUG nova.compute.manager [req-a53e4ab7-c460-4894-b67e-539da80221e1 req-8568cdcb-3b94-4a52-b325-869667cd7a05 service nova] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Received event network-vif-unplugged-b50b65dc-a03d-4f22-bb35-f2b9dc67596d for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:17:00 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:17:00 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Took 0.61 seconds to deallocate network for instance.
Aug 09 07:17:00 user nova-compute[72809]: DEBUG nova.compute.manager [req-82c52b9e-3a33-4741-87cc-92ffb1969a86 req-e5588a17-9634-4b5f-a7e7-9ff10cc8017b service nova] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Received event network-vif-deleted-b50b65dc-a03d-4f22-bb35-f2b9dc67596d {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:17:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9c5ea1d7-139b-4cb3-b573-2c996fe98969 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:17:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9c5ea1d7-139b-4cb3-b573-2c996fe98969 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:17:01 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-9c5ea1d7-139b-4cb3-b573-2c996fe98969 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:17:01 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-9c5ea1d7-139b-4cb3-b573-2c996fe98969 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:17:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9c5ea1d7-139b-4cb3-b573-2c996fe98969 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:17:01 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-9c5ea1d7-139b-4cb3-b573-2c996fe98969 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Deleted allocations for instance 339372ed-140d-4226-ba00-2cc682214d5c
Aug 09 07:17:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-9c5ea1d7-139b-4cb3-b573-2c996fe98969 tempest-ServerBootFromVolumeStableRescueTest-917311946 tempest-ServerBootFromVolumeStableRescueTest-917311946-project-member] Lock "339372ed-140d-4226-ba00-2cc682214d5c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.669s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:17:02 user nova-compute[72809]: DEBUG nova.compute.manager [req-911d49dc-f719-4d90-80dd-a7b8ebbb559f req-49b88b72-1818-4814-82da-6af3f442936e service nova] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Received event network-vif-plugged-b50b65dc-a03d-4f22-bb35-f2b9dc67596d {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:17:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-911d49dc-f719-4d90-80dd-a7b8ebbb559f req-49b88b72-1818-4814-82da-6af3f442936e service nova] Acquiring lock "339372ed-140d-4226-ba00-2cc682214d5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:17:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-911d49dc-f719-4d90-80dd-a7b8ebbb559f req-49b88b72-1818-4814-82da-6af3f442936e service nova] Lock "339372ed-140d-4226-ba00-2cc682214d5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:17:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-911d49dc-f719-4d90-80dd-a7b8ebbb559f req-49b88b72-1818-4814-82da-6af3f442936e service nova] Lock "339372ed-140d-4226-ba00-2cc682214d5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:17:02 user nova-compute[72809]: DEBUG nova.compute.manager [req-911d49dc-f719-4d90-80dd-a7b8ebbb559f req-49b88b72-1818-4814-82da-6af3f442936e service nova] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] No waiting events found dispatching network-vif-plugged-b50b65dc-a03d-4f22-bb35-f2b9dc67596d {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:17:02 user nova-compute[72809]: WARNING nova.compute.manager [req-911d49dc-f719-4d90-80dd-a7b8ebbb559f req-49b88b72-1818-4814-82da-6af3f442936e service nova] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Received unexpected event network-vif-plugged-b50b65dc-a03d-4f22-bb35-f2b9dc67596d for instance with vm_state deleted and task_state None.
Aug 09 07:17:03 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:17:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:17:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquiring lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:17:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:17:06 user nova-compute[72809]: DEBUG nova.objects.instance [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lazy-loading 'flavor' on Instance uuid 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:17:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:17:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquiring lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:17:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:17:06 user nova-compute[72809]: INFO nova.compute.manager [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Attaching volume 86a55a14-3f64-4385-b509-1320359e97bd to /dev/vdb
Aug 09 07:17:06 user nova-compute[72809]: DEBUG os_brick.utils [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:17:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8b0e21-30dd-4ca6-8d1c-ea321633a42b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ecfd1b-b638-4e1d-971b-39e0a3b8e9be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d6613a-99be-4c12-8350-2e52ee8ebf88]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[589fcaa4-dcf8-47b9-9671-dc5d99057ba5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:17:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 07:17:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:06 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:17:06 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 07:17:06 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[34875bc9-1b32-4801-bc82-954f423c5426]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 07:17:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 07:17:06 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 07:17:06 user nova-compute[72809]: DEBUG os_brick.utils [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:17:06 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Updating existing volume attachment record: 8a0064b2-71de-46b8-923f-935be293fabf {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 07:17:07 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:17:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:17:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:17:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "8798d9fd-e562-4acc-b076-0f4a5d56c0a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:17:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "8798d9fd-e562-4acc-b076-0f4a5d56c0a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:17:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "8798d9fd-e562-4acc-b076-0f4a5d56c0a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:17:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "8798d9fd-e562-4acc-b076-0f4a5d56c0a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:17:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "8798d9fd-e562-4acc-b076-0f4a5d56c0a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:17:10 user nova-compute[72809]: INFO nova.compute.manager [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Terminating instance
Aug 09 07:17:10 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:17:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:17:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:17:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:17:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:17:10 user nova-compute[72809]: DEBUG nova.compute.manager [req-d52358f2-9c00-4b17-a5ff-5762ef537ea2 req-f89325d4-cf72-4ba3-9bd3-99ddb974c4b6 service nova] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Received event network-vif-unplugged-540e5264-643d-4aa8-8119-ee69542e55af {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:17:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d52358f2-9c00-4b17-a5ff-5762ef537ea2 req-f89325d4-cf72-4ba3-9bd3-99ddb974c4b6 service nova] Acquiring lock "8798d9fd-e562-4acc-b076-0f4a5d56c0a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:17:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d52358f2-9c00-4b17-a5ff-5762ef537ea2 req-f89325d4-cf72-4ba3-9bd3-99ddb974c4b6 service nova] Lock "8798d9fd-e562-4acc-b076-0f4a5d56c0a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:17:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d52358f2-9c00-4b17-a5ff-5762ef537ea2 req-f89325d4-cf72-4ba3-9bd3-99ddb974c4b6 service nova] Lock "8798d9fd-e562-4acc-b076-0f4a5d56c0a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:17:10 user nova-compute[72809]: DEBUG nova.compute.manager [req-d52358f2-9c00-4b17-a5ff-5762ef537ea2 req-f89325d4-cf72-4ba3-9bd3-99ddb974c4b6 service nova] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] No waiting events found dispatching network-vif-unplugged-540e5264-643d-4aa8-8119-ee69542e55af {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:17:10 user nova-compute[72809]: DEBUG nova.compute.manager [req-d52358f2-9c00-4b17-a5ff-5762ef537ea2 req-f89325d4-cf72-4ba3-9bd3-99ddb974c4b6 service nova] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Received event network-vif-unplugged-540e5264-643d-4aa8-8119-ee69542e55af for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:17:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:17:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:17:10 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Instance destroyed successfully.
Aug 09 07:17:10 user nova-compute[72809]: DEBUG nova.objects.instance [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lazy-loading 'resources' on Instance uuid 8798d9fd-e562-4acc-b076-0f4a5d56c0a6 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:17:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:15:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-980317520',display_name='tempest-TestVolumeBootPattern-server-980317520',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-980317520',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:15:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8cdcd8241b9b47eab16a6e37a9cc5f54',ramdisk_id='',reservation_id='r-vi8eu9ra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-224847517',owner_user_name='tempest-TestVolumeBootPattern-224847517-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:15:39Z,user_data=None,user_id='a7859a38408b426eb9a14ef003483bd3',uuid=8798d9fd-e562-4acc-b076-0f4a5d56c0a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "540e5264-643d-4aa8-8119-ee69542e55af", "address": "fa:16:3e:b0:31:61", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e5264-64", "ovs_interfaceid": "540e5264-643d-4aa8-8119-ee69542e55af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:17:10 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converting VIF {"id": "540e5264-643d-4aa8-8119-ee69542e55af", "address": "fa:16:3e:b0:31:61", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e5264-64", "ovs_interfaceid": "540e5264-643d-4aa8-8119-ee69542e55af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:17:10 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:31:61,bridge_name='br-int',has_traffic_filtering=True,id=540e5264-643d-4aa8-8119-ee69542e55af,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap540e5264-64') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:17:10 user nova-compute[72809]: DEBUG os_vif [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:31:61,bridge_name='br-int',has_traffic_filtering=True,id=540e5264-643d-4aa8-8119-ee69542e55af,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap540e5264-64') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:17:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:17:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap540e5264-64, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:17:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:17:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:17:10 user nova-compute[72809]: INFO os_vif [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:31:61,bridge_name='br-int',has_traffic_filtering=True,id=540e5264-643d-4aa8-8119-ee69542e55af,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap540e5264-64')
Aug 09 07:17:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:17:10 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Udfiuonr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:17:10 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:17:10 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:17:10 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:17:10 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:17:10 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f26b582-f450-42d6-9852-4ea555acd659]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fc08ecb-0991-4577-90ab-8de852480801\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91f1661-a3b4-4d00-b4b2-af70e12cb025]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc08ecb-0991-4577-90ab-8de852480801 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f (non-flash)
Aug 09 07:17:11 user nova-compute[72809]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc08ecb-0991-4577-90ab-8de852480801 (non-flash)
Aug 09 07:17:11 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f (non-flash)
Aug 09 07:17:11 user nova-compute[72809]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc08ecb-0991-4577-90ab-8de852480801 (non-flash)
Aug 09 07:17:11 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc138712710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f'): ({'sdc'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Removing single pathed devices sdc {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2edbc6-31f3-4bbc-8ef9-394886e64b44]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cb94a6-3c92-4a21-804d-b7c9810f86e7]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Flushing IO for device /dev/sdc {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b431ff-5198-42b5-bfff-0716afe4aa25]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7c8c93-2f45-4833-a191-08e1e48cd3ee]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] SCSI volumes sdc have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO47db290d-33ff98e91bdbaa08', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_47db290d', '/dev/disk/by-id/scsi-23333666639386539') {{(pid=83900) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[da080073-5df8-4acc-b5e8-5399f3288b34]: (4, None) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce382ae-a44d-4513-b528-3433a0810b1e]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96c621f-bdd5-4f42-97e6-5d402fff42a5]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f, portal: 172.16.0.220,3260]
Aug 09 07:17:11 user nova-compute[72809]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f, portal: 172.16.0.220,3260] successful.
Aug 09 07:17:11 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8f01dd-e3a1-4e44-b862-4bf5f385db0f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[95384bbc-3231-412e-9c7d-a854d088dac4]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] <== disconnect_volume: return (297ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:17:11 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Deleting instance files /opt/stack/data/nova/instances/8798d9fd-e562-4acc-b076-0f4a5d56c0a6_del
Aug 09 07:17:11 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Deletion of /opt/stack/data/nova/instances/8798d9fd-e562-4acc-b076-0f4a5d56c0a6_del complete
Aug 09 07:17:11 user nova-compute[72809]: INFO nova.compute.manager [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 09 07:17:11 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-06d2d6fe-7445-40e3-a934-a440a70c94ac tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-06d2d6fe-7445-40e3-a934-a440a70c94ac tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-06d2d6fe-7445-40e3-a934-a440a70c94ac tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-06d2d6fe-7445-40e3-a934-a440a70c94ac tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-06d2d6fe-7445-40e3-a934-a440a70c94ac tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:17:11 user nova-compute[72809]: INFO nova.compute.manager [None req-06d2d6fe-7445-40e3-a934-a440a70c94ac tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Terminating instance
Aug 09 07:17:11 user nova-compute[72809]: DEBUG nova.compute.manager [None req-06d2d6fe-7445-40e3-a934-a440a70c94ac tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:17:11 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:17:11 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Took 0.59 seconds to deallocate network for instance.
Aug 09 07:17:11 user nova-compute[72809]: DEBUG nova.compute.manager [req-8b2d1c0c-23cd-4b7c-ac47-40d8425b84fa req-f1debab9-8d59-46d9-989c-af452f1fde91 service nova] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Received event network-vif-deleted-540e5264-643d-4aa8-8119-ee69542e55af {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:17:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:17:12 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Instance destroyed successfully.
Aug 09 07:17:12 user nova-compute[72809]: DEBUG nova.objects.instance [None req-06d2d6fe-7445-40e3-a934-a440a70c94ac tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lazy-loading 'resources' on Instance uuid b00766a3-5171-4022-8cb3-77ea9c8c5db6 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:17:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-06d2d6fe-7445-40e3-a934-a440a70c94ac tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:11:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-275542902',display_name='tempest-TestMinimumBasicScenario-server-275542902',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-275542902',id=42,image_ref='69804617-2d9d-4732-9fa3-a2e99341612f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL66oBtNaPzlMlbKOWSTNg47DcXATsR8KBT9Ay3EFhkFcRH3fzS+FojTgaNiLQ7xi0/BINtV7FyabX+JzG2grwDO2Ln+2KY2fSwekJmdD/VuoBWBGR5Q8FWtvVx4WLi/MQ==',key_name='tempest-TestMinimumBasicScenario-838682356',keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:12:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96695e79164d4b9d836be01cad13efd8',ramdisk_id='',reservation_id='r-a2twhv46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='69804617-2d9d-4732-9fa3-a2e99341612f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1810598523',owner_user_name='tempest-TestMinimumBasicScenario-1810598523-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:14:32Z,user_data=None,user_id='ed97d2c12b4b408cb1ab70dc60b2170d',uuid=b00766a3-5171-4022-8cb3-77ea9c8c5db6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7319b474-9cbb-4012-992b-b6e41c507433", "address": "fa:16:3e:46:ed:75", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7319b474-9c", "ovs_interfaceid": "7319b474-9cbb-4012-992b-b6e41c507433", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:17:12 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-06d2d6fe-7445-40e3-a934-a440a70c94ac tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Converting VIF {"id": "7319b474-9cbb-4012-992b-b6e41c507433", "address": "fa:16:3e:46:ed:75", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7319b474-9c", "ovs_interfaceid": "7319b474-9cbb-4012-992b-b6e41c507433", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:17:12 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-06d2d6fe-7445-40e3-a934-a440a70c94ac tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:ed:75,bridge_name='br-int',has_traffic_filtering=True,id=7319b474-9cbb-4012-992b-b6e41c507433,network=Network(0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7319b474-9c') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:17:12 user nova-compute[72809]: DEBUG os_vif [None req-06d2d6fe-7445-40e3-a934-a440a70c94ac tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:ed:75,bridge_name='br-int',has_traffic_filtering=True,id=7319b474-9cbb-4012-992b-b6e41c507433,network=Network(0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7319b474-9c') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:17:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:17:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7319b474-9c, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:17:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:17:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:17:12 user nova-compute[72809]: INFO os_vif [None req-06d2d6fe-7445-40e3-a934-a440a70c94ac tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:ed:75,bridge_name='br-int',has_traffic_filtering=True,id=7319b474-9cbb-4012-992b-b6e41c507433,network=Network(0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7319b474-9c')
Aug 09 07:17:12 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-06d2d6fe-7445-40e3-a934-a440a70c94ac tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Deleting instance files /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6_del
Aug 09 07:17:12 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-06d2d6fe-7445-40e3-a934-a440a70c94ac tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Deletion of /opt/stack/data/nova/instances/b00766a3-5171-4022-8cb3-77ea9c8c5db6_del complete
Aug 09 07:17:12 user nova-compute[72809]: INFO nova.compute.manager [None req-06d2d6fe-7445-40e3-a934-a440a70c94ac tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 09 07:17:12 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-06d2d6fe-7445-40e3-a934-a440a70c94ac tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:17:12 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:17:12 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:17:12 user nova-compute[72809]: DEBUG nova.compute.manager [req-ecabf8b6-c9f7-4dde-89e2-af4fe895b353 req-af772d6a-9467-43a0-b103-e2bc0381acbb service nova] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Received event network-vif-plugged-540e5264-643d-4aa8-8119-ee69542e55af {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:17:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ecabf8b6-c9f7-4dde-89e2-af4fe895b353 req-af772d6a-9467-43a0-b103-e2bc0381acbb service nova] Acquiring lock "8798d9fd-e562-4acc-b076-0f4a5d56c0a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:17:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ecabf8b6-c9f7-4dde-89e2-af4fe895b353 req-af772d6a-9467-43a0-b103-e2bc0381acbb service nova] Lock "8798d9fd-e562-4acc-b076-0f4a5d56c0a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:17:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ecabf8b6-c9f7-4dde-89e2-af4fe895b353 req-af772d6a-9467-43a0-b103-e2bc0381acbb service nova] Lock "8798d9fd-e562-4acc-b076-0f4a5d56c0a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:17:12 user nova-compute[72809]: DEBUG nova.compute.manager [req-ecabf8b6-c9f7-4dde-89e2-af4fe895b353 req-af772d6a-9467-43a0-b103-e2bc0381acbb service nova] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] No waiting events found dispatching network-vif-plugged-540e5264-643d-4aa8-8119-ee69542e55af {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:17:12 user nova-compute[72809]: WARNING nova.compute.manager [req-ecabf8b6-c9f7-4dde-89e2-af4fe895b353 req-af772d6a-9467-43a0-b103-e2bc0381acbb service nova] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Received unexpected event network-vif-plugged-540e5264-643d-4aa8-8119-ee69542e55af for instance with vm_state active and task_state deleting.
Aug 09 07:17:12 user nova-compute[72809]: DEBUG nova.compute.manager [req-ecabf8b6-c9f7-4dde-89e2-af4fe895b353 req-af772d6a-9467-43a0-b103-e2bc0381acbb service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Received event network-vif-unplugged-7319b474-9cbb-4012-992b-b6e41c507433 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:17:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ecabf8b6-c9f7-4dde-89e2-af4fe895b353 req-af772d6a-9467-43a0-b103-e2bc0381acbb service nova] Acquiring lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:17:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ecabf8b6-c9f7-4dde-89e2-af4fe895b353 req-af772d6a-9467-43a0-b103-e2bc0381acbb service nova] Lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:17:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ecabf8b6-c9f7-4dde-89e2-af4fe895b353 req-af772d6a-9467-43a0-b103-e2bc0381acbb service nova] Lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:17:12 user nova-compute[72809]: DEBUG nova.compute.manager [req-ecabf8b6-c9f7-4dde-89e2-af4fe895b353 req-af772d6a-9467-43a0-b103-e2bc0381acbb service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] No waiting events found dispatching network-vif-unplugged-7319b474-9cbb-4012-992b-b6e41c507433 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:17:12 user nova-compute[72809]: DEBUG nova.compute.manager [req-ecabf8b6-c9f7-4dde-89e2-af4fe895b353 req-af772d6a-9467-43a0-b103-e2bc0381acbb service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Received event network-vif-unplugged-7319b474-9cbb-4012-992b-b6e41c507433 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:17:12 user nova-compute[72809]: DEBUG nova.compute.manager [req-ecabf8b6-c9f7-4dde-89e2-af4fe895b353 req-af772d6a-9467-43a0-b103-e2bc0381acbb service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Received event network-vif-plugged-7319b474-9cbb-4012-992b-b6e41c507433 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:17:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ecabf8b6-c9f7-4dde-89e2-af4fe895b353 req-af772d6a-9467-43a0-b103-e2bc0381acbb service nova] Acquiring lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:17:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ecabf8b6-c9f7-4dde-89e2-af4fe895b353 req-af772d6a-9467-43a0-b103-e2bc0381acbb service nova] Lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:17:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ecabf8b6-c9f7-4dde-89e2-af4fe895b353 req-af772d6a-9467-43a0-b103-e2bc0381acbb service nova] Lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:17:12 user nova-compute[72809]: DEBUG nova.compute.manager [req-ecabf8b6-c9f7-4dde-89e2-af4fe895b353 req-af772d6a-9467-43a0-b103-e2bc0381acbb service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] No waiting events found dispatching network-vif-plugged-7319b474-9cbb-4012-992b-b6e41c507433 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:17:12 user nova-compute[72809]: WARNING nova.compute.manager [req-ecabf8b6-c9f7-4dde-89e2-af4fe895b353 req-af772d6a-9467-43a0-b103-e2bc0381acbb service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Received unexpected event network-vif-plugged-7319b474-9cbb-4012-992b-b6e41c507433 for instance with vm_state active and task_state deleting.
Aug 09 07:17:13 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:17:13 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Took 0.72 seconds to deallocate network for instance.
Aug 09 07:17:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-06d2d6fe-7445-40e3-a934-a440a70c94ac tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:17:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-06d2d6fe-7445-40e3-a934-a440a70c94ac tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:17:13 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-06d2d6fe-7445-40e3-a934-a440a70c94ac tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:17:13 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-06d2d6fe-7445-40e3-a934-a440a70c94ac tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:17:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-06d2d6fe-7445-40e3-a934-a440a70c94ac tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.175s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:17:13 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-06d2d6fe-7445-40e3-a934-a440a70c94ac tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Deleted allocations for instance b00766a3-5171-4022-8cb3-77ea9c8c5db6
Aug 09 07:17:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-06d2d6fe-7445-40e3-a934-a440a70c94ac tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "b00766a3-5171-4022-8cb3-77ea9c8c5db6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.987s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:17:14 user nova-compute[72809]: DEBUG nova.compute.manager [req-45e877d8-79b5-48b1-8069-41a9f02fad2c req-e65982d7-1a9e-4eeb-bc93-5e498ac51861 service nova] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Received event network-vif-deleted-7319b474-9cbb-4012-992b-b6e41c507433 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691565420.1092985, 339372ed-140d-4226-ba00-2cc682214d5c => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:17:15 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] VM Stopped (Lifecycle Event)
Aug 09 07:17:15 user nova-compute[72809]: DEBUG nova.compute.manager [None req-15bdf2ca-3f5a-4689-aba3-c732adf771cb None None] [instance: 339372ed-140d-4226-ba00-2cc682214d5c] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJWkwzqF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:17:15 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:17:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:17:15 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:17:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:17:15 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 07:17:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfcd8c6-82b1-47c9-ab74-3ef239f99bc3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 07:17:15 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae99c6d-f90e-4f94-9b7e-d16943b7acff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd] added
Aug 09 07:17:15 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[643a423c-9404-4cdc-98f1-f6fdfa609848]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ed5884-a2af-4d1c-bfb6-ca3cc6fdf06c]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pJWkwzqF {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pJWkwzqF" returned: 0 in 0.027s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[702ea225-54bb-45e8-a5fe-249988874bba]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pJWkwzqF'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28c5a68-e6a2-4222-a503-fc62e9e1dce2]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6537a0-1df4-4b47-be46-982afc411445]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc08ecb-0991-4577-90ab-8de852480801 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc08ecb-0991-4577-90ab-8de852480801 (non-flash)
Aug 09 07:17:15 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc08ecb-0991-4577-90ab-8de852480801 (non-flash)
Aug 09 07:17:15 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[20eb5415-297c-41be-9bdd-5602ab4e2ef5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd, portal: 172.16.0.220,3260]
Aug 09 07:17:15 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd, portal: 172.16.0.220,3260] successful.
Aug 09 07:17:15 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0573bf-9f5a-4026-b35e-f424f65dc36c]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f1e77e-1c4a-4109-a53c-aff1a2202211]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc08ecb-0991-4577-90ab-8de852480801 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc08ecb-0991-4577-90ab-8de852480801 (non-flash)
Aug 09 07:17:15 user nova-compute[72809]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd (non-flash)
Aug 09 07:17:15 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc08ecb-0991-4577-90ab-8de852480801 (non-flash)
Aug 09 07:17:15 user nova-compute[72809]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd (non-flash)
Aug 09 07:17:15 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0d3618-42de-4ccb-95bf-7161465cf260]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:17:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJWkwzqF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 07:17:16 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:17:16 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26161363864303137', 'path': '/dev/sdc'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:17:16 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161363864303137', 'path': '/dev/sdc'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 07:17:16 user nova-compute[72809]: DEBUG nova.objects.instance [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lazy-loading 'flavor' on Instance uuid 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:17:16 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 07:17:16 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:17:16 user nova-compute[72809]:   <source dev="/dev/sdc"/>
Aug 09 07:17:16 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:17:16 user nova-compute[72809]:   <serial>86a55a14-3f64-4385-b509-1320359e97bd</serial>
Aug 09 07:17:16 user nova-compute[72809]: </disk>
Aug 09 07:17:16 user nova-compute[72809]:  {{(pid=72809) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 07:17:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:17:17 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:17:17 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:17:17 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] No VIF found with MAC fa:16:3e:3d:dc:e9, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:17:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-201a6635-2b70-4d90-9c59-dd9caf5597ea tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.917s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:17:18 user nova-compute[72809]: INFO nova.compute.manager [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Took 6.11 seconds to detach 1 volumes for instance.
Aug 09 07:17:18 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Deleting volume: 7e8f01dd-e3a1-4e44-b862-4bf5f385db0f {{(pid=72809) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 07:17:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:17:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:17:18 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:17:18 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:17:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:17:18 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Deleted allocations for instance 8798d9fd-e562-4acc-b076-0f4a5d56c0a6
Aug 09 07:17:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bb60dbe9-d484-46e6-8748-f56a1dd33706 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "8798d9fd-e562-4acc-b076-0f4a5d56c0a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.293s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:17:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquiring lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:17:20 user nova-compute[72809]: INFO nova.compute.manager [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Detaching volume 86a55a14-3f64-4385-b509-1320359e97bd
Aug 09 07:17:20 user nova-compute[72809]: INFO nova.virt.block_device [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Attempting to driver detach volume 86a55a14-3f64-4385-b509-1320359e97bd from mountpoint /dev/vdb
Aug 09 07:17:20 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Attempting to detach device vdb from instance 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 from the persistent domain config. {{(pid=72809) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:17:20 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:17:20 user nova-compute[72809]:   <source dev="/dev/sdc"/>
Aug 09 07:17:20 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:17:20 user nova-compute[72809]:   <serial>86a55a14-3f64-4385-b509-1320359e97bd</serial>
Aug 09 07:17:20 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 07:17:20 user nova-compute[72809]: </disk>
Aug 09 07:17:20 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:17:20 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Successfully detached device vdb from instance 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 from the persistent domain config.
Aug 09 07:17:20 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 from the live domain config. {{(pid=72809) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:17:20 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:17:20 user nova-compute[72809]:   <source dev="/dev/sdc"/>
Aug 09 07:17:20 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:17:20 user nova-compute[72809]:   <serial>86a55a14-3f64-4385-b509-1320359e97bd</serial>
Aug 09 07:17:20 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 07:17:20 user nova-compute[72809]: </disk>
Aug 09 07:17:20 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Received event <DeviceRemovedEvent: 1691565440.6164668, 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72809) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 {{(pid=72809) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 07:17:20 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Successfully detached device vdb from instance 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 from the live domain config.
Aug 09 07:17:20 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJWkwzqF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:17:20 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:17:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8352a28-e873-4810-a152-cfbac9ade475]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fc08ecb-0991-4577-90ab-8de852480801\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e991c5e4-23ec-4ff4-ba71-3ae73bd8dc15\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5343b54c-0b56-4cbc-9980-39dd13176254]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc08ecb-0991-4577-90ab-8de852480801 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e991c5e4-23ec-4ff4-ba71-3ae73bd8dc15 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc08ecb-0991-4577-90ab-8de852480801 (non-flash)
Aug 09 07:17:20 user nova-compute[72809]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd (non-flash)
Aug 09 07:17:20 user nova-compute[72809]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e991c5e4-23ec-4ff4-ba71-3ae73bd8dc15 (non-flash)
Aug 09 07:17:20 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc08ecb-0991-4577-90ab-8de852480801 (non-flash)
Aug 09 07:17:20 user nova-compute[72809]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd (non-flash)
Aug 09 07:17:20 user nova-compute[72809]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e991c5e4-23ec-4ff4-ba71-3ae73bd8dc15 (non-flash)
Aug 09 07:17:20 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc1383853f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd'): ({'sdc'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Removing single pathed devices sdc {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f54f8e-f68e-4e95-91f7-24076e98b528]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ef3080-1ff4-409b-a22c-5b24180fb097]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Flushing IO for device /dev/sdc {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4e01aa-c52e-4aca-b3f0-50c0f1d8ca6b]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d56b7b3-f5f2-4fb5-87b6-7ddad9f511ff]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] SCSI volumes sdc have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ceed14b-541d-4d33-a9af-bc8248097b43]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7649814e-015e-4fe1-8c2c-819aa8a09e1c]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd, portal: 172.16.0.220,3260]
Aug 09 07:17:20 user nova-compute[72809]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd, portal: 172.16.0.220,3260] successful.
Aug 09 07:17:20 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86a55a14-3f64-4385-b509-1320359e97bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9971cb-03c5-4810-8175-56b5294138bb]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] <== disconnect_volume: return (267ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:17:20 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:17:21 user nova-compute[72809]: DEBUG nova.objects.instance [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lazy-loading 'flavor' on Instance uuid 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:17:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-38d28e84-539b-4f4f-8ded-f8b3389fc1ae tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.712s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:17:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:17:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:17:25 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691565430.9502838, 8798d9fd-e562-4acc-b076-0f4a5d56c0a6 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:17:25 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] VM Stopped (Lifecycle Event)
Aug 09 07:17:25 user nova-compute[72809]: DEBUG nova.compute.manager [None req-4ec08358-7bbf-40ee-8697-5bf026b62658 None None] [instance: 8798d9fd-e562-4acc-b076-0f4a5d56c0a6] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:17:27 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691565432.351209, b00766a3-5171-4022-8cb3-77ea9c8c5db6 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:17:27 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] VM Stopped (Lifecycle Event)
Aug 09 07:17:27 user nova-compute[72809]: DEBUG nova.compute.manager [None req-40483d75-71de-4f31-a9db-e9127a61980d None None] [instance: b00766a3-5171-4022-8cb3-77ea9c8c5db6] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:17:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:17:32 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:17:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:17:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:17:44 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:17:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:17:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:17:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:17:44 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 07:17:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:44 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:17:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:17:45 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:17:45 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:17:45 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=8557MB free_disk=25.16189193725586GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 07:17:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:17:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:17:45 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:17:45 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 07:17:45 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 07:17:45 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:17:45 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:17:45 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 07:17:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:17:46 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:17:46 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 07:17:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:17:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:17:46 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 07:17:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:17:47 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Updating instance_info_cache with network_info: [{"id": "4ccb4018-12aa-43f0-95d9-3021c4b8e61e", "address": "fa:16:3e:3d:dc:e9", "network": {"id": "1aa93c25-f23b-4acf-83dc-407d71f0284f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2043026175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29c65ac1c7649c1bc05bd790821801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccb4018-12", "ovs_interfaceid": "4ccb4018-12aa-43f0-95d9-3021c4b8e61e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:17:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:17:47 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 07:17:47 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:17:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:17:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:17:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:17:55 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:17:55 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:17:55 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:17:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:17:58 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:17:58 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 07:17:59 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:18:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:04 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:18:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "2f07bffa-786c-4024-b0d4-c6155417d3ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:18:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "2f07bffa-786c-4024-b0d4-c6155417d3ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:18:06 user nova-compute[72809]: DEBUG nova.compute.manager [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 07:18:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:18:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:18:06 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 07:18:06 user nova-compute[72809]: INFO nova.compute.claims [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Claim successful on node user
Aug 09 07:18:06 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:18:06 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:18:06 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.260s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:18:06 user nova-compute[72809]: DEBUG nova.compute.manager [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 07:18:06 user nova-compute[72809]: DEBUG nova.compute.manager [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 07:18:06 user nova-compute[72809]: DEBUG nova.network.neutron [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 07:18:06 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 07:18:06 user nova-compute[72809]: DEBUG nova.compute.manager [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 07:18:07 user nova-compute[72809]: DEBUG nova.policy [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ed97d2c12b4b408cb1ab70dc60b2170d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96695e79164d4b9d836be01cad13efd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 07:18:07 user nova-compute[72809]: DEBUG nova.compute.manager [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 07:18:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 07:18:07 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Creating image(s)
Aug 09 07:18:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:18:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "/opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:18:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "/opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.050s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:18:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "fa3e19b4bdca7c6a929199d624f3d57192bee977" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:18:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "fa3e19b4bdca7c6a929199d624f3d57192bee977" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:18:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa3e19b4bdca7c6a929199d624f3d57192bee977.part --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:07 user nova-compute[72809]: DEBUG nova.network.neutron [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Successfully created port: 4c62a706-971f-4153-9d45-1fcb03ece3eb {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 07:18:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa3e19b4bdca7c6a929199d624f3d57192bee977.part --force-share --output=json" returned: 0 in 0.168s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:08 user nova-compute[72809]: DEBUG nova.virt.images [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] d4e0bb26-cf78-4499-9838-7faa7f7eb3b2 was qcow2, converting to raw {{(pid=72809) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 07:18:08 user nova-compute[72809]: DEBUG nova.privsep.utils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72809) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 07:18:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fa3e19b4bdca7c6a929199d624f3d57192bee977.part /opt/stack/data/nova/instances/_base/fa3e19b4bdca7c6a929199d624f3d57192bee977.converted {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fa3e19b4bdca7c6a929199d624f3d57192bee977.part /opt/stack/data/nova/instances/_base/fa3e19b4bdca7c6a929199d624f3d57192bee977.converted" returned: 0 in 0.251s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa3e19b4bdca7c6a929199d624f3d57192bee977.converted --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa3e19b4bdca7c6a929199d624f3d57192bee977.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "fa3e19b4bdca7c6a929199d624f3d57192bee977" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.234s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:18:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa3e19b4bdca7c6a929199d624f3d57192bee977 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa3e19b4bdca7c6a929199d624f3d57192bee977 --force-share --output=json" returned: 0 in 0.146s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "fa3e19b4bdca7c6a929199d624f3d57192bee977" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:18:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "fa3e19b4bdca7c6a929199d624f3d57192bee977" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:18:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa3e19b4bdca7c6a929199d624f3d57192bee977 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa3e19b4bdca7c6a929199d624f3d57192bee977 --force-share --output=json" returned: 0 in 0.147s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa3e19b4bdca7c6a929199d624f3d57192bee977,backing_fmt=raw /opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:08 user nova-compute[72809]: DEBUG nova.network.neutron [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Successfully updated port: 4c62a706-971f-4153-9d45-1fcb03ece3eb {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 07:18:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa3e19b4bdca7c6a929199d624f3d57192bee977,backing_fmt=raw /opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba/disk 1073741824" returned: 0 in 0.075s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "fa3e19b4bdca7c6a929199d624f3d57192bee977" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:18:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa3e19b4bdca7c6a929199d624f3d57192bee977 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "refresh_cache-2f07bffa-786c-4024-b0d4-c6155417d3ba" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:18:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquired lock "refresh_cache-2f07bffa-786c-4024-b0d4-c6155417d3ba" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:18:08 user nova-compute[72809]: DEBUG nova.network.neutron [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:18:08 user nova-compute[72809]: DEBUG nova.compute.manager [req-a8ef57c7-6528-4d5d-90bc-2f1183493d45 req-e1975eda-59db-4466-96fd-4ccce95eb5d8 service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Received event network-changed-4c62a706-971f-4153-9d45-1fcb03ece3eb {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:18:08 user nova-compute[72809]: DEBUG nova.compute.manager [req-a8ef57c7-6528-4d5d-90bc-2f1183493d45 req-e1975eda-59db-4466-96fd-4ccce95eb5d8 service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Refreshing instance network info cache due to event network-changed-4c62a706-971f-4153-9d45-1fcb03ece3eb. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:18:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a8ef57c7-6528-4d5d-90bc-2f1183493d45 req-e1975eda-59db-4466-96fd-4ccce95eb5d8 service nova] Acquiring lock "refresh_cache-2f07bffa-786c-4024-b0d4-c6155417d3ba" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:18:08 user nova-compute[72809]: DEBUG nova.network.neutron [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa3e19b4bdca7c6a929199d624f3d57192bee977 --force-share --output=json" returned: 0 in 0.161s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Cannot resize image /opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.objects.instance [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lazy-loading 'migration_context' on Instance uuid 2f07bffa-786c-4024-b0d4-c6155417d3ba {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Ensure instance console log exists: /opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.network.neutron [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Updating instance_info_cache with network_info: [{"id": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "address": "fa:16:3e:23:0e:15", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c62a706-97", "ovs_interfaceid": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Releasing lock "refresh_cache-2f07bffa-786c-4024-b0d4-c6155417d3ba" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.compute.manager [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Instance network_info: |[{"id": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "address": "fa:16:3e:23:0e:15", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c62a706-97", "ovs_interfaceid": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a8ef57c7-6528-4d5d-90bc-2f1183493d45 req-e1975eda-59db-4466-96fd-4ccce95eb5d8 service nova] Acquired lock "refresh_cache-2f07bffa-786c-4024-b0d4-c6155417d3ba" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.network.neutron [req-a8ef57c7-6528-4d5d-90bc-2f1183493d45 req-e1975eda-59db-4466-96fd-4ccce95eb5d8 service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Refreshing network info cache for port 4c62a706-971f-4153-9d45-1fcb03ece3eb {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Start _get_guest_xml network_info=[{"id": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "address": "fa:16:3e:23:0e:15", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c62a706-97", "ovs_interfaceid": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T07:18:03Z,direct_url=<?>,disk_format='qcow2',id=d4e0bb26-cf78-4499-9838-7faa7f7eb3b2,min_disk=0,min_ram=0,name='tempest-scenario-img--1882611071',owner='96695e79164d4b9d836be01cad13efd8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T07:18:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'd4e0bb26-cf78-4499-9838-7faa7f7eb3b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 07:18:09 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:18:09 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T07:18:03Z,direct_url=<?>,disk_format='qcow2',id=d4e0bb26-cf78-4499-9838-7faa7f7eb3b2,min_disk=0,min_ram=0,name='tempest-scenario-img--1882611071',owner='96695e79164d4b9d836be01cad13efd8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T07:18:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:18:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1974636058',display_name='tempest-TestMinimumBasicScenario-server-1974636058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1974636058',id=45,image_ref='d4e0bb26-cf78-4499-9838-7faa7f7eb3b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDP5Ae9+WUjvoYH5T6pFGI0XvMT74Gjj4Kj/FfzkhVviBqxtfzs90JWsfpGWEhBtsZ5Wz/Pq33E686ioVr4tXD3oqJrv+aAynCYI65flCYaj6eHu/70oTdLKqroGV3DKnA==',key_name='tempest-TestMinimumBasicScenario-1501750792',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96695e79164d4b9d836be01cad13efd8',ramdisk_id='',reservation_id='r-a1umsdzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d4e0bb26-cf78-4499-9838-7faa7f7eb3b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1810598523',owner_user_name='tempest-TestMinimumBasicScenario-1810598523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:18:07Z,user_data=None,user_id='ed97d2c12b4b408cb1ab70dc60b2170d',uuid=2f07bffa-786c-4024-b0d4-c6155417d3ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "address": "fa:16:3e:23:0e:15", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c62a706-97", "ovs_interfaceid": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Converting VIF {"id": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "address": "fa:16:3e:23:0e:15", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c62a706-97", "ovs_interfaceid": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:0e:15,bridge_name='br-int',has_traffic_filtering=True,id=4c62a706-971f-4153-9d45-1fcb03ece3eb,network=Network(0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c62a706-97') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.objects.instance [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f07bffa-786c-4024-b0d4-c6155417d3ba {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] End _get_guest_xml xml=<domain type="kvm">
Aug 09 07:18:09 user nova-compute[72809]:   <uuid>2f07bffa-786c-4024-b0d4-c6155417d3ba</uuid>
Aug 09 07:18:09 user nova-compute[72809]:   <name>instance-0000002d</name>
Aug 09 07:18:09 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 07:18:09 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 07:18:09 user nova-compute[72809]:   <metadata>
Aug 09 07:18:09 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 07:18:09 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 07:18:09 user nova-compute[72809]:       <nova:name>tempest-TestMinimumBasicScenario-server-1974636058</nova:name>
Aug 09 07:18:09 user nova-compute[72809]:       <nova:creationTime>2023-08-09 07:18:09</nova:creationTime>
Aug 09 07:18:09 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 07:18:09 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 07:18:09 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 07:18:09 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 07:18:09 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 07:18:09 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 07:18:09 user nova-compute[72809]:       </nova:flavor>
Aug 09 07:18:09 user nova-compute[72809]:       <nova:owner>
Aug 09 07:18:09 user nova-compute[72809]:         <nova:user uuid="ed97d2c12b4b408cb1ab70dc60b2170d">tempest-TestMinimumBasicScenario-1810598523-project-member</nova:user>
Aug 09 07:18:09 user nova-compute[72809]:         <nova:project uuid="96695e79164d4b9d836be01cad13efd8">tempest-TestMinimumBasicScenario-1810598523</nova:project>
Aug 09 07:18:09 user nova-compute[72809]:       </nova:owner>
Aug 09 07:18:09 user nova-compute[72809]:       <nova:root type="image" uuid="d4e0bb26-cf78-4499-9838-7faa7f7eb3b2"/>
Aug 09 07:18:09 user nova-compute[72809]:       <nova:ports>
Aug 09 07:18:09 user nova-compute[72809]:         <nova:port uuid="4c62a706-971f-4153-9d45-1fcb03ece3eb">
Aug 09 07:18:09 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 07:18:09 user nova-compute[72809]:         </nova:port>
Aug 09 07:18:09 user nova-compute[72809]:       </nova:ports>
Aug 09 07:18:09 user nova-compute[72809]:     </nova:instance>
Aug 09 07:18:09 user nova-compute[72809]:   </metadata>
Aug 09 07:18:09 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 07:18:09 user nova-compute[72809]:     <system>
Aug 09 07:18:09 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 07:18:09 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 07:18:09 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 07:18:09 user nova-compute[72809]:       <entry name="serial">2f07bffa-786c-4024-b0d4-c6155417d3ba</entry>
Aug 09 07:18:09 user nova-compute[72809]:       <entry name="uuid">2f07bffa-786c-4024-b0d4-c6155417d3ba</entry>
Aug 09 07:18:09 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 07:18:09 user nova-compute[72809]:     </system>
Aug 09 07:18:09 user nova-compute[72809]:   </sysinfo>
Aug 09 07:18:09 user nova-compute[72809]:   <os>
Aug 09 07:18:09 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 07:18:09 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 07:18:09 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 07:18:09 user nova-compute[72809]:   </os>
Aug 09 07:18:09 user nova-compute[72809]:   <features>
Aug 09 07:18:09 user nova-compute[72809]:     <acpi/>
Aug 09 07:18:09 user nova-compute[72809]:     <apic/>
Aug 09 07:18:09 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 07:18:09 user nova-compute[72809]:   </features>
Aug 09 07:18:09 user nova-compute[72809]:   <clock offset="utc">
Aug 09 07:18:09 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 07:18:09 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 07:18:09 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 07:18:09 user nova-compute[72809]:   </clock>
Aug 09 07:18:09 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 07:18:09 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 07:18:09 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 07:18:09 user nova-compute[72809]:   </cpu>
Aug 09 07:18:09 user nova-compute[72809]:   <devices>
Aug 09 07:18:09 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 07:18:09 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 07:18:09 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba/disk"/>
Aug 09 07:18:09 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 07:18:09 user nova-compute[72809]:     </disk>
Aug 09 07:18:09 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 07:18:09 user nova-compute[72809]:       <mac address="fa:16:3e:23:0e:15"/>
Aug 09 07:18:09 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:18:09 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 07:18:09 user nova-compute[72809]:       <target dev="tap4c62a706-97"/>
Aug 09 07:18:09 user nova-compute[72809]:     </interface>
Aug 09 07:18:09 user nova-compute[72809]:     <serial type="pty">
Aug 09 07:18:09 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba/console.log" append="off"/>
Aug 09 07:18:09 user nova-compute[72809]:     </serial>
Aug 09 07:18:09 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 07:18:09 user nova-compute[72809]:     <video>
Aug 09 07:18:09 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:18:09 user nova-compute[72809]:     </video>
Aug 09 07:18:09 user nova-compute[72809]:     <rng model="virtio">
Aug 09 07:18:09 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 07:18:09 user nova-compute[72809]:     </rng>
Aug 09 07:18:09 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 07:18:09 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 07:18:09 user nova-compute[72809]:       <stats period="10"/>
Aug 09 07:18:09 user nova-compute[72809]:     </memballoon>
Aug 09 07:18:09 user nova-compute[72809]:   </devices>
Aug 09 07:18:09 user nova-compute[72809]: </domain>
Aug 09 07:18:09 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:18:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1974636058',display_name='tempest-TestMinimumBasicScenario-server-1974636058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1974636058',id=45,image_ref='d4e0bb26-cf78-4499-9838-7faa7f7eb3b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDP5Ae9+WUjvoYH5T6pFGI0XvMT74Gjj4Kj/FfzkhVviBqxtfzs90JWsfpGWEhBtsZ5Wz/Pq33E686ioVr4tXD3oqJrv+aAynCYI65flCYaj6eHu/70oTdLKqroGV3DKnA==',key_name='tempest-TestMinimumBasicScenario-1501750792',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96695e79164d4b9d836be01cad13efd8',ramdisk_id='',reservation_id='r-a1umsdzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d4e0bb26-cf78-4499-9838-7faa7f7eb3b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1810598523',owner_user_name='tempest-TestMinimumBasicScenario-1810598523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:18:07Z,user_data=None,user_id='ed97d2c12b4b408cb1ab70dc60b2170d',uuid=2f07bffa-786c-4024-b0d4-c6155417d3ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "address": "fa:16:3e:23:0e:15", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c62a706-97", "ovs_interfaceid": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Converting VIF {"id": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "address": "fa:16:3e:23:0e:15", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c62a706-97", "ovs_interfaceid": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:0e:15,bridge_name='br-int',has_traffic_filtering=True,id=4c62a706-971f-4153-9d45-1fcb03ece3eb,network=Network(0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c62a706-97') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG os_vif [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:0e:15,bridge_name='br-int',has_traffic_filtering=True,id=4c62a706-971f-4153-9d45-1fcb03ece3eb,network=Network(0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c62a706-97') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c62a706-97, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4c62a706-97, col_values=(('external_ids', {'iface-id': '4c62a706-971f-4153-9d45-1fcb03ece3eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:0e:15', 'vm-uuid': '2f07bffa-786c-4024-b0d4-c6155417d3ba'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:09 user nova-compute[72809]: INFO os_vif [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:0e:15,bridge_name='br-int',has_traffic_filtering=True,id=4c62a706-971f-4153-9d45-1fcb03ece3eb,network=Network(0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c62a706-97')
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] No VIF found with MAC fa:16:3e:23:0e:15, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.network.neutron [req-a8ef57c7-6528-4d5d-90bc-2f1183493d45 req-e1975eda-59db-4466-96fd-4ccce95eb5d8 service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Updated VIF entry in instance network info cache for port 4c62a706-971f-4153-9d45-1fcb03ece3eb. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG nova.network.neutron [req-a8ef57c7-6528-4d5d-90bc-2f1183493d45 req-e1975eda-59db-4466-96fd-4ccce95eb5d8 service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Updating instance_info_cache with network_info: [{"id": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "address": "fa:16:3e:23:0e:15", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c62a706-97", "ovs_interfaceid": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:18:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a8ef57c7-6528-4d5d-90bc-2f1183493d45 req-e1975eda-59db-4466-96fd-4ccce95eb5d8 service nova] Releasing lock "refresh_cache-2f07bffa-786c-4024-b0d4-c6155417d3ba" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:18:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:11 user nova-compute[72809]: DEBUG nova.compute.manager [req-79679f6d-1a9a-4efa-a857-021c5dd23169 req-4ae92e9d-b90b-495b-8541-93f35413c9e5 service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Received event network-vif-plugged-4c62a706-971f-4153-9d45-1fcb03ece3eb {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:18:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-79679f6d-1a9a-4efa-a857-021c5dd23169 req-4ae92e9d-b90b-495b-8541-93f35413c9e5 service nova] Acquiring lock "2f07bffa-786c-4024-b0d4-c6155417d3ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:18:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-79679f6d-1a9a-4efa-a857-021c5dd23169 req-4ae92e9d-b90b-495b-8541-93f35413c9e5 service nova] Lock "2f07bffa-786c-4024-b0d4-c6155417d3ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:18:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-79679f6d-1a9a-4efa-a857-021c5dd23169 req-4ae92e9d-b90b-495b-8541-93f35413c9e5 service nova] Lock "2f07bffa-786c-4024-b0d4-c6155417d3ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:18:11 user nova-compute[72809]: DEBUG nova.compute.manager [req-79679f6d-1a9a-4efa-a857-021c5dd23169 req-4ae92e9d-b90b-495b-8541-93f35413c9e5 service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] No waiting events found dispatching network-vif-plugged-4c62a706-971f-4153-9d45-1fcb03ece3eb {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:18:11 user nova-compute[72809]: WARNING nova.compute.manager [req-79679f6d-1a9a-4efa-a857-021c5dd23169 req-4ae92e9d-b90b-495b-8541-93f35413c9e5 service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Received unexpected event network-vif-plugged-4c62a706-971f-4153-9d45-1fcb03ece3eb for instance with vm_state building and task_state spawning.
Aug 09 07:18:11 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:11 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:11 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:13 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691565493.1284661, 2f07bffa-786c-4024-b0d4-c6155417d3ba => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:18:13 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] VM Resumed (Lifecycle Event)
Aug 09 07:18:13 user nova-compute[72809]: DEBUG nova.compute.manager [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 07:18:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 07:18:13 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Instance spawned successfully.
Aug 09 07:18:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 07:18:13 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:18:13 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:18:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:18:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:18:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:18:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:18:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:18:13 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:18:13 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:18:13 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691565493.1312747, 2f07bffa-786c-4024-b0d4-c6155417d3ba => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:18:13 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] VM Started (Lifecycle Event)
Aug 09 07:18:13 user nova-compute[72809]: DEBUG nova.compute.manager [req-77f89ac5-60a6-4819-8ca6-6a8624d34976 req-ed7b6be3-b4e3-4cb3-a8b1-c83a8cf74cbf service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Received event network-vif-plugged-4c62a706-971f-4153-9d45-1fcb03ece3eb {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:18:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-77f89ac5-60a6-4819-8ca6-6a8624d34976 req-ed7b6be3-b4e3-4cb3-a8b1-c83a8cf74cbf service nova] Acquiring lock "2f07bffa-786c-4024-b0d4-c6155417d3ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:18:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-77f89ac5-60a6-4819-8ca6-6a8624d34976 req-ed7b6be3-b4e3-4cb3-a8b1-c83a8cf74cbf service nova] Lock "2f07bffa-786c-4024-b0d4-c6155417d3ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:18:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-77f89ac5-60a6-4819-8ca6-6a8624d34976 req-ed7b6be3-b4e3-4cb3-a8b1-c83a8cf74cbf service nova] Lock "2f07bffa-786c-4024-b0d4-c6155417d3ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:18:13 user nova-compute[72809]: DEBUG nova.compute.manager [req-77f89ac5-60a6-4819-8ca6-6a8624d34976 req-ed7b6be3-b4e3-4cb3-a8b1-c83a8cf74cbf service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] No waiting events found dispatching network-vif-plugged-4c62a706-971f-4153-9d45-1fcb03ece3eb {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:18:13 user nova-compute[72809]: WARNING nova.compute.manager [req-77f89ac5-60a6-4819-8ca6-6a8624d34976 req-ed7b6be3-b4e3-4cb3-a8b1-c83a8cf74cbf service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Received unexpected event network-vif-plugged-4c62a706-971f-4153-9d45-1fcb03ece3eb for instance with vm_state building and task_state spawning.
Aug 09 07:18:13 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:18:13 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:18:13 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:18:13 user nova-compute[72809]: INFO nova.compute.manager [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Took 6.10 seconds to spawn the instance on the hypervisor.
Aug 09 07:18:13 user nova-compute[72809]: DEBUG nova.compute.manager [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:18:13 user nova-compute[72809]: INFO nova.compute.manager [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Took 6.77 seconds to build instance.
Aug 09 07:18:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3dcf7cee-5f3e-4c79-b6d1-f3be0682f2ff tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "2f07bffa-786c-4024-b0d4-c6155417d3ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.881s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:18:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquiring lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:18:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:18:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:14 user nova-compute[72809]: DEBUG nova.objects.instance [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lazy-loading 'flavor' on Instance uuid 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:18:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:18:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquiring lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:18:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:18:14 user nova-compute[72809]: INFO nova.compute.manager [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Attaching volume 7a2277bd-4025-4125-bc20-80628fa4b4ef to /dev/vdb
Aug 09 07:18:14 user nova-compute[72809]: DEBUG os_brick.utils [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:18:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:14 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5e8b7c-6a17-475d-beeb-54662f72fa08]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:14 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f351f9-e9e7-4007-a394-fd241502f4e8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:14 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[531d5416-0df6-4a52-bc0d-50e9b1583e84]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:14 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4eefa76-707c-4d56-a731-73015be0b8a3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:18:14 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 07:18:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:14 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:18:14 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 07:18:14 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f66f1c4-dafa-4a21-a603-41399b0a1f92]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:14 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 07:18:14 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 07:18:14 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 07:18:14 user nova-compute[72809]: DEBUG os_brick.utils [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:18:14 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Updating existing volume attachment record: 1afae437-6e4b-476d-bbf0-3f9da3b7c1f3 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 07:18:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KUjvnlDI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:18:23 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:18:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:18:23 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:18:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:18:23 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ab26a1-8292-4855-b954-b473e078b032]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 07:18:23 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc0425f-d13d-426c-970d-f5e97344fc02]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef] added
Aug 09 07:18:23 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e160f40-edd6-4ab0-a85f-5dc5568964d2]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb4b152-f159-4941-8a95-7974023910e1]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KUjvnlDI {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KUjvnlDI" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5113a1f-1188-4572-b655-a8456ca9421b]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KUjvnlDI'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6e8560-7dd8-43e9-b67e-29491c2acf80]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[46444570-0058-46a9-923f-f1b50c8987a9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 07:18:23 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 07:18:23 user nova-compute[72809]:  {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:18:23 user nova-compute[72809]: WARNING os_brick.initiator.connectors.iscsi [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 07:18:23 user nova-compute[72809]: 
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6fe8d0-57a9-4504-a16e-02bb8948a24d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef, portal: 172.16.0.220,3260]
Aug 09 07:18:23 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef, portal: 172.16.0.220,3260] successful.
Aug 09 07:18:23 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7781128-6d25-467d-b8a4-9eed74867efc]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[206fbdca-4072-420a-93ab-9b283e26476a]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef (non-flash)
Aug 09 07:18:23 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef (non-flash)
Aug 09 07:18:23 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e4e19a-5110-4456-b51c-41911f24653f]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "476ced47-d6f0-4581-9d12-39f5b1fe90d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "476ced47-d6f0-4581-9d12-39f5b1fe90d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG nova.compute.manager [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 07:18:23 user nova-compute[72809]: INFO nova.compute.claims [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Claim successful on node user
Aug 09 07:18:23 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:18:23 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.251s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG nova.compute.manager [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG nova.compute.manager [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG nova.network.neutron [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 07:18:24 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 07:18:24 user nova-compute[72809]: DEBUG nova.compute.manager [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 07:18:24 user nova-compute[72809]: INFO nova.virt.block_device [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Booting with volume 865348e8-a951-4f53-95c5-3567766f503b at /dev/vda
Aug 09 07:18:24 user nova-compute[72809]: DEBUG nova.policy [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a7859a38408b426eb9a14ef003483bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8241b9b47eab16a6e37a9cc5f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG os_brick.utils [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ddbe8f-b233-42d2-95bd-d05c96188f8c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4116910b-09b4-42f6-9fe7-4fa45a6b527e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c25aa59-b93a-4912-8b0e-4f5ca638db9f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0693e4-a40d-4a1b-88e9-14a283dee437]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:18:24 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 07:18:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1af3d5-3f06-4a85-8205-55dbbc070e65]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG os_brick.utils [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Updating existing volume attachment record: fdaee089-cc46-456d-9b3e-ecf4f25ca11f {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KUjvnlDI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23631646262646137', 'path': '/dev/sdb'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631646262646137', 'path': '/dev/sdb'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG nova.objects.instance [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lazy-loading 'flavor' on Instance uuid 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 07:18:24 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:18:24 user nova-compute[72809]:   <source dev="/dev/sdb"/>
Aug 09 07:18:24 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:18:24 user nova-compute[72809]:   <serial>7a2277bd-4025-4125-bc20-80628fa4b4ef</serial>
Aug 09 07:18:24 user nova-compute[72809]: </disk>
Aug 09 07:18:24 user nova-compute[72809]:  {{(pid=72809) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG nova.network.neutron [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Successfully created port: c2ace49a-35ba-443f-a90a-7f43b3ea1079 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:18:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] No VIF found with MAC fa:16:3e:3d:dc:e9, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:18:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-3153d483-3f7a-4592-8115-da9b8e80ae02 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.493s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:18:26 user nova-compute[72809]: DEBUG nova.network.neutron [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Successfully updated port: c2ace49a-35ba-443f-a90a-7f43b3ea1079 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 07:18:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "refresh_cache-476ced47-d6f0-4581-9d12-39f5b1fe90d0" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:18:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquired lock "refresh_cache-476ced47-d6f0-4581-9d12-39f5b1fe90d0" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:18:26 user nova-compute[72809]: DEBUG nova.network.neutron [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:18:26 user nova-compute[72809]: DEBUG nova.compute.manager [req-1b9d77d6-3ecd-4b33-a9f7-50a0b0dffe49 req-e0fde159-74c5-4a83-9729-3f82f56a81ce service nova] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Received event network-changed-c2ace49a-35ba-443f-a90a-7f43b3ea1079 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:18:26 user nova-compute[72809]: DEBUG nova.compute.manager [req-1b9d77d6-3ecd-4b33-a9f7-50a0b0dffe49 req-e0fde159-74c5-4a83-9729-3f82f56a81ce service nova] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Refreshing instance network info cache due to event network-changed-c2ace49a-35ba-443f-a90a-7f43b3ea1079. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:18:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1b9d77d6-3ecd-4b33-a9f7-50a0b0dffe49 req-e0fde159-74c5-4a83-9729-3f82f56a81ce service nova] Acquiring lock "refresh_cache-476ced47-d6f0-4581-9d12-39f5b1fe90d0" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:18:26 user nova-compute[72809]: DEBUG nova.network.neutron [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 07:18:26 user nova-compute[72809]: DEBUG nova.network.neutron [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Updating instance_info_cache with network_info: [{"id": "c2ace49a-35ba-443f-a90a-7f43b3ea1079", "address": "fa:16:3e:9c:da:f2", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ace49a-35", "ovs_interfaceid": "c2ace49a-35ba-443f-a90a-7f43b3ea1079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:18:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Releasing lock "refresh_cache-476ced47-d6f0-4581-9d12-39f5b1fe90d0" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:18:26 user nova-compute[72809]: DEBUG nova.compute.manager [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Instance network_info: |[{"id": "c2ace49a-35ba-443f-a90a-7f43b3ea1079", "address": "fa:16:3e:9c:da:f2", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ace49a-35", "ovs_interfaceid": "c2ace49a-35ba-443f-a90a-7f43b3ea1079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 07:18:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1b9d77d6-3ecd-4b33-a9f7-50a0b0dffe49 req-e0fde159-74c5-4a83-9729-3f82f56a81ce service nova] Acquired lock "refresh_cache-476ced47-d6f0-4581-9d12-39f5b1fe90d0" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:18:26 user nova-compute[72809]: DEBUG nova.network.neutron [req-1b9d77d6-3ecd-4b33-a9f7-50a0b0dffe49 req-e0fde159-74c5-4a83-9729-3f82f56a81ce service nova] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Refreshing network info cache for port c2ace49a-35ba-443f-a90a-7f43b3ea1079 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:18:26 user nova-compute[72809]: DEBUG nova.network.neutron [req-1b9d77d6-3ecd-4b33-a9f7-50a0b0dffe49 req-e0fde159-74c5-4a83-9729-3f82f56a81ce service nova] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Updated VIF entry in instance network info cache for port c2ace49a-35ba-443f-a90a-7f43b3ea1079. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:18:26 user nova-compute[72809]: DEBUG nova.network.neutron [req-1b9d77d6-3ecd-4b33-a9f7-50a0b0dffe49 req-e0fde159-74c5-4a83-9729-3f82f56a81ce service nova] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Updating instance_info_cache with network_info: [{"id": "c2ace49a-35ba-443f-a90a-7f43b3ea1079", "address": "fa:16:3e:9c:da:f2", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ace49a-35", "ovs_interfaceid": "c2ace49a-35ba-443f-a90a-7f43b3ea1079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:18:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1b9d77d6-3ecd-4b33-a9f7-50a0b0dffe49 req-e0fde159-74c5-4a83-9729-3f82f56a81ce service nova] Releasing lock "refresh_cache-476ced47-d6f0-4581-9d12-39f5b1fe90d0" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquiring lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:18:27 user nova-compute[72809]: INFO nova.compute.manager [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Detaching volume 7a2277bd-4025-4125-bc20-80628fa4b4ef
Aug 09 07:18:27 user nova-compute[72809]: INFO nova.virt.block_device [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Attempting to driver detach volume 7a2277bd-4025-4125-bc20-80628fa4b4ef from mountpoint /dev/vdb
Aug 09 07:18:27 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Attempting to detach device vdb from instance 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 from the persistent domain config. {{(pid=72809) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:18:27 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:18:27 user nova-compute[72809]:   <source dev="/dev/sdb"/>
Aug 09 07:18:27 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:18:27 user nova-compute[72809]:   <serial>7a2277bd-4025-4125-bc20-80628fa4b4ef</serial>
Aug 09 07:18:27 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 07:18:27 user nova-compute[72809]: </disk>
Aug 09 07:18:27 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:18:27 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Successfully detached device vdb from instance 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 from the persistent domain config.
Aug 09 07:18:27 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 from the live domain config. {{(pid=72809) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:18:27 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:18:27 user nova-compute[72809]:   <source dev="/dev/sdb"/>
Aug 09 07:18:27 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:18:27 user nova-compute[72809]:   <serial>7a2277bd-4025-4125-bc20-80628fa4b4ef</serial>
Aug 09 07:18:27 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 07:18:27 user nova-compute[72809]: </disk>
Aug 09 07:18:27 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Received event <DeviceRemovedEvent: 1691565507.644982, 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72809) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 {{(pid=72809) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 07:18:27 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Successfully detached device vdb from instance 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 from the live domain config.
Aug 09 07:18:27 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KUjvnlDI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:18:27 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:18:27 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6227b1a8-7666-4482-acf2-496e11de9c16]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[63608010-4412-4219-a20e-df02b104b2d2]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef (non-flash)
Aug 09 07:18:27 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef (non-flash)
Aug 09 07:18:27 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc1585d4e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef'): ({'sdb'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Removing single pathed devices sdb {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7605290-d763-4474-ba32-e715f7884862]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[787746fc-eb69-4196-8532-d730ab43d2b8]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Flushing IO for device /dev/sdb {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[25855048-537c-46a4-806b-f1cc131d2494]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80f46a9-76d2-4439-a0de-fc09d923651b]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] SCSI volumes sdb have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[74dda1bd-4352-4dc8-9f21-0ccfca5eafac]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dabb22-7674-44a2-bdd8-f497c03b2035]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef, portal: 172.16.0.220,3260]
Aug 09 07:18:27 user nova-compute[72809]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef, portal: 172.16.0.220,3260] successful.
Aug 09 07:18:27 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a2277bd-4025-4125-bc20-80628fa4b4ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[105d8610-7472-4caf-84a2-69f0219aa82a]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] <== disconnect_volume: return (289ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:18:27 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:18:28 user nova-compute[72809]: DEBUG nova.objects.instance [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lazy-loading 'flavor' on Instance uuid 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:18:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-d6e99e50-0f16-44cd-bb04-904e05d558b4 tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.625s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:18:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG nova.compute.manager [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 07:18:32 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Creating image(s)
Aug 09 07:18:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Did not create local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Ensure instance console log exists: /opt/stack/data/nova/instances/476ced47-d6f0-4581-9d12-39f5b1fe90d0/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Start _get_guest_xml network_info=[{"id": "c2ace49a-35ba-443f-a90a-7f43b3ea1079", "address": "fa:16:3e:9c:da:f2", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ace49a-35", "ovs_interfaceid": "c2ace49a-35ba-443f-a90a-7f43b3ea1079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFWTSMCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '476ced47-d6f0-4581-9d12-39f5b1fe90d0', 'attached_at': '', 'detached_at': '', 'volume_id': '865348e8-a951-4f53-95c5-3567766f503b', 'serial': '865348e8-a951-4f53-95c5-3567766f503b'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'boot_index': 0, 'attachment_id': 'fdaee089-cc46-456d-9b3e-ecf4f25ca11f', 'volume_type': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 07:18:32 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:18:32 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:18:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFWTSMCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:18:32 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:18:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:18:32 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:18:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:18:32 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b04408-8c88-4627-b015-39e641b5e443]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 07:18:32 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4254e580-ebbd-4746-b635-814717d58d21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b] added
Aug 09 07:18:32 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32e0f7b-a748-4ec9-9ef2-45cf2d773193]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c9b46e-ecbb-4beb-991f-cfe691597c33]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pFWTSMCe {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pFWTSMCe" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[912dbdc1-fdd6-49c6-a4ae-78f89dbed169]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pFWTSMCe'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[51224879-1323-4853-b330-009f393f569a]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54616dd-cb71-40ee-a1f1-ce727c0f1b1c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 07:18:32 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 07:18:32 user nova-compute[72809]:  {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:18:32 user nova-compute[72809]: WARNING os_brick.initiator.connectors.iscsi [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 07:18:32 user nova-compute[72809]: 
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94636bd-29d5-4521-97d7-68d72897bff6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b, portal: 172.16.0.220,3260]
Aug 09 07:18:32 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b, portal: 172.16.0.220,3260] successful.
Aug 09 07:18:32 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cb5d4e-a17f-45f5-8236-adab3fb0fd43]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca383a6-2955-43c1-8cfd-941c89f28fd9]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b (non-flash)
Aug 09 07:18:32 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b (non-flash)
Aug 09 07:18:32 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a570c6ca-1cfc-4289-bcfb-535fd8b48428]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:18:32 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFWTSMCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 07:18:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:18:33 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23630323638366164', 'path': '/dev/sdb'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:18:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630323638366164', 'path': '/dev/sdb'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 07:18:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:18:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1843871379',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1843871379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1843871379',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdavMQws6q7edRXy8NJ16Qm+gSUVO27aTZ1DaMCFHMrfBdM4jGqf55yzB257uo62n/KNv1m4VV+P4y9gCCAJSzWYTkJPhIm2cb/tqgUOOmZDzyMoPj8rwyY4Pn8wk90Jw==',key_name='tempest-keypair-643055003',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cdcd8241b9b47eab16a6e37a9cc5f54',ramdisk_id='',reservation_id='r-e62mlyrz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-224847517',owner_user_name='tempest-TestVolumeBootPattern-224847517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:18:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7859a38408b426eb9a14ef003483bd3',uuid=476ced47-d6f0-4581-9d12-39f5b1fe90d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2ace49a-35ba-443f-a90a-7f43b3ea1079", "address": "fa:16:3e:9c:da:f2", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ace49a-35", "ovs_interfaceid": "c2ace49a-35ba-443f-a90a-7f43b3ea1079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 07:18:33 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converting VIF {"id": "c2ace49a-35ba-443f-a90a-7f43b3ea1079", "address": "fa:16:3e:9c:da:f2", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ace49a-35", "ovs_interfaceid": "c2ace49a-35ba-443f-a90a-7f43b3ea1079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:18:33 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:da:f2,bridge_name='br-int',has_traffic_filtering=True,id=c2ace49a-35ba-443f-a90a-7f43b3ea1079,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ace49a-35') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:18:33 user nova-compute[72809]: DEBUG nova.objects.instance [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lazy-loading 'pci_devices' on Instance uuid 476ced47-d6f0-4581-9d12-39f5b1fe90d0 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:18:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] End _get_guest_xml xml=<domain type="kvm">
Aug 09 07:18:33 user nova-compute[72809]:   <uuid>476ced47-d6f0-4581-9d12-39f5b1fe90d0</uuid>
Aug 09 07:18:33 user nova-compute[72809]:   <name>instance-0000002e</name>
Aug 09 07:18:33 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 07:18:33 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 07:18:33 user nova-compute[72809]:   <metadata>
Aug 09 07:18:33 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 07:18:33 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 07:18:33 user nova-compute[72809]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1843871379</nova:name>
Aug 09 07:18:33 user nova-compute[72809]:       <nova:creationTime>2023-08-09 07:18:32</nova:creationTime>
Aug 09 07:18:33 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 07:18:33 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 07:18:33 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 07:18:33 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 07:18:33 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 07:18:33 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 07:18:33 user nova-compute[72809]:       </nova:flavor>
Aug 09 07:18:33 user nova-compute[72809]:       <nova:owner>
Aug 09 07:18:33 user nova-compute[72809]:         <nova:user uuid="a7859a38408b426eb9a14ef003483bd3">tempest-TestVolumeBootPattern-224847517-project-member</nova:user>
Aug 09 07:18:33 user nova-compute[72809]:         <nova:project uuid="8cdcd8241b9b47eab16a6e37a9cc5f54">tempest-TestVolumeBootPattern-224847517</nova:project>
Aug 09 07:18:33 user nova-compute[72809]:       </nova:owner>
Aug 09 07:18:33 user nova-compute[72809]:       <nova:ports>
Aug 09 07:18:33 user nova-compute[72809]:         <nova:port uuid="c2ace49a-35ba-443f-a90a-7f43b3ea1079">
Aug 09 07:18:33 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 07:18:33 user nova-compute[72809]:         </nova:port>
Aug 09 07:18:33 user nova-compute[72809]:       </nova:ports>
Aug 09 07:18:33 user nova-compute[72809]:     </nova:instance>
Aug 09 07:18:33 user nova-compute[72809]:   </metadata>
Aug 09 07:18:33 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 07:18:33 user nova-compute[72809]:     <system>
Aug 09 07:18:33 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 07:18:33 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 07:18:33 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 07:18:33 user nova-compute[72809]:       <entry name="serial">476ced47-d6f0-4581-9d12-39f5b1fe90d0</entry>
Aug 09 07:18:33 user nova-compute[72809]:       <entry name="uuid">476ced47-d6f0-4581-9d12-39f5b1fe90d0</entry>
Aug 09 07:18:33 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 07:18:33 user nova-compute[72809]:     </system>
Aug 09 07:18:33 user nova-compute[72809]:   </sysinfo>
Aug 09 07:18:33 user nova-compute[72809]:   <os>
Aug 09 07:18:33 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 07:18:33 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 07:18:33 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 07:18:33 user nova-compute[72809]:   </os>
Aug 09 07:18:33 user nova-compute[72809]:   <features>
Aug 09 07:18:33 user nova-compute[72809]:     <acpi/>
Aug 09 07:18:33 user nova-compute[72809]:     <apic/>
Aug 09 07:18:33 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 07:18:33 user nova-compute[72809]:   </features>
Aug 09 07:18:33 user nova-compute[72809]:   <clock offset="utc">
Aug 09 07:18:33 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 07:18:33 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 07:18:33 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 07:18:33 user nova-compute[72809]:   </clock>
Aug 09 07:18:33 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 07:18:33 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 07:18:33 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 07:18:33 user nova-compute[72809]:   </cpu>
Aug 09 07:18:33 user nova-compute[72809]:   <devices>
Aug 09 07:18:33 user nova-compute[72809]:     <disk type="block" device="disk">
Aug 09 07:18:33 user nova-compute[72809]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:18:33 user nova-compute[72809]:       <source dev="/dev/sdb"/>
Aug 09 07:18:33 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 07:18:33 user nova-compute[72809]:       <serial>865348e8-a951-4f53-95c5-3567766f503b</serial>
Aug 09 07:18:33 user nova-compute[72809]:     </disk>
Aug 09 07:18:33 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 07:18:33 user nova-compute[72809]:       <mac address="fa:16:3e:9c:da:f2"/>
Aug 09 07:18:33 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:18:33 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 07:18:33 user nova-compute[72809]:       <target dev="tapc2ace49a-35"/>
Aug 09 07:18:33 user nova-compute[72809]:     </interface>
Aug 09 07:18:33 user nova-compute[72809]:     <serial type="pty">
Aug 09 07:18:33 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/476ced47-d6f0-4581-9d12-39f5b1fe90d0/console.log" append="off"/>
Aug 09 07:18:33 user nova-compute[72809]:     </serial>
Aug 09 07:18:33 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 07:18:33 user nova-compute[72809]:     <video>
Aug 09 07:18:33 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:18:33 user nova-compute[72809]:     </video>
Aug 09 07:18:33 user nova-compute[72809]:     <rng model="virtio">
Aug 09 07:18:33 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 07:18:33 user nova-compute[72809]:     </rng>
Aug 09 07:18:33 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 07:18:33 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 07:18:33 user nova-compute[72809]:       <stats period="10"/>
Aug 09 07:18:33 user nova-compute[72809]:     </memballoon>
Aug 09 07:18:33 user nova-compute[72809]:   </devices>
Aug 09 07:18:33 user nova-compute[72809]: </domain>
Aug 09 07:18:33 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 07:18:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:18:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1843871379',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1843871379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1843871379',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdavMQws6q7edRXy8NJ16Qm+gSUVO27aTZ1DaMCFHMrfBdM4jGqf55yzB257uo62n/KNv1m4VV+P4y9gCCAJSzWYTkJPhIm2cb/tqgUOOmZDzyMoPj8rwyY4Pn8wk90Jw==',key_name='tempest-keypair-643055003',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cdcd8241b9b47eab16a6e37a9cc5f54',ramdisk_id='',reservation_id='r-e62mlyrz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-224847517',owner_user_name='tempest-TestVolumeBootPattern-224847517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:18:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7859a38408b426eb9a14ef003483bd3',uuid=476ced47-d6f0-4581-9d12-39f5b1fe90d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2ace49a-35ba-443f-a90a-7f43b3ea1079", "address": "fa:16:3e:9c:da:f2", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ace49a-35", "ovs_interfaceid": "c2ace49a-35ba-443f-a90a-7f43b3ea1079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 07:18:33 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converting VIF {"id": "c2ace49a-35ba-443f-a90a-7f43b3ea1079", "address": "fa:16:3e:9c:da:f2", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ace49a-35", "ovs_interfaceid": "c2ace49a-35ba-443f-a90a-7f43b3ea1079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:18:33 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:da:f2,bridge_name='br-int',has_traffic_filtering=True,id=c2ace49a-35ba-443f-a90a-7f43b3ea1079,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ace49a-35') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:18:33 user nova-compute[72809]: DEBUG os_vif [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:da:f2,bridge_name='br-int',has_traffic_filtering=True,id=c2ace49a-35ba-443f-a90a-7f43b3ea1079,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ace49a-35') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 07:18:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:18:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 07:18:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2ace49a-35, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:18:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc2ace49a-35, col_values=(('external_ids', {'iface-id': 'c2ace49a-35ba-443f-a90a-7f43b3ea1079', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:da:f2', 'vm-uuid': '476ced47-d6f0-4581-9d12-39f5b1fe90d0'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:18:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:18:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:33 user nova-compute[72809]: INFO os_vif [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:da:f2,bridge_name='br-int',has_traffic_filtering=True,id=c2ace49a-35ba-443f-a90a-7f43b3ea1079,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ace49a-35')
Aug 09 07:18:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:18:33 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] No VIF found with MAC fa:16:3e:9c:da:f2, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:18:34 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:34 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:34 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:34 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:35 user nova-compute[72809]: DEBUG nova.compute.manager [req-2e84fb74-5638-4acb-9865-4876cc90dbe7 req-3036ac4b-e344-4db9-aeb9-08b48920f35b service nova] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Received event network-vif-plugged-c2ace49a-35ba-443f-a90a-7f43b3ea1079 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:18:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2e84fb74-5638-4acb-9865-4876cc90dbe7 req-3036ac4b-e344-4db9-aeb9-08b48920f35b service nova] Acquiring lock "476ced47-d6f0-4581-9d12-39f5b1fe90d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:18:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2e84fb74-5638-4acb-9865-4876cc90dbe7 req-3036ac4b-e344-4db9-aeb9-08b48920f35b service nova] Lock "476ced47-d6f0-4581-9d12-39f5b1fe90d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:18:35 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2e84fb74-5638-4acb-9865-4876cc90dbe7 req-3036ac4b-e344-4db9-aeb9-08b48920f35b service nova] Lock "476ced47-d6f0-4581-9d12-39f5b1fe90d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:18:35 user nova-compute[72809]: DEBUG nova.compute.manager [req-2e84fb74-5638-4acb-9865-4876cc90dbe7 req-3036ac4b-e344-4db9-aeb9-08b48920f35b service nova] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] No waiting events found dispatching network-vif-plugged-c2ace49a-35ba-443f-a90a-7f43b3ea1079 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:18:35 user nova-compute[72809]: WARNING nova.compute.manager [req-2e84fb74-5638-4acb-9865-4876cc90dbe7 req-3036ac4b-e344-4db9-aeb9-08b48920f35b service nova] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Received unexpected event network-vif-plugged-c2ace49a-35ba-443f-a90a-7f43b3ea1079 for instance with vm_state building and task_state spawning.
Aug 09 07:18:35 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:35 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:35 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:37 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691565517.0804908, 476ced47-d6f0-4581-9d12-39f5b1fe90d0 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:18:37 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] VM Resumed (Lifecycle Event)
Aug 09 07:18:37 user nova-compute[72809]: DEBUG nova.compute.manager [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 07:18:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 07:18:37 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Instance spawned successfully.
Aug 09 07:18:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 07:18:37 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:18:37 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:18:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:18:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:18:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:18:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:18:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:18:37 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:18:37 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:18:37 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691565517.081956, 476ced47-d6f0-4581-9d12-39f5b1fe90d0 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:18:37 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] VM Started (Lifecycle Event)
Aug 09 07:18:37 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:18:37 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:18:37 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:18:37 user nova-compute[72809]: INFO nova.compute.manager [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Took 4.91 seconds to spawn the instance on the hypervisor.
Aug 09 07:18:37 user nova-compute[72809]: DEBUG nova.compute.manager [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:18:37 user nova-compute[72809]: DEBUG nova.compute.manager [req-cdd5eaa9-0b53-450e-99ad-428d73cb6e59 req-06b58e34-2937-4eb0-a9f4-9b21d1e4bdb6 service nova] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Received event network-vif-plugged-c2ace49a-35ba-443f-a90a-7f43b3ea1079 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:18:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-cdd5eaa9-0b53-450e-99ad-428d73cb6e59 req-06b58e34-2937-4eb0-a9f4-9b21d1e4bdb6 service nova] Acquiring lock "476ced47-d6f0-4581-9d12-39f5b1fe90d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:18:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-cdd5eaa9-0b53-450e-99ad-428d73cb6e59 req-06b58e34-2937-4eb0-a9f4-9b21d1e4bdb6 service nova] Lock "476ced47-d6f0-4581-9d12-39f5b1fe90d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:18:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-cdd5eaa9-0b53-450e-99ad-428d73cb6e59 req-06b58e34-2937-4eb0-a9f4-9b21d1e4bdb6 service nova] Lock "476ced47-d6f0-4581-9d12-39f5b1fe90d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:18:37 user nova-compute[72809]: DEBUG nova.compute.manager [req-cdd5eaa9-0b53-450e-99ad-428d73cb6e59 req-06b58e34-2937-4eb0-a9f4-9b21d1e4bdb6 service nova] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] No waiting events found dispatching network-vif-plugged-c2ace49a-35ba-443f-a90a-7f43b3ea1079 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:18:37 user nova-compute[72809]: WARNING nova.compute.manager [req-cdd5eaa9-0b53-450e-99ad-428d73cb6e59 req-06b58e34-2937-4eb0-a9f4-9b21d1e4bdb6 service nova] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Received unexpected event network-vif-plugged-c2ace49a-35ba-443f-a90a-7f43b3ea1079 for instance with vm_state building and task_state spawning.
Aug 09 07:18:37 user nova-compute[72809]: INFO nova.compute.manager [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Took 13.55 seconds to build instance.
Aug 09 07:18:37 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7f85aab3-b3b9-427f-a572-3cf0a3ff4893 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "476ced47-d6f0-4581-9d12-39f5b1fe90d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.682s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:18:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:43 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:45 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:18:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:18:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:18:45 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:18:45 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 07:18:45 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:18:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:45 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:18:46 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:18:46 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:18:46 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:18:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=8512MB free_disk=25.107959747314453GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 07:18:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:18:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:18:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:18:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 2f07bffa-786c-4024-b0d4-c6155417d3ba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:18:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 476ced47-d6f0-4581-9d12-39f5b1fe90d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:18:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 07:18:46 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 07:18:47 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:18:47 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:18:47 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 07:18:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.369s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:18:48 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:18:48 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 07:18:48 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Didn't find any instances for network info cache update. {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 07:18:48 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:18:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:55 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:18:57 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:18:57 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:18:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:18:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:19:00 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:19:00 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 07:19:01 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:19:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:19:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:19:05 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:19:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:19:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:19:11 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:19:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:19:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:19:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:19:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:19:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72809) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 07:19:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:19:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:19:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:19:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:19:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:19:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:19:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:19:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72809) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 07:19:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:19:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:19:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:19:43 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:19:46 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:19:46 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 07:19:46 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Rebuilding the list of instances to heal {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 07:19:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:19:46 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:19:46 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 07:19:46 user nova-compute[72809]: DEBUG nova.objects.instance [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lazy-loading 'info_cache' on Instance uuid 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:19:47 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Updating instance_info_cache with network_info: [{"id": "4ccb4018-12aa-43f0-95d9-3021c4b8e61e", "address": "fa:16:3e:3d:dc:e9", "network": {"id": "1aa93c25-f23b-4acf-83dc-407d71f0284f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2043026175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29c65ac1c7649c1bc05bd790821801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccb4018-12", "ovs_interfaceid": "4ccb4018-12aa-43f0-95d9-3021c4b8e61e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:19:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:19:47 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 07:19:47 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:19:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:19:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:19:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:19:47 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 07:19:47 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:19:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:19:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:19:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:19:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:19:47 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:19:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:19:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:19:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:19:48 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:19:48 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:19:48 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=8504MB free_disk=25.099040985107422GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 07:19:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:19:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:19:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:19:48 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:19:48 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 2f07bffa-786c-4024-b0d4-c6155417d3ba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:19:48 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 476ced47-d6f0-4581-9d12-39f5b1fe90d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:19:48 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 07:19:48 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 07:19:49 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:19:49 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:19:49 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 07:19:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.408s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:19:51 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:19:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:19:57 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:19:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bdbd5413-5d8e-49a3-885a-620928029cca tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquiring lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:19:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bdbd5413-5d8e-49a3-885a-620928029cca tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:19:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bdbd5413-5d8e-49a3-885a-620928029cca tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquiring lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:19:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bdbd5413-5d8e-49a3-885a-620928029cca tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:19:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bdbd5413-5d8e-49a3-885a-620928029cca tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:19:58 user nova-compute[72809]: INFO nova.compute.manager [None req-bdbd5413-5d8e-49a3-885a-620928029cca tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Terminating instance
Aug 09 07:19:58 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bdbd5413-5d8e-49a3-885a-620928029cca tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:19:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:19:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:19:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:19:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:19:58 user nova-compute[72809]: DEBUG nova.compute.manager [req-6ce88d2a-8298-4f4e-96c3-5f48f82c77ab req-b21dc02e-5535-4e7a-bc9f-fcda2c21ea94 service nova] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Received event network-vif-unplugged-4ccb4018-12aa-43f0-95d9-3021c4b8e61e {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:19:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6ce88d2a-8298-4f4e-96c3-5f48f82c77ab req-b21dc02e-5535-4e7a-bc9f-fcda2c21ea94 service nova] Acquiring lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:19:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6ce88d2a-8298-4f4e-96c3-5f48f82c77ab req-b21dc02e-5535-4e7a-bc9f-fcda2c21ea94 service nova] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:19:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6ce88d2a-8298-4f4e-96c3-5f48f82c77ab req-b21dc02e-5535-4e7a-bc9f-fcda2c21ea94 service nova] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:19:58 user nova-compute[72809]: DEBUG nova.compute.manager [req-6ce88d2a-8298-4f4e-96c3-5f48f82c77ab req-b21dc02e-5535-4e7a-bc9f-fcda2c21ea94 service nova] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] No waiting events found dispatching network-vif-unplugged-4ccb4018-12aa-43f0-95d9-3021c4b8e61e {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:19:58 user nova-compute[72809]: DEBUG nova.compute.manager [req-6ce88d2a-8298-4f4e-96c3-5f48f82c77ab req-b21dc02e-5535-4e7a-bc9f-fcda2c21ea94 service nova] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Received event network-vif-unplugged-4ccb4018-12aa-43f0-95d9-3021c4b8e61e for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:19:58 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:19:58 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:19:58 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:19:58 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Cleaning up deleted instances {{(pid=72809) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 07:19:58 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] There are 0 instances to clean {{(pid=72809) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 07:19:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:19:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:19:59 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Instance destroyed successfully.
Aug 09 07:19:59 user nova-compute[72809]: DEBUG nova.objects.instance [None req-bdbd5413-5d8e-49a3-885a-620928029cca tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lazy-loading 'resources' on Instance uuid 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:19:59 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-bdbd5413-5d8e-49a3-885a-620928029cca tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-688152727',display_name='tempest-SnapshotDataIntegrityTests-server-688152727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-688152727',id=43,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJ4Fy5Yb+PbuBHKTtUH+j18umyuJ8D5XYxOzU2DEUuC18bQqnnYuSrWq+0U4B4YeCUZ3J1fl9zpO7FCv7Fq+mZEG4KzK1f17jr4MPEl0YdTBVj1LFXD8V3UCtM2gbMtIA==',key_name='tempest-keypair-1083576033',keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:12:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f29c65ac1c7649c1bc05bd790821801e',ramdisk_id='',reservation_id='r-g82jruwd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-186766721',owner_user_name='tempest-SnapshotDataIntegrityTests-186766721-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:12:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b188eb3ed1df40768c24486c0bd06235',uuid=91bdefd3-8ab1-43c2-8eb8-06d4b84eb382,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ccb4018-12aa-43f0-95d9-3021c4b8e61e", "address": "fa:16:3e:3d:dc:e9", "network": {"id": "1aa93c25-f23b-4acf-83dc-407d71f0284f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2043026175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29c65ac1c7649c1bc05bd790821801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccb4018-12", "ovs_interfaceid": "4ccb4018-12aa-43f0-95d9-3021c4b8e61e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:19:59 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-bdbd5413-5d8e-49a3-885a-620928029cca tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Converting VIF {"id": "4ccb4018-12aa-43f0-95d9-3021c4b8e61e", "address": "fa:16:3e:3d:dc:e9", "network": {"id": "1aa93c25-f23b-4acf-83dc-407d71f0284f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2043026175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29c65ac1c7649c1bc05bd790821801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccb4018-12", "ovs_interfaceid": "4ccb4018-12aa-43f0-95d9-3021c4b8e61e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:19:59 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-bdbd5413-5d8e-49a3-885a-620928029cca tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:dc:e9,bridge_name='br-int',has_traffic_filtering=True,id=4ccb4018-12aa-43f0-95d9-3021c4b8e61e,network=Network(1aa93c25-f23b-4acf-83dc-407d71f0284f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ccb4018-12') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:19:59 user nova-compute[72809]: DEBUG os_vif [None req-bdbd5413-5d8e-49a3-885a-620928029cca tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:dc:e9,bridge_name='br-int',has_traffic_filtering=True,id=4ccb4018-12aa-43f0-95d9-3021c4b8e61e,network=Network(1aa93c25-f23b-4acf-83dc-407d71f0284f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ccb4018-12') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:19:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:19:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ccb4018-12, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:19:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:19:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:19:59 user nova-compute[72809]: INFO os_vif [None req-bdbd5413-5d8e-49a3-885a-620928029cca tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:dc:e9,bridge_name='br-int',has_traffic_filtering=True,id=4ccb4018-12aa-43f0-95d9-3021c4b8e61e,network=Network(1aa93c25-f23b-4acf-83dc-407d71f0284f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ccb4018-12')
Aug 09 07:19:59 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-bdbd5413-5d8e-49a3-885a-620928029cca tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Deleting instance files /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382_del
Aug 09 07:19:59 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-bdbd5413-5d8e-49a3-885a-620928029cca tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Deletion of /opt/stack/data/nova/instances/91bdefd3-8ab1-43c2-8eb8-06d4b84eb382_del complete
Aug 09 07:19:59 user nova-compute[72809]: INFO nova.compute.manager [None req-bdbd5413-5d8e-49a3-885a-620928029cca tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 09 07:19:59 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-bdbd5413-5d8e-49a3-885a-620928029cca tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:19:59 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:19:59 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:20:00 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:20:00 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Took 0.89 seconds to deallocate network for instance.
Aug 09 07:20:00 user nova-compute[72809]: DEBUG nova.compute.manager [req-4654d7f5-968e-4546-9eff-f1b965bb9eea req-b9e1937e-81bb-4a52-95b1-ebe6422d2a48 service nova] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Received event network-vif-deleted-4ccb4018-12aa-43f0-95d9-3021c4b8e61e {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:20:00 user nova-compute[72809]: INFO nova.compute.manager [req-4654d7f5-968e-4546-9eff-f1b965bb9eea req-b9e1937e-81bb-4a52-95b1-ebe6422d2a48 service nova] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Neutron deleted interface 4ccb4018-12aa-43f0-95d9-3021c4b8e61e; detaching it from the instance and deleting it from the info cache
Aug 09 07:20:00 user nova-compute[72809]: DEBUG nova.network.neutron [req-4654d7f5-968e-4546-9eff-f1b965bb9eea req-b9e1937e-81bb-4a52-95b1-ebe6422d2a48 service nova] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:20:00 user nova-compute[72809]: DEBUG nova.compute.manager [req-4654d7f5-968e-4546-9eff-f1b965bb9eea req-b9e1937e-81bb-4a52-95b1-ebe6422d2a48 service nova] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Detach interface failed, port_id=4ccb4018-12aa-43f0-95d9-3021c4b8e61e, reason: Instance 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 could not be found. {{(pid=72809) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 07:20:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bdbd5413-5d8e-49a3-885a-620928029cca tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:20:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bdbd5413-5d8e-49a3-885a-620928029cca tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:20:00 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-bdbd5413-5d8e-49a3-885a-620928029cca tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:20:00 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-bdbd5413-5d8e-49a3-885a-620928029cca tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:20:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bdbd5413-5d8e-49a3-885a-620928029cca tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.215s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:20:00 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-bdbd5413-5d8e-49a3-885a-620928029cca tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Deleted allocations for instance 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382
Aug 09 07:20:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bdbd5413-5d8e-49a3-885a-620928029cca tempest-SnapshotDataIntegrityTests-186766721 tempest-SnapshotDataIntegrityTests-186766721-project-member] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.159s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:20:00 user nova-compute[72809]: DEBUG nova.compute.manager [req-3b793df6-d55c-4751-bf61-3f3c0e61b6be req-e9f3e357-c711-4131-965e-d498cf6dafd5 service nova] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Received event network-vif-plugged-4ccb4018-12aa-43f0-95d9-3021c4b8e61e {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:20:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3b793df6-d55c-4751-bf61-3f3c0e61b6be req-e9f3e357-c711-4131-965e-d498cf6dafd5 service nova] Acquiring lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:20:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3b793df6-d55c-4751-bf61-3f3c0e61b6be req-e9f3e357-c711-4131-965e-d498cf6dafd5 service nova] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:20:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3b793df6-d55c-4751-bf61-3f3c0e61b6be req-e9f3e357-c711-4131-965e-d498cf6dafd5 service nova] Lock "91bdefd3-8ab1-43c2-8eb8-06d4b84eb382-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:20:00 user nova-compute[72809]: DEBUG nova.compute.manager [req-3b793df6-d55c-4751-bf61-3f3c0e61b6be req-e9f3e357-c711-4131-965e-d498cf6dafd5 service nova] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] No waiting events found dispatching network-vif-plugged-4ccb4018-12aa-43f0-95d9-3021c4b8e61e {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:20:00 user nova-compute[72809]: WARNING nova.compute.manager [req-3b793df6-d55c-4751-bf61-3f3c0e61b6be req-e9f3e357-c711-4131-965e-d498cf6dafd5 service nova] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Received unexpected event network-vif-plugged-4ccb4018-12aa-43f0-95d9-3021c4b8e61e for instance with vm_state deleted and task_state None.
Aug 09 07:20:00 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:20:00 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 07:20:00 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:20:00 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72809) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 07:20:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "2f07bffa-786c-4024-b0d4-c6155417d3ba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:20:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "2f07bffa-786c-4024-b0d4-c6155417d3ba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:20:00 user nova-compute[72809]: DEBUG nova.objects.instance [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lazy-loading 'flavor' on Instance uuid 2f07bffa-786c-4024-b0d4-c6155417d3ba {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:20:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "2f07bffa-786c-4024-b0d4-c6155417d3ba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:20:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "2f07bffa-786c-4024-b0d4-c6155417d3ba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:20:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "2f07bffa-786c-4024-b0d4-c6155417d3ba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:20:01 user nova-compute[72809]: INFO nova.compute.manager [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Attaching volume 8817b7f9-5956-41d4-a48b-05cdad06edd7 to /dev/vdb
Aug 09 07:20:01 user nova-compute[72809]: DEBUG os_brick.utils [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:20:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:20:01 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a9275c-d1ec-430e-b090-291ca7a1a5f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:20:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:20:01 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfa5401-e38d-4606-82e9-9035282eaa92]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:20:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:20:01 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ba1837-315f-4f60-a78f-3231863ffb1f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:20:01 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d2e6d0-467d-4ff9-b083-880d9e717620]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:20:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:20:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 07:20:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:01 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:20:01 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 07:20:01 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a78774-9d11-42a4-baf0-d07b62bda98e]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:20:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 07:20:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 07:20:01 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 07:20:01 user nova-compute[72809]: DEBUG os_brick.utils [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:20:01 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Updating existing volume attachment record: 6556e239-4d65-45f8-8ff3-a4212eeaf965 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 07:20:01 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:20:03 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:20:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:07 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:20:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 07:20:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VZJWsqTk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:20:08 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:20:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:20:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:20:08 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:20:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:20:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:20:08 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 07:20:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:20:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12f2eab-049a-4556-9182-4dc78035031d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:20:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 07:20:08 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:20:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:20:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba886ba4-fa04-4799-bfe6-19be6bb9920c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:20:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7] added
Aug 09 07:20:08 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:20:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39b2392-c254-4ea5-be24-ff7a24589910]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e80a7c6-03b6-4702-8491-046c35aea91a]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VZJWsqTk {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VZJWsqTk" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec836f2-c473-47fe-bc4f-507b8bb6172d]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VZJWsqTk'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72809) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.125s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[638f0968-6981-40ba-a402-1080c584fde9]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[181d0e54-683b-4d03-8360-d3f90d6995e0]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b (non-flash)
Aug 09 07:20:09 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b (non-flash)
Aug 09 07:20:09 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a67acf-a15c-415c-aa34-28434593f46a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7, portal: 172.16.0.220,3260]
Aug 09 07:20:09 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7, portal: 172.16.0.220,3260] successful.
Aug 09 07:20:09 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[1418e293-ffbb-4473-9191-960c9783d4ca]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a00f27-6fd1-44ee-b6fc-db7c248df76f]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b (non-flash)
Aug 09 07:20:09 user nova-compute[72809]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 (non-flash)
Aug 09 07:20:09 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b (non-flash)
Aug 09 07:20:09 user nova-compute[72809]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 (non-flash)
Aug 09 07:20:09 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b38ea8-ba2b-4a1f-917a-947dda720fdd]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:20:09 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VZJWsqTk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 07:20:10 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:20:10 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '26464323664663162', 'path': '/dev/sdc'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:20:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464323664663162', 'path': '/dev/sdc'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 07:20:10 user nova-compute[72809]: DEBUG nova.objects.instance [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lazy-loading 'flavor' on Instance uuid 2f07bffa-786c-4024-b0d4-c6155417d3ba {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:20:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 07:20:10 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:20:10 user nova-compute[72809]:   <source dev="/dev/sdc"/>
Aug 09 07:20:10 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:20:10 user nova-compute[72809]:   <serial>8817b7f9-5956-41d4-a48b-05cdad06edd7</serial>
Aug 09 07:20:10 user nova-compute[72809]: </disk>
Aug 09 07:20:10 user nova-compute[72809]:  {{(pid=72809) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 07:20:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:20:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:20:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] No VIF found with MAC fa:16:3e:23:0e:15, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:20:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-18923c25-6633-4db4-b072-d4d42e73377f tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "2f07bffa-786c-4024-b0d4-c6155417d3ba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.757s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:20:14 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691565599.036698, 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:20:14 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] VM Stopped (Lifecycle Event)
Aug 09 07:20:14 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bdf8e812-9815-4292-ab8e-13307c597e57 None None] [instance: 91bdefd3-8ab1-43c2-8eb8-06d4b84eb382] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:20:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:14 user nova-compute[72809]: DEBUG nova.compute.manager [req-12bf035f-554c-4497-9783-cea80a3ef6f8 req-d7ab7d9e-3c0f-4ceb-be74-bd4d145c0223 service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Received event network-changed-4c62a706-971f-4153-9d45-1fcb03ece3eb {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:20:14 user nova-compute[72809]: DEBUG nova.compute.manager [req-12bf035f-554c-4497-9783-cea80a3ef6f8 req-d7ab7d9e-3c0f-4ceb-be74-bd4d145c0223 service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Refreshing instance network info cache due to event network-changed-4c62a706-971f-4153-9d45-1fcb03ece3eb. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:20:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-12bf035f-554c-4497-9783-cea80a3ef6f8 req-d7ab7d9e-3c0f-4ceb-be74-bd4d145c0223 service nova] Acquiring lock "refresh_cache-2f07bffa-786c-4024-b0d4-c6155417d3ba" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:20:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-12bf035f-554c-4497-9783-cea80a3ef6f8 req-d7ab7d9e-3c0f-4ceb-be74-bd4d145c0223 service nova] Acquired lock "refresh_cache-2f07bffa-786c-4024-b0d4-c6155417d3ba" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:20:14 user nova-compute[72809]: DEBUG nova.network.neutron [req-12bf035f-554c-4497-9783-cea80a3ef6f8 req-d7ab7d9e-3c0f-4ceb-be74-bd4d145c0223 service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Refreshing network info cache for port 4c62a706-971f-4153-9d45-1fcb03ece3eb {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:20:14 user nova-compute[72809]: DEBUG nova.compute.manager [req-a0c4e5d8-d60b-4f4c-ae1e-51f1a8aba4b8 req-662e0b8c-c9f3-4165-9497-2a3ed38b043d service nova] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Received event network-changed-c2ace49a-35ba-443f-a90a-7f43b3ea1079 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:20:14 user nova-compute[72809]: DEBUG nova.compute.manager [req-a0c4e5d8-d60b-4f4c-ae1e-51f1a8aba4b8 req-662e0b8c-c9f3-4165-9497-2a3ed38b043d service nova] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Refreshing instance network info cache due to event network-changed-c2ace49a-35ba-443f-a90a-7f43b3ea1079. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:20:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a0c4e5d8-d60b-4f4c-ae1e-51f1a8aba4b8 req-662e0b8c-c9f3-4165-9497-2a3ed38b043d service nova] Acquiring lock "refresh_cache-476ced47-d6f0-4581-9d12-39f5b1fe90d0" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:20:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a0c4e5d8-d60b-4f4c-ae1e-51f1a8aba4b8 req-662e0b8c-c9f3-4165-9497-2a3ed38b043d service nova] Acquired lock "refresh_cache-476ced47-d6f0-4581-9d12-39f5b1fe90d0" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:20:14 user nova-compute[72809]: DEBUG nova.network.neutron [req-a0c4e5d8-d60b-4f4c-ae1e-51f1a8aba4b8 req-662e0b8c-c9f3-4165-9497-2a3ed38b043d service nova] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Refreshing network info cache for port c2ace49a-35ba-443f-a90a-7f43b3ea1079 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:20:15 user nova-compute[72809]: DEBUG nova.network.neutron [req-12bf035f-554c-4497-9783-cea80a3ef6f8 req-d7ab7d9e-3c0f-4ceb-be74-bd4d145c0223 service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Updated VIF entry in instance network info cache for port 4c62a706-971f-4153-9d45-1fcb03ece3eb. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:20:15 user nova-compute[72809]: DEBUG nova.network.neutron [req-12bf035f-554c-4497-9783-cea80a3ef6f8 req-d7ab7d9e-3c0f-4ceb-be74-bd4d145c0223 service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Updating instance_info_cache with network_info: [{"id": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "address": "fa:16:3e:23:0e:15", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c62a706-97", "ovs_interfaceid": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:20:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-12bf035f-554c-4497-9783-cea80a3ef6f8 req-d7ab7d9e-3c0f-4ceb-be74-bd4d145c0223 service nova] Releasing lock "refresh_cache-2f07bffa-786c-4024-b0d4-c6155417d3ba" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:20:15 user nova-compute[72809]: DEBUG nova.network.neutron [req-a0c4e5d8-d60b-4f4c-ae1e-51f1a8aba4b8 req-662e0b8c-c9f3-4165-9497-2a3ed38b043d service nova] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Updated VIF entry in instance network info cache for port c2ace49a-35ba-443f-a90a-7f43b3ea1079. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:20:15 user nova-compute[72809]: DEBUG nova.network.neutron [req-a0c4e5d8-d60b-4f4c-ae1e-51f1a8aba4b8 req-662e0b8c-c9f3-4165-9497-2a3ed38b043d service nova] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Updating instance_info_cache with network_info: [{"id": "c2ace49a-35ba-443f-a90a-7f43b3ea1079", "address": "fa:16:3e:9c:da:f2", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ace49a-35", "ovs_interfaceid": "c2ace49a-35ba-443f-a90a-7f43b3ea1079", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:20:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a0c4e5d8-d60b-4f4c-ae1e-51f1a8aba4b8 req-662e0b8c-c9f3-4165-9497-2a3ed38b043d service nova] Releasing lock "refresh_cache-476ced47-d6f0-4581-9d12-39f5b1fe90d0" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:20:16 user nova-compute[72809]: DEBUG nova.compute.manager [req-d300732b-3d86-4277-85b1-84d8347e1e55 req-1cfda2d0-96d0-4077-8e58-56f708ae6f00 service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Received event network-changed-4c62a706-971f-4153-9d45-1fcb03ece3eb {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:20:16 user nova-compute[72809]: DEBUG nova.compute.manager [req-d300732b-3d86-4277-85b1-84d8347e1e55 req-1cfda2d0-96d0-4077-8e58-56f708ae6f00 service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Refreshing instance network info cache due to event network-changed-4c62a706-971f-4153-9d45-1fcb03ece3eb. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:20:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d300732b-3d86-4277-85b1-84d8347e1e55 req-1cfda2d0-96d0-4077-8e58-56f708ae6f00 service nova] Acquiring lock "refresh_cache-2f07bffa-786c-4024-b0d4-c6155417d3ba" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:20:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d300732b-3d86-4277-85b1-84d8347e1e55 req-1cfda2d0-96d0-4077-8e58-56f708ae6f00 service nova] Acquired lock "refresh_cache-2f07bffa-786c-4024-b0d4-c6155417d3ba" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:20:16 user nova-compute[72809]: DEBUG nova.network.neutron [req-d300732b-3d86-4277-85b1-84d8347e1e55 req-1cfda2d0-96d0-4077-8e58-56f708ae6f00 service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Refreshing network info cache for port 4c62a706-971f-4153-9d45-1fcb03ece3eb {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:20:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-376a8645-f9c4-41df-9cb0-7e02c08b65a9 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "2f07bffa-786c-4024-b0d4-c6155417d3ba" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:20:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-376a8645-f9c4-41df-9cb0-7e02c08b65a9 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "2f07bffa-786c-4024-b0d4-c6155417d3ba" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:20:17 user nova-compute[72809]: INFO nova.compute.manager [None req-376a8645-f9c4-41df-9cb0-7e02c08b65a9 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Rebooting instance
Aug 09 07:20:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-376a8645-f9c4-41df-9cb0-7e02c08b65a9 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "refresh_cache-2f07bffa-786c-4024-b0d4-c6155417d3ba" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:20:17 user nova-compute[72809]: DEBUG nova.network.neutron [req-d300732b-3d86-4277-85b1-84d8347e1e55 req-1cfda2d0-96d0-4077-8e58-56f708ae6f00 service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Updated VIF entry in instance network info cache for port 4c62a706-971f-4153-9d45-1fcb03ece3eb. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:20:17 user nova-compute[72809]: DEBUG nova.network.neutron [req-d300732b-3d86-4277-85b1-84d8347e1e55 req-1cfda2d0-96d0-4077-8e58-56f708ae6f00 service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Updating instance_info_cache with network_info: [{"id": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "address": "fa:16:3e:23:0e:15", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c62a706-97", "ovs_interfaceid": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:20:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d300732b-3d86-4277-85b1-84d8347e1e55 req-1cfda2d0-96d0-4077-8e58-56f708ae6f00 service nova] Releasing lock "refresh_cache-2f07bffa-786c-4024-b0d4-c6155417d3ba" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:20:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-376a8645-f9c4-41df-9cb0-7e02c08b65a9 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquired lock "refresh_cache-2f07bffa-786c-4024-b0d4-c6155417d3ba" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:20:17 user nova-compute[72809]: DEBUG nova.network.neutron [None req-376a8645-f9c4-41df-9cb0-7e02c08b65a9 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:20:17 user nova-compute[72809]: DEBUG nova.network.neutron [None req-376a8645-f9c4-41df-9cb0-7e02c08b65a9 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Updating instance_info_cache with network_info: [{"id": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "address": "fa:16:3e:23:0e:15", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c62a706-97", "ovs_interfaceid": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:20:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-376a8645-f9c4-41df-9cb0-7e02c08b65a9 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Releasing lock "refresh_cache-2f07bffa-786c-4024-b0d4-c6155417d3ba" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:20:17 user nova-compute[72809]: DEBUG nova.compute.manager [None req-376a8645-f9c4-41df-9cb0-7e02c08b65a9 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:20:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:20:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:20 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:20 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:20 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:20 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:20 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:20 user nova-compute[72809]: DEBUG nova.compute.manager [req-b91a930f-66ff-4c51-8a5d-6cc35a10bdd0 req-f4a8724b-e6d5-434d-a244-3c9e80d2950b service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Received event network-vif-unplugged-4c62a706-971f-4153-9d45-1fcb03ece3eb {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:20:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b91a930f-66ff-4c51-8a5d-6cc35a10bdd0 req-f4a8724b-e6d5-434d-a244-3c9e80d2950b service nova] Acquiring lock "2f07bffa-786c-4024-b0d4-c6155417d3ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:20:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b91a930f-66ff-4c51-8a5d-6cc35a10bdd0 req-f4a8724b-e6d5-434d-a244-3c9e80d2950b service nova] Lock "2f07bffa-786c-4024-b0d4-c6155417d3ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:20:20 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b91a930f-66ff-4c51-8a5d-6cc35a10bdd0 req-f4a8724b-e6d5-434d-a244-3c9e80d2950b service nova] Lock "2f07bffa-786c-4024-b0d4-c6155417d3ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:20:20 user nova-compute[72809]: DEBUG nova.compute.manager [req-b91a930f-66ff-4c51-8a5d-6cc35a10bdd0 req-f4a8724b-e6d5-434d-a244-3c9e80d2950b service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] No waiting events found dispatching network-vif-unplugged-4c62a706-971f-4153-9d45-1fcb03ece3eb {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:20:20 user nova-compute[72809]: WARNING nova.compute.manager [req-b91a930f-66ff-4c51-8a5d-6cc35a10bdd0 req-f4a8724b-e6d5-434d-a244-3c9e80d2950b service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Received unexpected event network-vif-unplugged-4c62a706-971f-4153-9d45-1fcb03ece3eb for instance with vm_state active and task_state reboot_started.
Aug 09 07:20:20 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-376a8645-f9c4-41df-9cb0-7e02c08b65a9 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Instance shutdown successfully.
Aug 09 07:20:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:22 user nova-compute[72809]: DEBUG nova.compute.manager [req-a85bb731-21c7-4747-965a-4b329d41b811 req-920f76e1-fe4d-45e7-99dc-1e87d3c0759a service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Received event network-vif-plugged-4c62a706-971f-4153-9d45-1fcb03ece3eb {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:20:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a85bb731-21c7-4747-965a-4b329d41b811 req-920f76e1-fe4d-45e7-99dc-1e87d3c0759a service nova] Acquiring lock "2f07bffa-786c-4024-b0d4-c6155417d3ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:20:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a85bb731-21c7-4747-965a-4b329d41b811 req-920f76e1-fe4d-45e7-99dc-1e87d3c0759a service nova] Lock "2f07bffa-786c-4024-b0d4-c6155417d3ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:20:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a85bb731-21c7-4747-965a-4b329d41b811 req-920f76e1-fe4d-45e7-99dc-1e87d3c0759a service nova] Lock "2f07bffa-786c-4024-b0d4-c6155417d3ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:20:22 user nova-compute[72809]: DEBUG nova.compute.manager [req-a85bb731-21c7-4747-965a-4b329d41b811 req-920f76e1-fe4d-45e7-99dc-1e87d3c0759a service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] No waiting events found dispatching network-vif-plugged-4c62a706-971f-4153-9d45-1fcb03ece3eb {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:20:22 user nova-compute[72809]: WARNING nova.compute.manager [req-a85bb731-21c7-4747-965a-4b329d41b811 req-920f76e1-fe4d-45e7-99dc-1e87d3c0759a service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Received unexpected event network-vif-plugged-4c62a706-971f-4153-9d45-1fcb03ece3eb for instance with vm_state active and task_state reboot_started.
Aug 09 07:20:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:24 user nova-compute[72809]: DEBUG nova.compute.manager [req-031d72ab-63e2-4823-8036-b0b82c05c2c5 req-29a89fa8-2ac4-46f7-902f-cfd61825dbab service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Received event network-vif-plugged-4c62a706-971f-4153-9d45-1fcb03ece3eb {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:20:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-031d72ab-63e2-4823-8036-b0b82c05c2c5 req-29a89fa8-2ac4-46f7-902f-cfd61825dbab service nova] Acquiring lock "2f07bffa-786c-4024-b0d4-c6155417d3ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:20:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-031d72ab-63e2-4823-8036-b0b82c05c2c5 req-29a89fa8-2ac4-46f7-902f-cfd61825dbab service nova] Lock "2f07bffa-786c-4024-b0d4-c6155417d3ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:20:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-031d72ab-63e2-4823-8036-b0b82c05c2c5 req-29a89fa8-2ac4-46f7-902f-cfd61825dbab service nova] Lock "2f07bffa-786c-4024-b0d4-c6155417d3ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:20:24 user nova-compute[72809]: DEBUG nova.compute.manager [req-031d72ab-63e2-4823-8036-b0b82c05c2c5 req-29a89fa8-2ac4-46f7-902f-cfd61825dbab service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] No waiting events found dispatching network-vif-plugged-4c62a706-971f-4153-9d45-1fcb03ece3eb {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:20:24 user nova-compute[72809]: WARNING nova.compute.manager [req-031d72ab-63e2-4823-8036-b0b82c05c2c5 req-29a89fa8-2ac4-46f7-902f-cfd61825dbab service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Received unexpected event network-vif-plugged-4c62a706-971f-4153-9d45-1fcb03ece3eb for instance with vm_state active and task_state reboot_started.
Aug 09 07:20:24 user nova-compute[72809]: DEBUG nova.compute.manager [req-031d72ab-63e2-4823-8036-b0b82c05c2c5 req-29a89fa8-2ac4-46f7-902f-cfd61825dbab service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Received event network-vif-plugged-4c62a706-971f-4153-9d45-1fcb03ece3eb {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:20:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-031d72ab-63e2-4823-8036-b0b82c05c2c5 req-29a89fa8-2ac4-46f7-902f-cfd61825dbab service nova] Acquiring lock "2f07bffa-786c-4024-b0d4-c6155417d3ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:20:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-031d72ab-63e2-4823-8036-b0b82c05c2c5 req-29a89fa8-2ac4-46f7-902f-cfd61825dbab service nova] Lock "2f07bffa-786c-4024-b0d4-c6155417d3ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:20:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-031d72ab-63e2-4823-8036-b0b82c05c2c5 req-29a89fa8-2ac4-46f7-902f-cfd61825dbab service nova] Lock "2f07bffa-786c-4024-b0d4-c6155417d3ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:20:24 user nova-compute[72809]: DEBUG nova.compute.manager [req-031d72ab-63e2-4823-8036-b0b82c05c2c5 req-29a89fa8-2ac4-46f7-902f-cfd61825dbab service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] No waiting events found dispatching network-vif-plugged-4c62a706-971f-4153-9d45-1fcb03ece3eb {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:20:24 user nova-compute[72809]: WARNING nova.compute.manager [req-031d72ab-63e2-4823-8036-b0b82c05c2c5 req-29a89fa8-2ac4-46f7-902f-cfd61825dbab service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Received unexpected event network-vif-plugged-4c62a706-971f-4153-9d45-1fcb03ece3eb for instance with vm_state active and task_state reboot_started.
Aug 09 07:20:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Removed pending event for 2f07bffa-786c-4024-b0d4-c6155417d3ba due to event {{(pid=72809) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 07:20:24 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691565624.4372756, 2f07bffa-786c-4024-b0d4-c6155417d3ba => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:20:24 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] VM Resumed (Lifecycle Event)
Aug 09 07:20:24 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Instance running successfully.
Aug 09 07:20:24 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-376a8645-f9c4-41df-9cb0-7e02c08b65a9 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Instance soft rebooted successfully.
Aug 09 07:20:24 user nova-compute[72809]: DEBUG nova.compute.manager [None req-376a8645-f9c4-41df-9cb0-7e02c08b65a9 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:20:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:20:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:20:24 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:20:24 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:20:24 user nova-compute[72809]: DEBUG nova.compute.manager [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 07:20:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-376a8645-f9c4-41df-9cb0-7e02c08b65a9 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "2f07bffa-786c-4024-b0d4-c6155417d3ba" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.436s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:20:24 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691565624.4383042, 2f07bffa-786c-4024-b0d4-c6155417d3ba => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:20:24 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] VM Started (Lifecycle Event)
Aug 09 07:20:24 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:20:24 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:20:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:20:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:20:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 07:20:24 user nova-compute[72809]: INFO nova.compute.claims [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Claim successful on node user
Aug 09 07:20:24 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:20:24 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:20:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.266s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:20:24 user nova-compute[72809]: DEBUG nova.compute.manager [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 07:20:24 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 07:20:24 user nova-compute[72809]: DEBUG nova.compute.manager [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 07:20:24 user nova-compute[72809]: DEBUG nova.network.neutron [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 07:20:24 user nova-compute[72809]: DEBUG nova.compute.manager [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 07:20:24 user nova-compute[72809]: INFO nova.virt.block_device [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Booting with volume snapshot ab3d3d7f-2c4f-4c46-996c-bd865686a9d7 at /dev/vda
Aug 09 07:20:25 user nova-compute[72809]: DEBUG nova.policy [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a7859a38408b426eb9a14ef003483bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8241b9b47eab16a6e37a9cc5f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 07:20:25 user nova-compute[72809]: DEBUG nova.network.neutron [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Successfully created port: 1dada21e-73f7-453a-8b0b-aaec34282103 {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 07:20:26 user nova-compute[72809]: DEBUG nova.network.neutron [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Successfully updated port: 1dada21e-73f7-453a-8b0b-aaec34282103 {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 07:20:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "refresh_cache-e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:20:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquired lock "refresh_cache-e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:20:26 user nova-compute[72809]: DEBUG nova.network.neutron [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:20:26 user nova-compute[72809]: DEBUG nova.compute.manager [req-657a730a-1e36-4a22-a425-f4c81de676ae req-b895fb85-3557-4698-b203-cd30622b667a service nova] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Received event network-changed-1dada21e-73f7-453a-8b0b-aaec34282103 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:20:26 user nova-compute[72809]: DEBUG nova.compute.manager [req-657a730a-1e36-4a22-a425-f4c81de676ae req-b895fb85-3557-4698-b203-cd30622b667a service nova] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Refreshing instance network info cache due to event network-changed-1dada21e-73f7-453a-8b0b-aaec34282103. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:20:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-657a730a-1e36-4a22-a425-f4c81de676ae req-b895fb85-3557-4698-b203-cd30622b667a service nova] Acquiring lock "refresh_cache-e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:20:26 user nova-compute[72809]: DEBUG nova.network.neutron [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 07:20:26 user nova-compute[72809]: DEBUG nova.network.neutron [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Updating instance_info_cache with network_info: [{"id": "1dada21e-73f7-453a-8b0b-aaec34282103", "address": "fa:16:3e:50:92:ea", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dada21e-73", "ovs_interfaceid": "1dada21e-73f7-453a-8b0b-aaec34282103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:20:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Releasing lock "refresh_cache-e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:20:26 user nova-compute[72809]: DEBUG nova.compute.manager [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Instance network_info: |[{"id": "1dada21e-73f7-453a-8b0b-aaec34282103", "address": "fa:16:3e:50:92:ea", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dada21e-73", "ovs_interfaceid": "1dada21e-73f7-453a-8b0b-aaec34282103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 07:20:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-657a730a-1e36-4a22-a425-f4c81de676ae req-b895fb85-3557-4698-b203-cd30622b667a service nova] Acquired lock "refresh_cache-e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:20:26 user nova-compute[72809]: DEBUG nova.network.neutron [req-657a730a-1e36-4a22-a425-f4c81de676ae req-b895fb85-3557-4698-b203-cd30622b667a service nova] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Refreshing network info cache for port 1dada21e-73f7-453a-8b0b-aaec34282103 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:20:27 user nova-compute[72809]: DEBUG nova.network.neutron [req-657a730a-1e36-4a22-a425-f4c81de676ae req-b895fb85-3557-4698-b203-cd30622b667a service nova] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Updated VIF entry in instance network info cache for port 1dada21e-73f7-453a-8b0b-aaec34282103. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:20:27 user nova-compute[72809]: DEBUG nova.network.neutron [req-657a730a-1e36-4a22-a425-f4c81de676ae req-b895fb85-3557-4698-b203-cd30622b667a service nova] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Updating instance_info_cache with network_info: [{"id": "1dada21e-73f7-453a-8b0b-aaec34282103", "address": "fa:16:3e:50:92:ea", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dada21e-73", "ovs_interfaceid": "1dada21e-73f7-453a-8b0b-aaec34282103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:20:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-657a730a-1e36-4a22-a425-f4c81de676ae req-b895fb85-3557-4698-b203-cd30622b667a service nova] Releasing lock "refresh_cache-e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:20:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:30 user nova-compute[72809]: DEBUG os_brick.utils [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:20:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:20:30 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f3cb75-1f4d-4391-b009-01270e26472b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:20:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:20:30 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8c5b43-1c7b-443e-ae83-f2a7b169e81c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:20:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:20:30 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cfbebd-b9f3-482a-b253-5ff747c6fa50]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:20:30 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[622f375b-9e6e-4969-a100-945a50c91b15]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:20:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:20:30 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 07:20:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:30 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:20:30 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 07:20:30 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd2e2d3-fd44-48a7-8e3e-d342fe1d3fbc]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:20:30 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 07:20:30 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 07:20:30 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 07:20:30 user nova-compute[72809]: DEBUG os_brick.utils [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:20:30 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Updating existing volume attachment record: 838c929e-6dac-474d-9cb6-e055c19d3bda {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 07:20:34 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:34 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG nova.compute.manager [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 07:20:39 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Creating image(s)
Aug 09 07:20:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Did not create local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Ensure instance console log exists: /opt/stack/data/nova/instances/e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Start _get_guest_xml network_info=[{"id": "1dada21e-73f7-453a-8b0b-aaec34282103", "address": "fa:16:3e:50:92:ea", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dada21e-73", "ovs_interfaceid": "1dada21e-73f7-453a-8b0b-aaec34282103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-09T07:20:16Z,direct_url=<?>,disk_format='qcow2',id=ffbd60ac-97c4-41f5-b171-14781f3b0e0d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1057869310',owner='8cdcd8241b9b47eab16a6e37a9cc5f54',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-09T07:20:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CymwLsdZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be', 'attached_at': '', 'detached_at': '', 'volume_id': 'f0274bc1-f80a-47cf-9cc9-46b524ebc0d5', 'serial': 'f0274bc1-f80a-47cf-9cc9-46b524ebc0d5'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'boot_index': 0, 'attachment_id': '838c929e-6dac-474d-9cb6-e055c19d3bda', 'volume_type': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 07:20:39 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:20:39 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:20:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-09T07:20:16Z,direct_url=<?>,disk_format='qcow2',id=ffbd60ac-97c4-41f5-b171-14781f3b0e0d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1057869310',owner='8cdcd8241b9b47eab16a6e37a9cc5f54',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-09T07:20:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CymwLsdZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:20:39 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:20:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:20:39 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:20:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:20:39 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5 -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6db435-fd5b-404f-b8ca-7c696f1a3311]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 07:20:39 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdac4600-4685-47c4-8015-82f86652a556]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5] added
Aug 09 07:20:39 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0b3c4d-795b-4165-8322-7857614e2c57]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b776d8b8-8fcb-47a8-9c8d-3a1d45cf1c55]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CymwLsdZ {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CymwLsdZ" returned: 0 in 0.026s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[83896002-7153-4652-8d61-563a46625fdb]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CymwLsdZ'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2ea9c0-b553-4831-9068-5ce9213561d6]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffa024e-62d2-4bb7-b1a4-df64c963b5fd]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b (non-flash)
Aug 09 07:20:39 user nova-compute[72809]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 (non-flash)
Aug 09 07:20:39 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b (non-flash)
Aug 09 07:20:39 user nova-compute[72809]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 (non-flash)
Aug 09 07:20:39 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5 -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58a8917-f579-4ce0-8779-e8a0924af368]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5, portal: 172.16.0.220,3260]
Aug 09 07:20:39 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5, portal: 172.16.0.220,3260] successful.
Aug 09 07:20:39 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff8200e-e6d3-4a2f-b84c-f33774bf883e]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ac3b03-ee52-41e5-8835-ff6c467b5798]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b (non-flash)
Aug 09 07:20:39 user nova-compute[72809]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 (non-flash)
Aug 09 07:20:39 user nova-compute[72809]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5 (non-flash)
Aug 09 07:20:39 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b (non-flash)
Aug 09 07:20:39 user nova-compute[72809]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 (non-flash)
Aug 09 07:20:39 user nova-compute[72809]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5 (non-flash)
Aug 09 07:20:39 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] HCTL ('35', '-', '-', 0) found on session 56 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b17ab40-9199-4fb5-b1db-4580a1bcda46]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Searching for a device in session 56 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:20:39 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CymwLsdZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 07:20:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:20:40 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23436336665656465', 'path': '/dev/sdd'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:20:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436336665656465', 'path': '/dev/sdd'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 07:20:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:20:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-496228920',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-496228920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-496228920',id=47,image_ref='ffbd60ac-97c4-41f5-b171-14781f3b0e0d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENx/V0vGTxRzyQA2FSw72STIekvGXafMBs2HauIC4VQQ6gDigi0zY6GBhz9b785nkTbVZNV7ZML4Fov04T1QSFwSKrK7tZzXDrv7cKfL719UjqXT+FH7S/r+dxn3I5efg==',key_name='tempest-keypair-1976925239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cdcd8241b9b47eab16a6e37a9cc5f54',ramdisk_id='',reservation_id='r-ih1mkvtg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-224847517',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-224847517-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-224847517',owner_user_name='tempest-TestVolumeBootPattern-224847517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:20:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7859a38408b426eb9a14ef003483bd3',uuid=e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dada21e-73f7-453a-8b0b-aaec34282103", "address": "fa:16:3e:50:92:ea", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dada21e-73", "ovs_interfaceid": "1dada21e-73f7-453a-8b0b-aaec34282103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 07:20:40 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converting VIF {"id": "1dada21e-73f7-453a-8b0b-aaec34282103", "address": "fa:16:3e:50:92:ea", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dada21e-73", "ovs_interfaceid": "1dada21e-73f7-453a-8b0b-aaec34282103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:20:40 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:92:ea,bridge_name='br-int',has_traffic_filtering=True,id=1dada21e-73f7-453a-8b0b-aaec34282103,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dada21e-73') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:20:40 user nova-compute[72809]: DEBUG nova.objects.instance [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lazy-loading 'pci_devices' on Instance uuid e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:20:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] End _get_guest_xml xml=<domain type="kvm">
Aug 09 07:20:40 user nova-compute[72809]:   <uuid>e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be</uuid>
Aug 09 07:20:40 user nova-compute[72809]:   <name>instance-0000002f</name>
Aug 09 07:20:40 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 07:20:40 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 07:20:40 user nova-compute[72809]:   <metadata>
Aug 09 07:20:40 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 07:20:40 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 07:20:40 user nova-compute[72809]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-496228920</nova:name>
Aug 09 07:20:40 user nova-compute[72809]:       <nova:creationTime>2023-08-09 07:20:39</nova:creationTime>
Aug 09 07:20:40 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 07:20:40 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 07:20:40 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 07:20:40 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 07:20:40 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 07:20:40 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 07:20:40 user nova-compute[72809]:       </nova:flavor>
Aug 09 07:20:40 user nova-compute[72809]:       <nova:owner>
Aug 09 07:20:40 user nova-compute[72809]:         <nova:user uuid="a7859a38408b426eb9a14ef003483bd3">tempest-TestVolumeBootPattern-224847517-project-member</nova:user>
Aug 09 07:20:40 user nova-compute[72809]:         <nova:project uuid="8cdcd8241b9b47eab16a6e37a9cc5f54">tempest-TestVolumeBootPattern-224847517</nova:project>
Aug 09 07:20:40 user nova-compute[72809]:       </nova:owner>
Aug 09 07:20:40 user nova-compute[72809]:       <nova:root type="image" uuid="ffbd60ac-97c4-41f5-b171-14781f3b0e0d"/>
Aug 09 07:20:40 user nova-compute[72809]:       <nova:ports>
Aug 09 07:20:40 user nova-compute[72809]:         <nova:port uuid="1dada21e-73f7-453a-8b0b-aaec34282103">
Aug 09 07:20:40 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 07:20:40 user nova-compute[72809]:         </nova:port>
Aug 09 07:20:40 user nova-compute[72809]:       </nova:ports>
Aug 09 07:20:40 user nova-compute[72809]:     </nova:instance>
Aug 09 07:20:40 user nova-compute[72809]:   </metadata>
Aug 09 07:20:40 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 07:20:40 user nova-compute[72809]:     <system>
Aug 09 07:20:40 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 07:20:40 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 07:20:40 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 07:20:40 user nova-compute[72809]:       <entry name="serial">e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be</entry>
Aug 09 07:20:40 user nova-compute[72809]:       <entry name="uuid">e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be</entry>
Aug 09 07:20:40 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 07:20:40 user nova-compute[72809]:     </system>
Aug 09 07:20:40 user nova-compute[72809]:   </sysinfo>
Aug 09 07:20:40 user nova-compute[72809]:   <os>
Aug 09 07:20:40 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 07:20:40 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 07:20:40 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 07:20:40 user nova-compute[72809]:   </os>
Aug 09 07:20:40 user nova-compute[72809]:   <features>
Aug 09 07:20:40 user nova-compute[72809]:     <acpi/>
Aug 09 07:20:40 user nova-compute[72809]:     <apic/>
Aug 09 07:20:40 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 07:20:40 user nova-compute[72809]:   </features>
Aug 09 07:20:40 user nova-compute[72809]:   <clock offset="utc">
Aug 09 07:20:40 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 07:20:40 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 07:20:40 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 07:20:40 user nova-compute[72809]:   </clock>
Aug 09 07:20:40 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 07:20:40 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 07:20:40 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 07:20:40 user nova-compute[72809]:   </cpu>
Aug 09 07:20:40 user nova-compute[72809]:   <devices>
Aug 09 07:20:40 user nova-compute[72809]:     <disk type="block" device="disk">
Aug 09 07:20:40 user nova-compute[72809]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:20:40 user nova-compute[72809]:       <source dev="/dev/sdd"/>
Aug 09 07:20:40 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 07:20:40 user nova-compute[72809]:       <serial>f0274bc1-f80a-47cf-9cc9-46b524ebc0d5</serial>
Aug 09 07:20:40 user nova-compute[72809]:     </disk>
Aug 09 07:20:40 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 07:20:40 user nova-compute[72809]:       <mac address="fa:16:3e:50:92:ea"/>
Aug 09 07:20:40 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:20:40 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 07:20:40 user nova-compute[72809]:       <target dev="tap1dada21e-73"/>
Aug 09 07:20:40 user nova-compute[72809]:     </interface>
Aug 09 07:20:40 user nova-compute[72809]:     <serial type="pty">
Aug 09 07:20:40 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be/console.log" append="off"/>
Aug 09 07:20:40 user nova-compute[72809]:     </serial>
Aug 09 07:20:40 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 07:20:40 user nova-compute[72809]:     <video>
Aug 09 07:20:40 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:20:40 user nova-compute[72809]:     </video>
Aug 09 07:20:40 user nova-compute[72809]:     <rng model="virtio">
Aug 09 07:20:40 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 07:20:40 user nova-compute[72809]:     </rng>
Aug 09 07:20:40 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 07:20:40 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 07:20:40 user nova-compute[72809]:       <stats period="10"/>
Aug 09 07:20:40 user nova-compute[72809]:     </memballoon>
Aug 09 07:20:40 user nova-compute[72809]:   </devices>
Aug 09 07:20:40 user nova-compute[72809]: </domain>
Aug 09 07:20:40 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 07:20:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:20:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-496228920',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-496228920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-496228920',id=47,image_ref='ffbd60ac-97c4-41f5-b171-14781f3b0e0d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENx/V0vGTxRzyQA2FSw72STIekvGXafMBs2HauIC4VQQ6gDigi0zY6GBhz9b785nkTbVZNV7ZML4Fov04T1QSFwSKrK7tZzXDrv7cKfL719UjqXT+FH7S/r+dxn3I5efg==',key_name='tempest-keypair-1976925239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cdcd8241b9b47eab16a6e37a9cc5f54',ramdisk_id='',reservation_id='r-ih1mkvtg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-224847517',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-224847517-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-224847517',owner_user_name='tempest-TestVolumeBootPattern-224847517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:20:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7859a38408b426eb9a14ef003483bd3',uuid=e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dada21e-73f7-453a-8b0b-aaec34282103", "address": "fa:16:3e:50:92:ea", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dada21e-73", "ovs_interfaceid": "1dada21e-73f7-453a-8b0b-aaec34282103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 07:20:40 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converting VIF {"id": "1dada21e-73f7-453a-8b0b-aaec34282103", "address": "fa:16:3e:50:92:ea", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dada21e-73", "ovs_interfaceid": "1dada21e-73f7-453a-8b0b-aaec34282103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:20:40 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:92:ea,bridge_name='br-int',has_traffic_filtering=True,id=1dada21e-73f7-453a-8b0b-aaec34282103,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dada21e-73') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:20:40 user nova-compute[72809]: DEBUG os_vif [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:92:ea,bridge_name='br-int',has_traffic_filtering=True,id=1dada21e-73f7-453a-8b0b-aaec34282103,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dada21e-73') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 07:20:40 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:40 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:20:40 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 07:20:40 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:40 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1dada21e-73, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:20:40 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1dada21e-73, col_values=(('external_ids', {'iface-id': '1dada21e-73f7-453a-8b0b-aaec34282103', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:92:ea', 'vm-uuid': 'e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:20:40 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:40 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:20:40 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:40 user nova-compute[72809]: INFO os_vif [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:92:ea,bridge_name='br-int',has_traffic_filtering=True,id=1dada21e-73f7-453a-8b0b-aaec34282103,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dada21e-73')
Aug 09 07:20:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:20:40 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] No VIF found with MAC fa:16:3e:50:92:ea, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:20:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:42 user nova-compute[72809]: DEBUG nova.compute.manager [req-7d4bfe05-39b2-428f-b60d-3493b0b42205 req-903fde63-8a70-4b6d-b581-547f7bde89e7 service nova] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Received event network-vif-plugged-1dada21e-73f7-453a-8b0b-aaec34282103 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:20:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7d4bfe05-39b2-428f-b60d-3493b0b42205 req-903fde63-8a70-4b6d-b581-547f7bde89e7 service nova] Acquiring lock "e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:20:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7d4bfe05-39b2-428f-b60d-3493b0b42205 req-903fde63-8a70-4b6d-b581-547f7bde89e7 service nova] Lock "e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:20:42 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-7d4bfe05-39b2-428f-b60d-3493b0b42205 req-903fde63-8a70-4b6d-b581-547f7bde89e7 service nova] Lock "e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:20:42 user nova-compute[72809]: DEBUG nova.compute.manager [req-7d4bfe05-39b2-428f-b60d-3493b0b42205 req-903fde63-8a70-4b6d-b581-547f7bde89e7 service nova] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] No waiting events found dispatching network-vif-plugged-1dada21e-73f7-453a-8b0b-aaec34282103 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:20:42 user nova-compute[72809]: WARNING nova.compute.manager [req-7d4bfe05-39b2-428f-b60d-3493b0b42205 req-903fde63-8a70-4b6d-b581-547f7bde89e7 service nova] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Received unexpected event network-vif-plugged-1dada21e-73f7-453a-8b0b-aaec34282103 for instance with vm_state building and task_state spawning.
Aug 09 07:20:43 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691565643.923923, e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:20:43 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] VM Resumed (Lifecycle Event)
Aug 09 07:20:43 user nova-compute[72809]: DEBUG nova.compute.manager [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 07:20:43 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 07:20:43 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Instance spawned successfully.
Aug 09 07:20:43 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 07:20:43 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:20:43 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:20:43 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:20:43 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:20:43 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:20:43 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691565643.9265423, e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:20:43 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] VM Started (Lifecycle Event)
Aug 09 07:20:43 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:20:44 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:20:44 user nova-compute[72809]: INFO nova.compute.manager [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Took 4.88 seconds to spawn the instance on the hypervisor.
Aug 09 07:20:44 user nova-compute[72809]: DEBUG nova.compute.manager [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:20:44 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:20:44 user nova-compute[72809]: INFO nova.compute.manager [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Took 19.55 seconds to build instance.
Aug 09 07:20:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-da22d1cf-aae3-41cc-97b6-e2af19752f5b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.638s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:20:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:44 user nova-compute[72809]: DEBUG nova.compute.manager [req-e4b879cd-0495-461d-8100-c2c97e4e2e36 req-aed0cf3e-650d-4914-8825-aeaf799664e6 service nova] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Received event network-vif-plugged-1dada21e-73f7-453a-8b0b-aaec34282103 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:20:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e4b879cd-0495-461d-8100-c2c97e4e2e36 req-aed0cf3e-650d-4914-8825-aeaf799664e6 service nova] Acquiring lock "e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:20:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e4b879cd-0495-461d-8100-c2c97e4e2e36 req-aed0cf3e-650d-4914-8825-aeaf799664e6 service nova] Lock "e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:20:44 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e4b879cd-0495-461d-8100-c2c97e4e2e36 req-aed0cf3e-650d-4914-8825-aeaf799664e6 service nova] Lock "e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:20:44 user nova-compute[72809]: DEBUG nova.compute.manager [req-e4b879cd-0495-461d-8100-c2c97e4e2e36 req-aed0cf3e-650d-4914-8825-aeaf799664e6 service nova] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] No waiting events found dispatching network-vif-plugged-1dada21e-73f7-453a-8b0b-aaec34282103 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:20:44 user nova-compute[72809]: WARNING nova.compute.manager [req-e4b879cd-0495-461d-8100-c2c97e4e2e36 req-aed0cf3e-650d-4914-8825-aeaf799664e6 service nova] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Received unexpected event network-vif-plugged-1dada21e-73f7-453a-8b0b-aaec34282103 for instance with vm_state active and task_state None.
Aug 09 07:20:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:47 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:20:47 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 07:20:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-2f07bffa-786c-4024-b0d4-c6155417d3ba" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:20:47 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-2f07bffa-786c-4024-b0d4-c6155417d3ba" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:20:47 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 07:20:48 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Updating instance_info_cache with network_info: [{"id": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "address": "fa:16:3e:23:0e:15", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c62a706-97", "ovs_interfaceid": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:20:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-2f07bffa-786c-4024-b0d4-c6155417d3ba" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:20:48 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 07:20:48 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:20:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:20:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:20:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:20:48 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 07:20:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:20:48 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:20:48 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:20:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:20:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:49 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:20:49 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:20:49 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:20:49 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:20:49 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=8433MB free_disk=25.123580932617188GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 07:20:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:20:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:20:49 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 2f07bffa-786c-4024-b0d4-c6155417d3ba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:20:49 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 476ced47-d6f0-4581-9d12-39f5b1fe90d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:20:49 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:20:49 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 07:20:49 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 07:20:49 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Refreshing inventories for resource provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 07:20:49 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Updating ProviderTree inventory for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 07:20:49 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Updating inventory in ProviderTree for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 07:20:49 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Refreshing aggregate associations for resource provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3, aggregates: None {{(pid=72809) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 07:20:49 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Refreshing trait associations for resource provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI {{(pid=72809) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 07:20:50 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:20:50 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:20:50 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 07:20:50 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.393s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:20:50 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:51 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:20:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:55 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:55 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:58 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:20:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:20:59 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:21:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:21:00 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:21:02 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:21:02 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:21:02 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 07:21:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:21:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:21:07 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:21:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:21:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:21:11 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:21:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:21:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:21:20 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:21:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:21:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:21:35 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:21:40 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:21:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:21:48 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:21:48 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 07:21:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-476ced47-d6f0-4581-9d12-39f5b1fe90d0" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:21:48 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-476ced47-d6f0-4581-9d12-39f5b1fe90d0" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:21:48 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 07:21:49 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Updating instance_info_cache with network_info: [{"id": "c2ace49a-35ba-443f-a90a-7f43b3ea1079", "address": "fa:16:3e:9c:da:f2", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ace49a-35", "ovs_interfaceid": "c2ace49a-35ba-443f-a90a-7f43b3ea1079", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:21:49 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-476ced47-d6f0-4581-9d12-39f5b1fe90d0" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:21:49 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 07:21:50 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:21:50 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:21:50 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:21:50 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:21:50 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:21:50 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 07:21:50 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:21:50 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:21:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:21:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:21:50 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:21:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:21:51 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:21:51 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:21:51 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:21:51 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=8539MB free_disk=25.122047424316406GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 07:21:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:21:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:21:51 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 2f07bffa-786c-4024-b0d4-c6155417d3ba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:21:51 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 476ced47-d6f0-4581-9d12-39f5b1fe90d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:21:51 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:21:51 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 07:21:51 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 07:21:51 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:21:51 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:21:51 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 07:21:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.265s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:21:52 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:21:55 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:22:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:22:00 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:22:01 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:22:01 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:22:02 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:22:02 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:22:02 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 07:22:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:22:07 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:22:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:22:08 user nova-compute[72809]: DEBUG nova.compute.manager [req-cbc581da-1d2d-4b02-9438-2c91e2c0389a req-2a682eff-28c0-47df-8fdb-0dbf08c1fcea service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Received event network-changed-4c62a706-971f-4153-9d45-1fcb03ece3eb {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:22:08 user nova-compute[72809]: DEBUG nova.compute.manager [req-cbc581da-1d2d-4b02-9438-2c91e2c0389a req-2a682eff-28c0-47df-8fdb-0dbf08c1fcea service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Refreshing instance network info cache due to event network-changed-4c62a706-971f-4153-9d45-1fcb03ece3eb. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:22:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-cbc581da-1d2d-4b02-9438-2c91e2c0389a req-2a682eff-28c0-47df-8fdb-0dbf08c1fcea service nova] Acquiring lock "refresh_cache-2f07bffa-786c-4024-b0d4-c6155417d3ba" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:22:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-cbc581da-1d2d-4b02-9438-2c91e2c0389a req-2a682eff-28c0-47df-8fdb-0dbf08c1fcea service nova] Acquired lock "refresh_cache-2f07bffa-786c-4024-b0d4-c6155417d3ba" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:22:08 user nova-compute[72809]: DEBUG nova.network.neutron [req-cbc581da-1d2d-4b02-9438-2c91e2c0389a req-2a682eff-28c0-47df-8fdb-0dbf08c1fcea service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Refreshing network info cache for port 4c62a706-971f-4153-9d45-1fcb03ece3eb {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:22:09 user nova-compute[72809]: DEBUG nova.network.neutron [req-cbc581da-1d2d-4b02-9438-2c91e2c0389a req-2a682eff-28c0-47df-8fdb-0dbf08c1fcea service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Updated VIF entry in instance network info cache for port 4c62a706-971f-4153-9d45-1fcb03ece3eb. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:22:09 user nova-compute[72809]: DEBUG nova.network.neutron [req-cbc581da-1d2d-4b02-9438-2c91e2c0389a req-2a682eff-28c0-47df-8fdb-0dbf08c1fcea service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Updating instance_info_cache with network_info: [{"id": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "address": "fa:16:3e:23:0e:15", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c62a706-97", "ovs_interfaceid": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:22:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-cbc581da-1d2d-4b02-9438-2c91e2c0389a req-2a682eff-28c0-47df-8fdb-0dbf08c1fcea service nova] Releasing lock "refresh_cache-2f07bffa-786c-4024-b0d4-c6155417d3ba" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:22:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:22:09 user nova-compute[72809]: DEBUG nova.compute.manager [req-f0e4a349-1d53-4ca8-abf5-f7b8886ba51a req-0a579e71-2016-4230-bfbb-b7882e530636 service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Received event network-changed-4c62a706-971f-4153-9d45-1fcb03ece3eb {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:22:09 user nova-compute[72809]: DEBUG nova.compute.manager [req-f0e4a349-1d53-4ca8-abf5-f7b8886ba51a req-0a579e71-2016-4230-bfbb-b7882e530636 service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Refreshing instance network info cache due to event network-changed-4c62a706-971f-4153-9d45-1fcb03ece3eb. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:22:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f0e4a349-1d53-4ca8-abf5-f7b8886ba51a req-0a579e71-2016-4230-bfbb-b7882e530636 service nova] Acquiring lock "refresh_cache-2f07bffa-786c-4024-b0d4-c6155417d3ba" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:22:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f0e4a349-1d53-4ca8-abf5-f7b8886ba51a req-0a579e71-2016-4230-bfbb-b7882e530636 service nova] Acquired lock "refresh_cache-2f07bffa-786c-4024-b0d4-c6155417d3ba" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:22:09 user nova-compute[72809]: DEBUG nova.network.neutron [req-f0e4a349-1d53-4ca8-abf5-f7b8886ba51a req-0a579e71-2016-4230-bfbb-b7882e530636 service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Refreshing network info cache for port 4c62a706-971f-4153-9d45-1fcb03ece3eb {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:22:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "2f07bffa-786c-4024-b0d4-c6155417d3ba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:22:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "2f07bffa-786c-4024-b0d4-c6155417d3ba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:22:09 user nova-compute[72809]: INFO nova.compute.manager [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Detaching volume 8817b7f9-5956-41d4-a48b-05cdad06edd7
Aug 09 07:22:09 user nova-compute[72809]: INFO nova.virt.block_device [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Attempting to driver detach volume 8817b7f9-5956-41d4-a48b-05cdad06edd7 from mountpoint /dev/vdb
Aug 09 07:22:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Attempting to detach device vdb from instance 2f07bffa-786c-4024-b0d4-c6155417d3ba from the persistent domain config. {{(pid=72809) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 07:22:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:22:09 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:22:09 user nova-compute[72809]:   <source dev="/dev/sdc"/>
Aug 09 07:22:09 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:22:09 user nova-compute[72809]:   <serial>8817b7f9-5956-41d4-a48b-05cdad06edd7</serial>
Aug 09 07:22:09 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 07:22:09 user nova-compute[72809]: </disk>
Aug 09 07:22:09 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:22:09 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Successfully detached device vdb from instance 2f07bffa-786c-4024-b0d4-c6155417d3ba from the persistent domain config.
Aug 09 07:22:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2f07bffa-786c-4024-b0d4-c6155417d3ba from the live domain config. {{(pid=72809) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 07:22:09 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:22:09 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:22:09 user nova-compute[72809]:   <source dev="/dev/sdc"/>
Aug 09 07:22:09 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:22:09 user nova-compute[72809]:   <serial>8817b7f9-5956-41d4-a48b-05cdad06edd7</serial>
Aug 09 07:22:09 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 07:22:09 user nova-compute[72809]: </disk>
Aug 09 07:22:09 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG nova.network.neutron [req-f0e4a349-1d53-4ca8-abf5-f7b8886ba51a req-0a579e71-2016-4230-bfbb-b7882e530636 service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Updated VIF entry in instance network info cache for port 4c62a706-971f-4153-9d45-1fcb03ece3eb. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG nova.network.neutron [req-f0e4a349-1d53-4ca8-abf5-f7b8886ba51a req-0a579e71-2016-4230-bfbb-b7882e530636 service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Updating instance_info_cache with network_info: [{"id": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "address": "fa:16:3e:23:0e:15", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c62a706-97", "ovs_interfaceid": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-f0e4a349-1d53-4ca8-abf5-f7b8886ba51a req-0a579e71-2016-4230-bfbb-b7882e530636 service nova] Releasing lock "refresh_cache-2f07bffa-786c-4024-b0d4-c6155417d3ba" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Received event <DeviceRemovedEvent: 1691565730.424697, 2f07bffa-786c-4024-b0d4-c6155417d3ba => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72809) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2f07bffa-786c-4024-b0d4-c6155417d3ba {{(pid=72809) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 07:22:10 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Successfully detached device vdb from instance 2f07bffa-786c-4024-b0d4-c6155417d3ba from the live domain config.
Aug 09 07:22:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VZJWsqTk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:22:10 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:22:10 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cccb740-183b-4027-992c-43b40af13e0c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6945c07b-2476-499f-9e48-1875744599f7]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b (non-flash)
Aug 09 07:22:10 user nova-compute[72809]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 (non-flash)
Aug 09 07:22:10 user nova-compute[72809]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5 (non-flash)
Aug 09 07:22:10 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b (non-flash)
Aug 09 07:22:10 user nova-compute[72809]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 (non-flash)
Aug 09 07:22:10 user nova-compute[72809]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5 (non-flash)
Aug 09 07:22:10 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc158671090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7'): ({'sdc'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Removing single pathed devices sdc {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[415c175f-3ea7-4d44-a9e8-7896d45d92ec]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9bcc01-8432-4420-be76-324c17259766]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Flushing IO for device /dev/sdc {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d263bc87-dc73-4206-8ec0-0957141c9f8e]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d24175-2dda-4974-93c7-6ad3abe61e86]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] SCSI volumes sdc have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5529b7b7-9090-458f-b9d9-f1d55cc291ba]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0204b704-2b15-4394-a0d9-66d2b02f1e42]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7, portal: 172.16.0.220,3260]
Aug 09 07:22:10 user nova-compute[72809]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7, portal: 172.16.0.220,3260] successful.
Aug 09 07:22:10 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8817b7f9-5956-41d4-a48b-05cdad06edd7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0527ed0-ed9d-489f-a4b6-3cf65c21c3f1]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] <== disconnect_volume: return (275ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:22:10 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:22:11 user nova-compute[72809]: DEBUG nova.objects.instance [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lazy-loading 'flavor' on Instance uuid 2f07bffa-786c-4024-b0d4-c6155417d3ba {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:22:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-257e411d-12cb-4050-9d1b-52fd5d53a767 tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "2f07bffa-786c-4024-b0d4-c6155417d3ba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.580s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:22:15 user nova-compute[72809]: DEBUG nova.compute.manager [req-2f37dd41-e0dd-4efd-bcc7-bd6dd2f79e78 req-b4c9604b-d3c3-4b07-8e4f-c278afe2564f service nova] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Received event network-changed-1dada21e-73f7-453a-8b0b-aaec34282103 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:22:15 user nova-compute[72809]: DEBUG nova.compute.manager [req-2f37dd41-e0dd-4efd-bcc7-bd6dd2f79e78 req-b4c9604b-d3c3-4b07-8e4f-c278afe2564f service nova] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Refreshing instance network info cache due to event network-changed-1dada21e-73f7-453a-8b0b-aaec34282103. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:22:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2f37dd41-e0dd-4efd-bcc7-bd6dd2f79e78 req-b4c9604b-d3c3-4b07-8e4f-c278afe2564f service nova] Acquiring lock "refresh_cache-e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:22:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2f37dd41-e0dd-4efd-bcc7-bd6dd2f79e78 req-b4c9604b-d3c3-4b07-8e4f-c278afe2564f service nova] Acquired lock "refresh_cache-e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:22:15 user nova-compute[72809]: DEBUG nova.network.neutron [req-2f37dd41-e0dd-4efd-bcc7-bd6dd2f79e78 req-b4c9604b-d3c3-4b07-8e4f-c278afe2564f service nova] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Refreshing network info cache for port 1dada21e-73f7-453a-8b0b-aaec34282103 {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:22:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:22:15 user nova-compute[72809]: DEBUG nova.network.neutron [req-2f37dd41-e0dd-4efd-bcc7-bd6dd2f79e78 req-b4c9604b-d3c3-4b07-8e4f-c278afe2564f service nova] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Updated VIF entry in instance network info cache for port 1dada21e-73f7-453a-8b0b-aaec34282103. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:22:15 user nova-compute[72809]: DEBUG nova.network.neutron [req-2f37dd41-e0dd-4efd-bcc7-bd6dd2f79e78 req-b4c9604b-d3c3-4b07-8e4f-c278afe2564f service nova] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Updating instance_info_cache with network_info: [{"id": "1dada21e-73f7-453a-8b0b-aaec34282103", "address": "fa:16:3e:50:92:ea", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dada21e-73", "ovs_interfaceid": "1dada21e-73f7-453a-8b0b-aaec34282103", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:22:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-2f37dd41-e0dd-4efd-bcc7-bd6dd2f79e78 req-b4c9604b-d3c3-4b07-8e4f-c278afe2564f service nova] Releasing lock "refresh_cache-e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:22:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:22:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:22:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:22:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:22:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:22:16 user nova-compute[72809]: INFO nova.compute.manager [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Terminating instance
Aug 09 07:22:16 user nova-compute[72809]: DEBUG nova.compute.manager [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG nova.compute.manager [req-44267281-54b9-4544-aafb-4f3a545bb8df req-ee96331d-493f-4466-8f04-b60d0188a84c service nova] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Received event network-vif-unplugged-1dada21e-73f7-453a-8b0b-aaec34282103 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-44267281-54b9-4544-aafb-4f3a545bb8df req-ee96331d-493f-4466-8f04-b60d0188a84c service nova] Acquiring lock "e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-44267281-54b9-4544-aafb-4f3a545bb8df req-ee96331d-493f-4466-8f04-b60d0188a84c service nova] Lock "e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-44267281-54b9-4544-aafb-4f3a545bb8df req-ee96331d-493f-4466-8f04-b60d0188a84c service nova] Lock "e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG nova.compute.manager [req-44267281-54b9-4544-aafb-4f3a545bb8df req-ee96331d-493f-4466-8f04-b60d0188a84c service nova] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] No waiting events found dispatching network-vif-unplugged-1dada21e-73f7-453a-8b0b-aaec34282103 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG nova.compute.manager [req-44267281-54b9-4544-aafb-4f3a545bb8df req-ee96331d-493f-4466-8f04-b60d0188a84c service nova] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Received event network-vif-unplugged-1dada21e-73f7-453a-8b0b-aaec34282103 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:22:16 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Instance destroyed successfully.
Aug 09 07:22:16 user nova-compute[72809]: DEBUG nova.objects.instance [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lazy-loading 'resources' on Instance uuid e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:20:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-496228920',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-496228920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-496228920',id=47,image_ref='ffbd60ac-97c4-41f5-b171-14781f3b0e0d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENx/V0vGTxRzyQA2FSw72STIekvGXafMBs2HauIC4VQQ6gDigi0zY6GBhz9b785nkTbVZNV7ZML4Fov04T1QSFwSKrK7tZzXDrv7cKfL719UjqXT+FH7S/r+dxn3I5efg==',key_name='tempest-keypair-1976925239',keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:20:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8cdcd8241b9b47eab16a6e37a9cc5f54',ramdisk_id='',reservation_id='r-ih1mkvtg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-224847517',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-224847517-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-224847517',owner_user_name='tempest-TestVolumeBootPattern-224847517-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:20:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7859a38408b426eb9a14ef003483bd3',uuid=e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1dada21e-73f7-453a-8b0b-aaec34282103", "address": "fa:16:3e:50:92:ea", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dada21e-73", "ovs_interfaceid": "1dada21e-73f7-453a-8b0b-aaec34282103", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converting VIF {"id": "1dada21e-73f7-453a-8b0b-aaec34282103", "address": "fa:16:3e:50:92:ea", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dada21e-73", "ovs_interfaceid": "1dada21e-73f7-453a-8b0b-aaec34282103", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:92:ea,bridge_name='br-int',has_traffic_filtering=True,id=1dada21e-73f7-453a-8b0b-aaec34282103,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dada21e-73') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG os_vif [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:92:ea,bridge_name='br-int',has_traffic_filtering=True,id=1dada21e-73f7-453a-8b0b-aaec34282103,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dada21e-73') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1dada21e-73, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:22:16 user nova-compute[72809]: INFO os_vif [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:92:ea,bridge_name='br-int',has_traffic_filtering=True,id=1dada21e-73f7-453a-8b0b-aaec34282103,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dada21e-73')
Aug 09 07:22:16 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CymwLsdZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:22:16 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:22:16 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[8133675b-419c-40cd-ad61-144f01f49b5b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52b9c99-9fc4-4071-8be8-32387eeb5380]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b (non-flash)
Aug 09 07:22:16 user nova-compute[72809]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5 (non-flash)
Aug 09 07:22:16 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b (non-flash)
Aug 09 07:22:16 user nova-compute[72809]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5 (non-flash)
Aug 09 07:22:16 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc158206dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5'): ({'sdd'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Removing single pathed devices sdd {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ee568c-e49d-42b7-a7b6-cff1cebbb434]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd29805-113e-4f0d-8e46-631d33db50f1]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Flushing IO for device /dev/sdd {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c8f593-ced2-408e-8bde-59dfe42dd43c]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8612fee-f88e-4a70-b5b4-7db4e0c41672]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] SCSI volumes sdd have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_e1193d4a', '/dev/disk/by-id/scsi-1SCST_BIOe1193d4a-463feede8b027d8b', '/dev/disk/by-id/scsi-23436336665656465') {{(pid=83900) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f6e618-b191-4ab0-af95-3eec6aa64cf2]: (4, None) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:22:16 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:22:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:22:17 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbac42ce-1c3b-4cba-b201-e9250d3848d0]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:22:17 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:22:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5 -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:22:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:22:17 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a30977-fc71-498d-8f68-06e943e0f1c6]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:22:17 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5, portal: 172.16.0.220,3260]
Aug 09 07:22:17 user nova-compute[72809]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5, portal: 172.16.0.220,3260] successful.
Aug 09 07:22:17 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:22:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5 -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:22:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0274bc1-f80a-47cf-9cc9-46b524ebc0d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:22:17 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[572e5241-055b-4b2f-9b8b-133cd14131cf]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:22:17 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:22:17 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:22:17 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] <== disconnect_volume: return (281ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:22:17 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:22:17 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Deleting instance files /opt/stack/data/nova/instances/e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be_del
Aug 09 07:22:17 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Deletion of /opt/stack/data/nova/instances/e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be_del complete
Aug 09 07:22:17 user nova-compute[72809]: INFO nova.compute.manager [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 09 07:22:17 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:22:17 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:22:17 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:22:17 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:22:17 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Took 0.71 seconds to deallocate network for instance.
Aug 09 07:22:17 user nova-compute[72809]: DEBUG nova.compute.manager [req-3fc97951-bf8a-4017-8bf3-53a8fba0a954 req-24ab1e21-dd71-4d76-863a-787143838b73 service nova] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Received event network-vif-deleted-1dada21e-73f7-453a-8b0b-aaec34282103 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:22:17 user nova-compute[72809]: INFO nova.compute.manager [req-3fc97951-bf8a-4017-8bf3-53a8fba0a954 req-24ab1e21-dd71-4d76-863a-787143838b73 service nova] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Neutron deleted interface 1dada21e-73f7-453a-8b0b-aaec34282103; detaching it from the instance and deleting it from the info cache
Aug 09 07:22:17 user nova-compute[72809]: DEBUG nova.network.neutron [req-3fc97951-bf8a-4017-8bf3-53a8fba0a954 req-24ab1e21-dd71-4d76-863a-787143838b73 service nova] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:22:17 user nova-compute[72809]: DEBUG nova.compute.manager [req-3fc97951-bf8a-4017-8bf3-53a8fba0a954 req-24ab1e21-dd71-4d76-863a-787143838b73 service nova] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Detach interface failed, port_id=1dada21e-73f7-453a-8b0b-aaec34282103, reason: Instance e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be could not be found. {{(pid=72809) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 07:22:18 user nova-compute[72809]: DEBUG nova.compute.manager [req-248f4194-9bde-42be-bbbc-5a4782ce8aae req-6ffac05f-da35-4412-96a4-a76a70faece7 service nova] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Received event network-vif-plugged-1dada21e-73f7-453a-8b0b-aaec34282103 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:22:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-248f4194-9bde-42be-bbbc-5a4782ce8aae req-6ffac05f-da35-4412-96a4-a76a70faece7 service nova] Acquiring lock "e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:22:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-248f4194-9bde-42be-bbbc-5a4782ce8aae req-6ffac05f-da35-4412-96a4-a76a70faece7 service nova] Lock "e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:22:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-248f4194-9bde-42be-bbbc-5a4782ce8aae req-6ffac05f-da35-4412-96a4-a76a70faece7 service nova] Lock "e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:22:18 user nova-compute[72809]: DEBUG nova.compute.manager [req-248f4194-9bde-42be-bbbc-5a4782ce8aae req-6ffac05f-da35-4412-96a4-a76a70faece7 service nova] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] No waiting events found dispatching network-vif-plugged-1dada21e-73f7-453a-8b0b-aaec34282103 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:22:18 user nova-compute[72809]: WARNING nova.compute.manager [req-248f4194-9bde-42be-bbbc-5a4782ce8aae req-6ffac05f-da35-4412-96a4-a76a70faece7 service nova] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Received unexpected event network-vif-plugged-1dada21e-73f7-453a-8b0b-aaec34282103 for instance with vm_state active and task_state deleting.
Aug 09 07:22:18 user nova-compute[72809]: INFO nova.compute.manager [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Took 0.72 seconds to detach 1 volumes for instance.
Aug 09 07:22:18 user nova-compute[72809]: DEBUG nova.compute.manager [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Deleting volume: f0274bc1-f80a-47cf-9cc9-46b524ebc0d5 {{(pid=72809) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 07:22:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:22:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:22:18 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:22:18 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:22:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:22:18 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Deleted allocations for instance e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be
Aug 09 07:22:19 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-897127d0-1e71-499d-919c-2d15a7e30950 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.023s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:22:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:22:21 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:22:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:22:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:22:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72809) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 07:22:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:22:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:22:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:22:31 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691565736.751107, e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:22:31 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] VM Stopped (Lifecycle Event)
Aug 09 07:22:31 user nova-compute[72809]: DEBUG nova.compute.manager [None req-b67f4fe8-9aaa-41a8-a8f4-5917883335e8 None None] [instance: e1e1f638-e4c5-4909-b9cd-2bf6dfb5a6be] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:22:31 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:22:31 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:22:31 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72809) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 07:22:31 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:22:31 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:22:31 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:22:36 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:22:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:22:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:22:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72809) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 07:22:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:22:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:22:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:22:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:22:50 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:22:50 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 07:22:50 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Rebuilding the list of instances to heal {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 07:22:50 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-2f07bffa-786c-4024-b0d4-c6155417d3ba" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:22:50 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-2f07bffa-786c-4024-b0d4-c6155417d3ba" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:22:50 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 07:22:50 user nova-compute[72809]: DEBUG nova.objects.instance [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lazy-loading 'info_cache' on Instance uuid 2f07bffa-786c-4024-b0d4-c6155417d3ba {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:22:51 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Updating instance_info_cache with network_info: [{"id": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "address": "fa:16:3e:23:0e:15", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c62a706-97", "ovs_interfaceid": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:22:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-2f07bffa-786c-4024-b0d4-c6155417d3ba" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:22:51 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 07:22:51 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:22:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:22:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:22:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:22:51 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 07:22:51 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:22:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:22:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:22:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:22:51 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:22:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:22:52 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:22:52 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:22:52 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=8622MB free_disk=25.113140106201172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 07:22:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:22:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:22:52 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 2f07bffa-786c-4024-b0d4-c6155417d3ba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:22:52 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 476ced47-d6f0-4581-9d12-39f5b1fe90d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:22:52 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 07:22:52 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 07:22:52 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:22:52 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:22:52 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 07:22:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:22:52 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:22:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:23:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:23:02 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:23:02 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:23:02 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 07:23:03 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:23:03 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:23:04 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:23:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7bdb3eb6-3fc3-42c2-b4e9-f8646321ea3c tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "2f07bffa-786c-4024-b0d4-c6155417d3ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:23:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7bdb3eb6-3fc3-42c2-b4e9-f8646321ea3c tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "2f07bffa-786c-4024-b0d4-c6155417d3ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:23:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7bdb3eb6-3fc3-42c2-b4e9-f8646321ea3c tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "2f07bffa-786c-4024-b0d4-c6155417d3ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:23:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7bdb3eb6-3fc3-42c2-b4e9-f8646321ea3c tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "2f07bffa-786c-4024-b0d4-c6155417d3ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:23:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7bdb3eb6-3fc3-42c2-b4e9-f8646321ea3c tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "2f07bffa-786c-4024-b0d4-c6155417d3ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:23:05 user nova-compute[72809]: INFO nova.compute.manager [None req-7bdb3eb6-3fc3-42c2-b4e9-f8646321ea3c tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Terminating instance
Aug 09 07:23:05 user nova-compute[72809]: DEBUG nova.compute.manager [None req-7bdb3eb6-3fc3-42c2-b4e9-f8646321ea3c tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:23:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:23:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:23:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:23:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:23:05 user nova-compute[72809]: DEBUG nova.compute.manager [req-aea85355-9d24-459f-9f14-33d25ce08d6a req-454e095c-9731-4739-a877-08ec79025a66 service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Received event network-vif-unplugged-4c62a706-971f-4153-9d45-1fcb03ece3eb {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:23:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-aea85355-9d24-459f-9f14-33d25ce08d6a req-454e095c-9731-4739-a877-08ec79025a66 service nova] Acquiring lock "2f07bffa-786c-4024-b0d4-c6155417d3ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:23:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-aea85355-9d24-459f-9f14-33d25ce08d6a req-454e095c-9731-4739-a877-08ec79025a66 service nova] Lock "2f07bffa-786c-4024-b0d4-c6155417d3ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:23:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-aea85355-9d24-459f-9f14-33d25ce08d6a req-454e095c-9731-4739-a877-08ec79025a66 service nova] Lock "2f07bffa-786c-4024-b0d4-c6155417d3ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:23:05 user nova-compute[72809]: DEBUG nova.compute.manager [req-aea85355-9d24-459f-9f14-33d25ce08d6a req-454e095c-9731-4739-a877-08ec79025a66 service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] No waiting events found dispatching network-vif-unplugged-4c62a706-971f-4153-9d45-1fcb03ece3eb {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:23:05 user nova-compute[72809]: DEBUG nova.compute.manager [req-aea85355-9d24-459f-9f14-33d25ce08d6a req-454e095c-9731-4739-a877-08ec79025a66 service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Received event network-vif-unplugged-4c62a706-971f-4153-9d45-1fcb03ece3eb for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:23:06 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Instance destroyed successfully.
Aug 09 07:23:06 user nova-compute[72809]: DEBUG nova.objects.instance [None req-7bdb3eb6-3fc3-42c2-b4e9-f8646321ea3c tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lazy-loading 'resources' on Instance uuid 2f07bffa-786c-4024-b0d4-c6155417d3ba {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:23:06 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-7bdb3eb6-3fc3-42c2-b4e9-f8646321ea3c tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:18:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1974636058',display_name='tempest-TestMinimumBasicScenario-server-1974636058',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1974636058',id=45,image_ref='d4e0bb26-cf78-4499-9838-7faa7f7eb3b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDP5Ae9+WUjvoYH5T6pFGI0XvMT74Gjj4Kj/FfzkhVviBqxtfzs90JWsfpGWEhBtsZ5Wz/Pq33E686ioVr4tXD3oqJrv+aAynCYI65flCYaj6eHu/70oTdLKqroGV3DKnA==',key_name='tempest-TestMinimumBasicScenario-1501750792',keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:18:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96695e79164d4b9d836be01cad13efd8',ramdisk_id='',reservation_id='r-a1umsdzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d4e0bb26-cf78-4499-9838-7faa7f7eb3b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1810598523',owner_user_name='tempest-TestMinimumBasicScenario-1810598523-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:20:24Z,user_data=None,user_id='ed97d2c12b4b408cb1ab70dc60b2170d',uuid=2f07bffa-786c-4024-b0d4-c6155417d3ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "address": "fa:16:3e:23:0e:15", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c62a706-97", "ovs_interfaceid": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:23:06 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7bdb3eb6-3fc3-42c2-b4e9-f8646321ea3c tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Converting VIF {"id": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "address": "fa:16:3e:23:0e:15", "network": {"id": "0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1759803460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96695e79164d4b9d836be01cad13efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c62a706-97", "ovs_interfaceid": "4c62a706-971f-4153-9d45-1fcb03ece3eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:23:06 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-7bdb3eb6-3fc3-42c2-b4e9-f8646321ea3c tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:0e:15,bridge_name='br-int',has_traffic_filtering=True,id=4c62a706-971f-4153-9d45-1fcb03ece3eb,network=Network(0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c62a706-97') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:23:06 user nova-compute[72809]: DEBUG os_vif [None req-7bdb3eb6-3fc3-42c2-b4e9-f8646321ea3c tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:0e:15,bridge_name='br-int',has_traffic_filtering=True,id=4c62a706-971f-4153-9d45-1fcb03ece3eb,network=Network(0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c62a706-97') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:23:06 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:23:06 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c62a706-97, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:23:06 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:23:06 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:23:06 user nova-compute[72809]: INFO os_vif [None req-7bdb3eb6-3fc3-42c2-b4e9-f8646321ea3c tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:0e:15,bridge_name='br-int',has_traffic_filtering=True,id=4c62a706-971f-4153-9d45-1fcb03ece3eb,network=Network(0eaba5ce-2fc2-4f48-9d31-ce996ff7cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c62a706-97')
Aug 09 07:23:06 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-7bdb3eb6-3fc3-42c2-b4e9-f8646321ea3c tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Deleting instance files /opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba_del
Aug 09 07:23:06 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-7bdb3eb6-3fc3-42c2-b4e9-f8646321ea3c tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Deletion of /opt/stack/data/nova/instances/2f07bffa-786c-4024-b0d4-c6155417d3ba_del complete
Aug 09 07:23:06 user nova-compute[72809]: INFO nova.compute.manager [None req-7bdb3eb6-3fc3-42c2-b4e9-f8646321ea3c tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 09 07:23:06 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-7bdb3eb6-3fc3-42c2-b4e9-f8646321ea3c tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:23:06 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:23:06 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:23:07 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:23:07 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Took 0.54 seconds to deallocate network for instance.
Aug 09 07:23:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7bdb3eb6-3fc3-42c2-b4e9-f8646321ea3c tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:23:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7bdb3eb6-3fc3-42c2-b4e9-f8646321ea3c tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:23:07 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-7bdb3eb6-3fc3-42c2-b4e9-f8646321ea3c tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:23:07 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-7bdb3eb6-3fc3-42c2-b4e9-f8646321ea3c tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:23:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7bdb3eb6-3fc3-42c2-b4e9-f8646321ea3c tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:23:07 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-7bdb3eb6-3fc3-42c2-b4e9-f8646321ea3c tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Deleted allocations for instance 2f07bffa-786c-4024-b0d4-c6155417d3ba
Aug 09 07:23:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-7bdb3eb6-3fc3-42c2-b4e9-f8646321ea3c tempest-TestMinimumBasicScenario-1810598523 tempest-TestMinimumBasicScenario-1810598523-project-member] Lock "2f07bffa-786c-4024-b0d4-c6155417d3ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.744s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:23:08 user nova-compute[72809]: DEBUG nova.compute.manager [req-a61a6557-fd6b-4d9f-9345-a9ad2d5aadde req-5a910822-2c0a-40ec-b104-cdc5e21cdfcd service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Received event network-vif-plugged-4c62a706-971f-4153-9d45-1fcb03ece3eb {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:23:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a61a6557-fd6b-4d9f-9345-a9ad2d5aadde req-5a910822-2c0a-40ec-b104-cdc5e21cdfcd service nova] Acquiring lock "2f07bffa-786c-4024-b0d4-c6155417d3ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:23:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a61a6557-fd6b-4d9f-9345-a9ad2d5aadde req-5a910822-2c0a-40ec-b104-cdc5e21cdfcd service nova] Lock "2f07bffa-786c-4024-b0d4-c6155417d3ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:23:08 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a61a6557-fd6b-4d9f-9345-a9ad2d5aadde req-5a910822-2c0a-40ec-b104-cdc5e21cdfcd service nova] Lock "2f07bffa-786c-4024-b0d4-c6155417d3ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:23:08 user nova-compute[72809]: DEBUG nova.compute.manager [req-a61a6557-fd6b-4d9f-9345-a9ad2d5aadde req-5a910822-2c0a-40ec-b104-cdc5e21cdfcd service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] No waiting events found dispatching network-vif-plugged-4c62a706-971f-4153-9d45-1fcb03ece3eb {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:23:08 user nova-compute[72809]: WARNING nova.compute.manager [req-a61a6557-fd6b-4d9f-9345-a9ad2d5aadde req-5a910822-2c0a-40ec-b104-cdc5e21cdfcd service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Received unexpected event network-vif-plugged-4c62a706-971f-4153-9d45-1fcb03ece3eb for instance with vm_state deleted and task_state None.
Aug 09 07:23:08 user nova-compute[72809]: DEBUG nova.compute.manager [req-a61a6557-fd6b-4d9f-9345-a9ad2d5aadde req-5a910822-2c0a-40ec-b104-cdc5e21cdfcd service nova] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Received event network-vif-deleted-4c62a706-971f-4153-9d45-1fcb03ece3eb {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:23:09 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:23:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "476ced47-d6f0-4581-9d12-39f5b1fe90d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:23:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "476ced47-d6f0-4581-9d12-39f5b1fe90d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:23:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "476ced47-d6f0-4581-9d12-39f5b1fe90d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:23:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "476ced47-d6f0-4581-9d12-39f5b1fe90d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:23:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "476ced47-d6f0-4581-9d12-39f5b1fe90d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:23:10 user nova-compute[72809]: INFO nova.compute.manager [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Terminating instance
Aug 09 07:23:10 user nova-compute[72809]: DEBUG nova.compute.manager [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:23:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:23:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:23:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:23:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG nova.compute.manager [req-1296a6f4-095f-45fa-aca4-06c2e417ad4a req-ca43f044-2987-44ec-bf0b-5beb4ef21e1a service nova] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Received event network-vif-unplugged-c2ace49a-35ba-443f-a90a-7f43b3ea1079 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1296a6f4-095f-45fa-aca4-06c2e417ad4a req-ca43f044-2987-44ec-bf0b-5beb4ef21e1a service nova] Acquiring lock "476ced47-d6f0-4581-9d12-39f5b1fe90d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1296a6f4-095f-45fa-aca4-06c2e417ad4a req-ca43f044-2987-44ec-bf0b-5beb4ef21e1a service nova] Lock "476ced47-d6f0-4581-9d12-39f5b1fe90d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1296a6f4-095f-45fa-aca4-06c2e417ad4a req-ca43f044-2987-44ec-bf0b-5beb4ef21e1a service nova] Lock "476ced47-d6f0-4581-9d12-39f5b1fe90d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG nova.compute.manager [req-1296a6f4-095f-45fa-aca4-06c2e417ad4a req-ca43f044-2987-44ec-bf0b-5beb4ef21e1a service nova] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] No waiting events found dispatching network-vif-unplugged-c2ace49a-35ba-443f-a90a-7f43b3ea1079 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG nova.compute.manager [req-1296a6f4-095f-45fa-aca4-06c2e417ad4a req-ca43f044-2987-44ec-bf0b-5beb4ef21e1a service nova] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Received event network-vif-unplugged-c2ace49a-35ba-443f-a90a-7f43b3ea1079 for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:23:11 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Instance destroyed successfully.
Aug 09 07:23:11 user nova-compute[72809]: DEBUG nova.objects.instance [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lazy-loading 'resources' on Instance uuid 476ced47-d6f0-4581-9d12-39f5b1fe90d0 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:18:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1843871379',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1843871379',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1843871379',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdavMQws6q7edRXy8NJ16Qm+gSUVO27aTZ1DaMCFHMrfBdM4jGqf55yzB257uo62n/KNv1m4VV+P4y9gCCAJSzWYTkJPhIm2cb/tqgUOOmZDzyMoPj8rwyY4Pn8wk90Jw==',key_name='tempest-keypair-643055003',keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:18:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8cdcd8241b9b47eab16a6e37a9cc5f54',ramdisk_id='',reservation_id='r-e62mlyrz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-224847517',owner_user_name='tempest-TestVolumeBootPattern-224847517-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:18:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7859a38408b426eb9a14ef003483bd3',uuid=476ced47-d6f0-4581-9d12-39f5b1fe90d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2ace49a-35ba-443f-a90a-7f43b3ea1079", "address": "fa:16:3e:9c:da:f2", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ace49a-35", "ovs_interfaceid": "c2ace49a-35ba-443f-a90a-7f43b3ea1079", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converting VIF {"id": "c2ace49a-35ba-443f-a90a-7f43b3ea1079", "address": "fa:16:3e:9c:da:f2", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ace49a-35", "ovs_interfaceid": "c2ace49a-35ba-443f-a90a-7f43b3ea1079", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:da:f2,bridge_name='br-int',has_traffic_filtering=True,id=c2ace49a-35ba-443f-a90a-7f43b3ea1079,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ace49a-35') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG os_vif [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:da:f2,bridge_name='br-int',has_traffic_filtering=True,id=c2ace49a-35ba-443f-a90a-7f43b3ea1079,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ace49a-35') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2ace49a-35, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:23:11 user nova-compute[72809]: INFO os_vif [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:da:f2,bridge_name='br-int',has_traffic_filtering=True,id=c2ace49a-35ba-443f-a90a-7f43b3ea1079,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ace49a-35')
Aug 09 07:23:11 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFWTSMCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:23:11 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:23:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3468aa15-dd7f-4bc8-806b-5b19fd9655c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2532127d-2fec-4053-a86b-e8e7a3ab1d63]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b (non-flash)
Aug 09 07:23:11 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b (non-flash)
Aug 09 07:23:11 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc1582056c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b'): ({'sdb'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Removing single pathed devices sdb {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[69407992-cf31-455d-8f22-c38fe02b3657]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[483d4fcb-e717-48ef-93d0-90d5a54feb70]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Flushing IO for device /dev/sdb {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc21edd-d85c-46df-8ed9-0270c8da10f9]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff798d0-0be0-474a-a85a-3f662f1ad4b4]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] SCSI volumes sdb have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23630323638366164', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_13cbd5d1', '/dev/disk/by-id/scsi-1SCST_BIO13cbd5d1-602686ad61357e2c') {{(pid=83900) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41bec28-d129-458d-aef9-2220b6bf588d]: (4, None) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9006c5d-4b9f-4c88-9e7f-d8cd2b84a332]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9b5344-b438-424a-b2a9-729c7d00678d]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b, portal: 172.16.0.220,3260]
Aug 09 07:23:11 user nova-compute[72809]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b, portal: 172.16.0.220,3260] successful.
Aug 09 07:23:11 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:865348e8-a951-4f53-95c5-3567766f503b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c961f58b-f9e4-4e2d-aeac-93c911e81df2]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] <== disconnect_volume: return (297ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:23:11 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Deleting instance files /opt/stack/data/nova/instances/476ced47-d6f0-4581-9d12-39f5b1fe90d0_del
Aug 09 07:23:11 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Deletion of /opt/stack/data/nova/instances/476ced47-d6f0-4581-9d12-39f5b1fe90d0_del complete
Aug 09 07:23:11 user nova-compute[72809]: INFO nova.compute.manager [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 09 07:23:11 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:23:11 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:23:12 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:23:12 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:23:12 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Took 0.78 seconds to deallocate network for instance.
Aug 09 07:23:12 user nova-compute[72809]: DEBUG nova.compute.manager [req-13c17e71-f16d-4266-91bc-d75d80daac3b req-e6c02519-0bb1-4427-9544-af1f8be57344 service nova] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Received event network-vif-deleted-c2ace49a-35ba-443f-a90a-7f43b3ea1079 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:23:13 user nova-compute[72809]: DEBUG nova.compute.manager [req-98619bd5-7183-4977-a2c2-9e7f1a4edaf3 req-25d03fcf-4438-44d7-afcd-c0eb934a3c48 service nova] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Received event network-vif-plugged-c2ace49a-35ba-443f-a90a-7f43b3ea1079 {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:23:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-98619bd5-7183-4977-a2c2-9e7f1a4edaf3 req-25d03fcf-4438-44d7-afcd-c0eb934a3c48 service nova] Acquiring lock "476ced47-d6f0-4581-9d12-39f5b1fe90d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:23:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-98619bd5-7183-4977-a2c2-9e7f1a4edaf3 req-25d03fcf-4438-44d7-afcd-c0eb934a3c48 service nova] Lock "476ced47-d6f0-4581-9d12-39f5b1fe90d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:23:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-98619bd5-7183-4977-a2c2-9e7f1a4edaf3 req-25d03fcf-4438-44d7-afcd-c0eb934a3c48 service nova] Lock "476ced47-d6f0-4581-9d12-39f5b1fe90d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:23:13 user nova-compute[72809]: DEBUG nova.compute.manager [req-98619bd5-7183-4977-a2c2-9e7f1a4edaf3 req-25d03fcf-4438-44d7-afcd-c0eb934a3c48 service nova] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] No waiting events found dispatching network-vif-plugged-c2ace49a-35ba-443f-a90a-7f43b3ea1079 {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:23:13 user nova-compute[72809]: WARNING nova.compute.manager [req-98619bd5-7183-4977-a2c2-9e7f1a4edaf3 req-25d03fcf-4438-44d7-afcd-c0eb934a3c48 service nova] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Received unexpected event network-vif-plugged-c2ace49a-35ba-443f-a90a-7f43b3ea1079 for instance with vm_state active and task_state deleting.
Aug 09 07:23:13 user nova-compute[72809]: INFO nova.compute.manager [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Took 0.75 seconds to detach 1 volumes for instance.
Aug 09 07:23:13 user nova-compute[72809]: DEBUG nova.compute.manager [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Deleting volume: 865348e8-a951-4f53-95c5-3567766f503b {{(pid=72809) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 07:23:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:23:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:23:13 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:23:13 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:23:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:23:13 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Deleted allocations for instance 476ced47-d6f0-4581-9d12-39f5b1fe90d0
Aug 09 07:23:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-8760b537-7737-407a-a0af-49e6d72bf90d tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "476ced47-d6f0-4581-9d12-39f5b1fe90d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.046s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:23:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:23:21 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691565786.5096953, 2f07bffa-786c-4024-b0d4-c6155417d3ba => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:23:21 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] VM Stopped (Lifecycle Event)
Aug 09 07:23:21 user nova-compute[72809]: DEBUG nova.compute.manager [None req-7f7380c9-59f8-411b-9890-90ff0caf5f83 None None] [instance: 2f07bffa-786c-4024-b0d4-c6155417d3ba] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:23:21 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:23:21 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:23:21 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72809) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 07:23:21 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:23:21 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:23:21 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:23:26 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691565791.5758564, 476ced47-d6f0-4581-9d12-39f5b1fe90d0 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:23:26 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] VM Stopped (Lifecycle Event)
Aug 09 07:23:26 user nova-compute[72809]: DEBUG nova.compute.manager [None req-4e264429-e55b-4b60-8c8e-eb6393b499d4 None None] [instance: 476ced47-d6f0-4581-9d12-39f5b1fe90d0] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:23:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:23:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:23:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72809) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 07:23:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:23:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:23:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:23:31 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:23:36 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:23:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:23:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:23:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72809) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 07:23:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:23:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:23:41 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:23:46 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:23:50 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:23:50 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 07:23:50 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Didn't find any instances for network info cache update. {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 07:23:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:23:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:23:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72809) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 07:23:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:23:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:23:51 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:23:51 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:23:52 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:23:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:23:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.004s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:23:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:23:52 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 07:23:53 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:23:53 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:23:53 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=8848MB free_disk=25.140182495117188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 07:23:53 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:23:53 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:23:53 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 07:23:53 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 07:23:53 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:23:53 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:23:53 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 07:23:53 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:23:56 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:23:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:04 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:24:04 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:24:04 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:24:04 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 07:24:04 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:24:05 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:24:06 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:11 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:11 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:24:11 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "1a7c8b14-533d-4913-8d60-4818c3801e54" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:24:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "1a7c8b14-533d-4913-8d60-4818c3801e54" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:24:15 user nova-compute[72809]: DEBUG nova.compute.manager [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 07:24:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:24:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:24:15 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 07:24:15 user nova-compute[72809]: INFO nova.compute.claims [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Claim successful on node user
Aug 09 07:24:15 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:24:15 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:24:15 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.176s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:24:15 user nova-compute[72809]: DEBUG nova.compute.manager [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 07:24:15 user nova-compute[72809]: DEBUG nova.compute.manager [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 07:24:15 user nova-compute[72809]: DEBUG nova.network.neutron [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 07:24:15 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 07:24:15 user nova-compute[72809]: DEBUG nova.compute.manager [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 07:24:15 user nova-compute[72809]: INFO nova.virt.block_device [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Booting with volume e4daa5fd-e98f-45cb-a865-913dcce3e753 at /dev/vda
Aug 09 07:24:15 user nova-compute[72809]: DEBUG nova.policy [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a7859a38408b426eb9a14ef003483bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8241b9b47eab16a6e37a9cc5f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 07:24:15 user nova-compute[72809]: DEBUG os_brick.utils [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:24:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:24:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:24:15 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[083a31f9-65db-42e2-936e-daf016e155ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:24:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:24:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:24:15 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77dd1e4-1e75-4218-a7c3-1a6a20894a47]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:24:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:24:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:24:15 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[991c2143-e8cd-4174-8b43-d0d53522a907]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:24:15 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[93761adb-2aa1-42f5-b186-4796145ba14e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:24:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:24:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:24:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 07:24:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:24:15 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:24:15 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 07:24:15 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cbfe31-186c-4d58-8f01-ef17f56e098e]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:24:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 07:24:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 07:24:15 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 07:24:15 user nova-compute[72809]: DEBUG os_brick.utils [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:24:15 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Updating existing volume attachment record: 516cf51d-49ea-458e-9d5c-a611806b08d5 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 07:24:16 user nova-compute[72809]: DEBUG nova.network.neutron [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Successfully created port: 2816d3a6-e5d7-4189-859b-bd12707eda1c {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 07:24:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:16 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:17 user nova-compute[72809]: DEBUG nova.network.neutron [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Successfully updated port: 2816d3a6-e5d7-4189-859b-bd12707eda1c {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 07:24:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "refresh_cache-1a7c8b14-533d-4913-8d60-4818c3801e54" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:24:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquired lock "refresh_cache-1a7c8b14-533d-4913-8d60-4818c3801e54" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:24:17 user nova-compute[72809]: DEBUG nova.network.neutron [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:24:17 user nova-compute[72809]: DEBUG nova.compute.manager [req-8e70520a-980e-47e5-9c47-ce9ee6433066 req-1d541776-b3de-4178-8b57-df0458fc3a45 service nova] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Received event network-changed-2816d3a6-e5d7-4189-859b-bd12707eda1c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:24:17 user nova-compute[72809]: DEBUG nova.compute.manager [req-8e70520a-980e-47e5-9c47-ce9ee6433066 req-1d541776-b3de-4178-8b57-df0458fc3a45 service nova] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Refreshing instance network info cache due to event network-changed-2816d3a6-e5d7-4189-859b-bd12707eda1c. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:24:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-8e70520a-980e-47e5-9c47-ce9ee6433066 req-1d541776-b3de-4178-8b57-df0458fc3a45 service nova] Acquiring lock "refresh_cache-1a7c8b14-533d-4913-8d60-4818c3801e54" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:24:17 user nova-compute[72809]: DEBUG nova.network.neutron [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 07:24:17 user nova-compute[72809]: DEBUG nova.network.neutron [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Updating instance_info_cache with network_info: [{"id": "2816d3a6-e5d7-4189-859b-bd12707eda1c", "address": "fa:16:3e:44:08:ae", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2816d3a6-e5", "ovs_interfaceid": "2816d3a6-e5d7-4189-859b-bd12707eda1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:24:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Releasing lock "refresh_cache-1a7c8b14-533d-4913-8d60-4818c3801e54" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:24:17 user nova-compute[72809]: DEBUG nova.compute.manager [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Instance network_info: |[{"id": "2816d3a6-e5d7-4189-859b-bd12707eda1c", "address": "fa:16:3e:44:08:ae", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2816d3a6-e5", "ovs_interfaceid": "2816d3a6-e5d7-4189-859b-bd12707eda1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 07:24:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-8e70520a-980e-47e5-9c47-ce9ee6433066 req-1d541776-b3de-4178-8b57-df0458fc3a45 service nova] Acquired lock "refresh_cache-1a7c8b14-533d-4913-8d60-4818c3801e54" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:24:17 user nova-compute[72809]: DEBUG nova.network.neutron [req-8e70520a-980e-47e5-9c47-ce9ee6433066 req-1d541776-b3de-4178-8b57-df0458fc3a45 service nova] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Refreshing network info cache for port 2816d3a6-e5d7-4189-859b-bd12707eda1c {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:24:18 user nova-compute[72809]: DEBUG nova.network.neutron [req-8e70520a-980e-47e5-9c47-ce9ee6433066 req-1d541776-b3de-4178-8b57-df0458fc3a45 service nova] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Updated VIF entry in instance network info cache for port 2816d3a6-e5d7-4189-859b-bd12707eda1c. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:24:18 user nova-compute[72809]: DEBUG nova.network.neutron [req-8e70520a-980e-47e5-9c47-ce9ee6433066 req-1d541776-b3de-4178-8b57-df0458fc3a45 service nova] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Updating instance_info_cache with network_info: [{"id": "2816d3a6-e5d7-4189-859b-bd12707eda1c", "address": "fa:16:3e:44:08:ae", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2816d3a6-e5", "ovs_interfaceid": "2816d3a6-e5d7-4189-859b-bd12707eda1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:24:18 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-8e70520a-980e-47e5-9c47-ce9ee6433066 req-1d541776-b3de-4178-8b57-df0458fc3a45 service nova] Releasing lock "refresh_cache-1a7c8b14-533d-4913-8d60-4818c3801e54" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:24:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:21 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:21 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:24:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:24:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:24:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:24:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:24:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:24:21 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:24:21 user nova-compute[72809]: DEBUG nova.virt.libvirt.imagecache [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Verify base images {{(pid=72809) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 09 07:24:21 user nova-compute[72809]: DEBUG nova.virt.libvirt.imagecache [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72809) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 09 07:24:21 user nova-compute[72809]: WARNING nova.virt.libvirt.imagecache [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Unknown base file: /opt/stack/data/nova/instances/_base/fa3e19b4bdca7c6a929199d624f3d57192bee977
Aug 09 07:24:21 user nova-compute[72809]: WARNING nova.virt.libvirt.imagecache [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Unknown base file: /opt/stack/data/nova/instances/_base/588ee97cfd082e8ce7584708f4df30d0a75a1d24
Aug 09 07:24:21 user nova-compute[72809]: WARNING nova.virt.libvirt.imagecache [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Unknown base file: /opt/stack/data/nova/instances/_base/fadcfaf2c192d53c17bb1bd4747d9b3596dbc190
Aug 09 07:24:21 user nova-compute[72809]: WARNING nova.virt.libvirt.imagecache [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Unknown base file: /opt/stack/data/nova/instances/_base/8ca6a1259042b6dfc58a4abad7a2714ae1f1040e
Aug 09 07:24:21 user nova-compute[72809]: WARNING nova.virt.libvirt.imagecache [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Unknown base file: /opt/stack/data/nova/instances/_base/db9e63e4eae382163c3ce930f6feb77b3089dfa0
Aug 09 07:24:21 user nova-compute[72809]: WARNING nova.virt.libvirt.imagecache [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Unknown base file: /opt/stack/data/nova/instances/_base/1cf4d3cb6079987eb7a29e77c813afd5eb8d35d6
Aug 09 07:24:21 user nova-compute[72809]: WARNING nova.virt.libvirt.imagecache [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Unknown base file: /opt/stack/data/nova/instances/_base/73aa1c7bb0fc365f15a82b0c664ce2eb624e8b8c
Aug 09 07:24:21 user nova-compute[72809]: WARNING nova.virt.libvirt.imagecache [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Unknown base file: /opt/stack/data/nova/instances/_base/105db938e88836852bb67e943a14dce3d494b314
Aug 09 07:24:21 user nova-compute[72809]: WARNING nova.virt.libvirt.imagecache [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Unknown base file: /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8
Aug 09 07:24:21 user nova-compute[72809]: WARNING nova.virt.libvirt.imagecache [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Unknown base file: /opt/stack/data/nova/instances/_base/fbe71dc42b190e0bfbeee567610c2f82cf91e045
Aug 09 07:24:21 user nova-compute[72809]: INFO nova.virt.libvirt.imagecache [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Removable base files: /opt/stack/data/nova/instances/_base/fa3e19b4bdca7c6a929199d624f3d57192bee977 /opt/stack/data/nova/instances/_base/588ee97cfd082e8ce7584708f4df30d0a75a1d24 /opt/stack/data/nova/instances/_base/fadcfaf2c192d53c17bb1bd4747d9b3596dbc190 /opt/stack/data/nova/instances/_base/8ca6a1259042b6dfc58a4abad7a2714ae1f1040e /opt/stack/data/nova/instances/_base/db9e63e4eae382163c3ce930f6feb77b3089dfa0 /opt/stack/data/nova/instances/_base/1cf4d3cb6079987eb7a29e77c813afd5eb8d35d6 /opt/stack/data/nova/instances/_base/73aa1c7bb0fc365f15a82b0c664ce2eb624e8b8c /opt/stack/data/nova/instances/_base/105db938e88836852bb67e943a14dce3d494b314 /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 /opt/stack/data/nova/instances/_base/fbe71dc42b190e0bfbeee567610c2f82cf91e045
Aug 09 07:24:21 user nova-compute[72809]: INFO nova.virt.libvirt.imagecache [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fa3e19b4bdca7c6a929199d624f3d57192bee977
Aug 09 07:24:21 user nova-compute[72809]: INFO nova.virt.libvirt.imagecache [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/588ee97cfd082e8ce7584708f4df30d0a75a1d24
Aug 09 07:24:21 user nova-compute[72809]: INFO nova.virt.libvirt.imagecache [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fadcfaf2c192d53c17bb1bd4747d9b3596dbc190
Aug 09 07:24:21 user nova-compute[72809]: INFO nova.virt.libvirt.imagecache [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8ca6a1259042b6dfc58a4abad7a2714ae1f1040e
Aug 09 07:24:21 user nova-compute[72809]: INFO nova.virt.libvirt.imagecache [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/db9e63e4eae382163c3ce930f6feb77b3089dfa0
Aug 09 07:24:21 user nova-compute[72809]: INFO nova.virt.libvirt.imagecache [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1cf4d3cb6079987eb7a29e77c813afd5eb8d35d6
Aug 09 07:24:21 user nova-compute[72809]: INFO nova.virt.libvirt.imagecache [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/73aa1c7bb0fc365f15a82b0c664ce2eb624e8b8c
Aug 09 07:24:21 user nova-compute[72809]: INFO nova.virt.libvirt.imagecache [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/105db938e88836852bb67e943a14dce3d494b314
Aug 09 07:24:21 user nova-compute[72809]: INFO nova.virt.libvirt.imagecache [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8
Aug 09 07:24:21 user nova-compute[72809]: INFO nova.virt.libvirt.imagecache [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fbe71dc42b190e0bfbeee567610c2f82cf91e045
Aug 09 07:24:21 user nova-compute[72809]: DEBUG nova.virt.libvirt.imagecache [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Verification complete {{(pid=72809) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 09 07:24:21 user nova-compute[72809]: DEBUG nova.virt.libvirt.imagecache [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Verify swap images {{(pid=72809) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 09 07:24:21 user nova-compute[72809]: DEBUG nova.virt.libvirt.imagecache [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Verify ephemeral images {{(pid=72809) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 09 07:24:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Acquiring lock "748b208f-1bb7-46b2-b914-9f6bdd1f80af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:24:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lock "748b208f-1bb7-46b2-b914-9f6bdd1f80af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:24:22 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 07:24:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:24:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:24:22 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 07:24:22 user nova-compute[72809]: INFO nova.compute.claims [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Claim successful on node user
Aug 09 07:24:22 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:24:22 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:24:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.218s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:24:22 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 07:24:22 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 07:24:22 user nova-compute[72809]: DEBUG nova.network.neutron [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 07:24:22 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 07:24:22 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 07:24:22 user nova-compute[72809]: DEBUG nova.policy [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2abed58a5e194074be138badc890880b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fbcffb883548f9a357ace3c4ba93fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 07:24:22 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 07:24:22 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 07:24:22 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Creating image(s)
Aug 09 07:24:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Acquiring lock "/opt/stack/data/nova/instances/748b208f-1bb7-46b2-b914-9f6bdd1f80af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:24:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lock "/opt/stack/data/nova/instances/748b208f-1bb7-46b2-b914-9f6bdd1f80af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:24:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lock "/opt/stack/data/nova/instances/748b208f-1bb7-46b2-b914-9f6bdd1f80af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:24:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:24:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.148s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:24:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Acquiring lock "5078a69ef6d585d7c781894529b3e50ca36128b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:24:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:24:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:24:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.147s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:24:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/748b208f-1bb7-46b2-b914-9f6bdd1f80af/disk 1073741824 {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:24:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8,backing_fmt=raw /opt/stack/data/nova/instances/748b208f-1bb7-46b2-b914-9f6bdd1f80af/disk 1073741824" returned: 0 in 0.055s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:24:22 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lock "5078a69ef6d585d7c781894529b3e50ca36128b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:24:22 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG nova.network.neutron [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Successfully created port: b4ff2651-84b6-43c3-8575-d144a6ff524e {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5078a69ef6d585d7c781894529b3e50ca36128b8 --force-share --output=json" returned: 0 in 0.133s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Checking if we can resize image /opt/stack/data/nova/instances/748b208f-1bb7-46b2-b914-9f6bdd1f80af/disk. size=1073741824 {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748b208f-1bb7-46b2-b914-9f6bdd1f80af/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748b208f-1bb7-46b2-b914-9f6bdd1f80af/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG nova.virt.disk.api [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Cannot resize image /opt/stack/data/nova/instances/748b208f-1bb7-46b2-b914-9f6bdd1f80af/disk to a smaller size. {{(pid=72809) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG nova.objects.instance [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lazy-loading 'migration_context' on Instance uuid 748b208f-1bb7-46b2-b914-9f6bdd1f80af {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Created local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Ensure instance console log exists: /opt/stack/data/nova/instances/748b208f-1bb7-46b2-b914-9f6bdd1f80af/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG nova.compute.manager [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 07:24:23 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Creating image(s)
Aug 09 07:24:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Did not create local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Ensure instance console log exists: /opt/stack/data/nova/instances/1a7c8b14-533d-4913-8d60-4818c3801e54/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Start _get_guest_xml network_info=[{"id": "2816d3a6-e5d7-4189-859b-bd12707eda1c", "address": "fa:16:3e:44:08:ae", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2816d3a6-e5", "ovs_interfaceid": "2816d3a6-e5d7-4189-859b-bd12707eda1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewTXjsCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1a7c8b14-533d-4913-8d60-4818c3801e54', 'attached_at': '', 'detached_at': '', 'volume_id': 'e4daa5fd-e98f-45cb-a865-913dcce3e753', 'serial': 'e4daa5fd-e98f-45cb-a865-913dcce3e753'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': 0, 'attachment_id': '516cf51d-49ea-458e-9d5c-a611806b08d5', 'volume_type': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 07:24:23 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:24:23 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:24:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewTXjsCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:24:23 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:24:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:24:23 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:24:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:24:23 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[106be705-8525-43c7-94e2-e53bd9c4fd05]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 07:24:23 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca3ae7b-c9a8-4f2d-9ae4-a866fc1e369e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753] added
Aug 09 07:24:23 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4581874-6427-48d1-b20f-dc32c933c594]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[394dfdd3-fe34-485d-ad6a-37c35529a052]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ewTXjsCP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG nova.network.neutron [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Successfully updated port: b4ff2651-84b6-43c3-8575-d144a6ff524e {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ewTXjsCP" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd27a39-424c-451d-9dc8-34839754c19f]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ewTXjsCP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Acquiring lock "refresh_cache-748b208f-1bb7-46b2-b914-9f6bdd1f80af" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Acquired lock "refresh_cache-748b208f-1bb7-46b2-b914-9f6bdd1f80af" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG nova.network.neutron [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG nova.compute.manager [req-55927113-12c0-428b-ac8f-f5ccdec7265f req-56a5f719-2603-4caa-95f0-582645c4e680 service nova] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Received event network-changed-b4ff2651-84b6-43c3-8575-d144a6ff524e {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG nova.compute.manager [req-55927113-12c0-428b-ac8f-f5ccdec7265f req-56a5f719-2603-4caa-95f0-582645c4e680 service nova] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Refreshing instance network info cache due to event network-changed-b4ff2651-84b6-43c3-8575-d144a6ff524e. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-55927113-12c0-428b-ac8f-f5ccdec7265f req-56a5f719-2603-4caa-95f0-582645c4e680 service nova] Acquiring lock "refresh_cache-748b208f-1bb7-46b2-b914-9f6bdd1f80af" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0e9558-8c1a-4e20-b9fd-318427a3522d]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee340e06-b538-4b91-9dd2-957df520627f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 07:24:23 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 07:24:23 user nova-compute[72809]:  {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:24:23 user nova-compute[72809]: WARNING os_brick.initiator.connectors.iscsi [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 07:24:23 user nova-compute[72809]: 
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG nova.network.neutron [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7926111-2021-40f0-aa3b-aade3890a1e4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753, portal: 172.16.0.220,3260]
Aug 09 07:24:23 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753, portal: 172.16.0.220,3260] successful.
Aug 09 07:24:23 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d5e7b8-8d6c-4a98-ae9f-d302b32740c9]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a758e4-8f72-433b-a106-e98ea77387a4]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 (non-flash)
Aug 09 07:24:23 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 (non-flash)
Aug 09 07:24:23 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 07:24:23 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31c9703-68fe-4b51-98c4-7d655e72bcc1]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewTXjsCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG nova.network.neutron [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Updating instance_info_cache with network_info: [{"id": "b4ff2651-84b6-43c3-8575-d144a6ff524e", "address": "fa:16:3e:e1:81:c7", "network": {"id": "dae64e44-3d73-4cd2-8361-f98f60e96d0d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1582898053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fbcffb883548f9a357ace3c4ba93fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ff2651-84", "ovs_interfaceid": "b4ff2651-84b6-43c3-8575-d144a6ff524e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Releasing lock "refresh_cache-748b208f-1bb7-46b2-b914-9f6bdd1f80af" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Instance network_info: |[{"id": "b4ff2651-84b6-43c3-8575-d144a6ff524e", "address": "fa:16:3e:e1:81:c7", "network": {"id": "dae64e44-3d73-4cd2-8361-f98f60e96d0d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1582898053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fbcffb883548f9a357ace3c4ba93fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ff2651-84", "ovs_interfaceid": "b4ff2651-84b6-43c3-8575-d144a6ff524e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-55927113-12c0-428b-ac8f-f5ccdec7265f req-56a5f719-2603-4caa-95f0-582645c4e680 service nova] Acquired lock "refresh_cache-748b208f-1bb7-46b2-b914-9f6bdd1f80af" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG nova.network.neutron [req-55927113-12c0-428b-ac8f-f5ccdec7265f req-56a5f719-2603-4caa-95f0-582645c4e680 service nova] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Refreshing network info cache for port b4ff2651-84b6-43c3-8575-d144a6ff524e {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Start _get_guest_xml network_info=[{"id": "b4ff2651-84b6-43c3-8575-d144a6ff524e", "address": "fa:16:3e:e1:81:c7", "network": {"id": "dae64e44-3d73-4cd2-8361-f98f60e96d0d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1582898053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fbcffb883548f9a357ace3c4ba93fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ff2651-84", "ovs_interfaceid": "b4ff2651-84b6-43c3-8575-d144a6ff524e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ba0d3e02-2e8a-403f-97cd-a9787534aa58'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 07:24:24 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:24:24 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:24:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T06:44:50Z,direct_url=<?>,disk_format='qcow2',id=ba0d3e02-2e8a-403f-97cd-a9787534aa58,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1295da1a81a44fec9e3e3e20732a553c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T06:44:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1048622649',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1048622649',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1048622',id=49,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIK+35O4mXG7vXom5JwS0dsBYVn/W/4zZ+/VxkAxGKWHyZhBxmW2LCToquM9ga9b/Im7WcL09yDC3xA+eay8vkuf9SmHULZIIgwbEbZgN27+crS8N2wVAXwEaZi+iMK68A==',key_name='tempest-keypair-1911419323',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56fbcffb883548f9a357ace3c4ba93fe',ramdisk_id='',reservation_id='r-32roandp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1105544373',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:24:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2abed58a5e194074be138badc890880b',uuid=748b208f-1bb7-46b2-b914-9f6bdd1f80af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4ff2651-84b6-43c3-8575-d144a6ff524e", "address": "fa:16:3e:e1:81:c7", "network": {"id": "dae64e44-3d73-4cd2-8361-f98f60e96d0d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1582898053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fbcffb883548f9a357ace3c4ba93fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ff2651-84", "ovs_interfaceid": "b4ff2651-84b6-43c3-8575-d144a6ff524e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Converting VIF {"id": "b4ff2651-84b6-43c3-8575-d144a6ff524e", "address": "fa:16:3e:e1:81:c7", "network": {"id": "dae64e44-3d73-4cd2-8361-f98f60e96d0d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1582898053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fbcffb883548f9a357ace3c4ba93fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ff2651-84", "ovs_interfaceid": "b4ff2651-84b6-43c3-8575-d144a6ff524e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:81:c7,bridge_name='br-int',has_traffic_filtering=True,id=b4ff2651-84b6-43c3-8575-d144a6ff524e,network=Network(dae64e44-3d73-4cd2-8361-f98f60e96d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4ff2651-84') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG nova.objects.instance [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lazy-loading 'pci_devices' on Instance uuid 748b208f-1bb7-46b2-b914-9f6bdd1f80af {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] End _get_guest_xml xml=<domain type="kvm">
Aug 09 07:24:24 user nova-compute[72809]:   <uuid>748b208f-1bb7-46b2-b914-9f6bdd1f80af</uuid>
Aug 09 07:24:24 user nova-compute[72809]:   <name>instance-00000031</name>
Aug 09 07:24:24 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 07:24:24 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 07:24:24 user nova-compute[72809]:   <metadata>
Aug 09 07:24:24 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 07:24:24 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 07:24:24 user nova-compute[72809]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1048622649</nova:name>
Aug 09 07:24:24 user nova-compute[72809]:       <nova:creationTime>2023-08-09 07:24:24</nova:creationTime>
Aug 09 07:24:24 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 07:24:24 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 07:24:24 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 07:24:24 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 07:24:24 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 07:24:24 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 07:24:24 user nova-compute[72809]:       </nova:flavor>
Aug 09 07:24:24 user nova-compute[72809]:       <nova:owner>
Aug 09 07:24:24 user nova-compute[72809]:         <nova:user uuid="2abed58a5e194074be138badc890880b">tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member</nova:user>
Aug 09 07:24:24 user nova-compute[72809]:         <nova:project uuid="56fbcffb883548f9a357ace3c4ba93fe">tempest-TestServerVolumeAttachScenarioOldVersion-1105544373</nova:project>
Aug 09 07:24:24 user nova-compute[72809]:       </nova:owner>
Aug 09 07:24:24 user nova-compute[72809]:       <nova:root type="image" uuid="ba0d3e02-2e8a-403f-97cd-a9787534aa58"/>
Aug 09 07:24:24 user nova-compute[72809]:       <nova:ports>
Aug 09 07:24:24 user nova-compute[72809]:         <nova:port uuid="b4ff2651-84b6-43c3-8575-d144a6ff524e">
Aug 09 07:24:24 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 07:24:24 user nova-compute[72809]:         </nova:port>
Aug 09 07:24:24 user nova-compute[72809]:       </nova:ports>
Aug 09 07:24:24 user nova-compute[72809]:     </nova:instance>
Aug 09 07:24:24 user nova-compute[72809]:   </metadata>
Aug 09 07:24:24 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 07:24:24 user nova-compute[72809]:     <system>
Aug 09 07:24:24 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 07:24:24 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 07:24:24 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 07:24:24 user nova-compute[72809]:       <entry name="serial">748b208f-1bb7-46b2-b914-9f6bdd1f80af</entry>
Aug 09 07:24:24 user nova-compute[72809]:       <entry name="uuid">748b208f-1bb7-46b2-b914-9f6bdd1f80af</entry>
Aug 09 07:24:24 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 07:24:24 user nova-compute[72809]:     </system>
Aug 09 07:24:24 user nova-compute[72809]:   </sysinfo>
Aug 09 07:24:24 user nova-compute[72809]:   <os>
Aug 09 07:24:24 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 07:24:24 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 07:24:24 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 07:24:24 user nova-compute[72809]:   </os>
Aug 09 07:24:24 user nova-compute[72809]:   <features>
Aug 09 07:24:24 user nova-compute[72809]:     <acpi/>
Aug 09 07:24:24 user nova-compute[72809]:     <apic/>
Aug 09 07:24:24 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 07:24:24 user nova-compute[72809]:   </features>
Aug 09 07:24:24 user nova-compute[72809]:   <clock offset="utc">
Aug 09 07:24:24 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 07:24:24 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 07:24:24 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 07:24:24 user nova-compute[72809]:   </clock>
Aug 09 07:24:24 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 07:24:24 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 07:24:24 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 07:24:24 user nova-compute[72809]:   </cpu>
Aug 09 07:24:24 user nova-compute[72809]:   <devices>
Aug 09 07:24:24 user nova-compute[72809]:     <disk type="file" device="disk">
Aug 09 07:24:24 user nova-compute[72809]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 07:24:24 user nova-compute[72809]:       <source file="/opt/stack/data/nova/instances/748b208f-1bb7-46b2-b914-9f6bdd1f80af/disk"/>
Aug 09 07:24:24 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 07:24:24 user nova-compute[72809]:     </disk>
Aug 09 07:24:24 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 07:24:24 user nova-compute[72809]:       <mac address="fa:16:3e:e1:81:c7"/>
Aug 09 07:24:24 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:24:24 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 07:24:24 user nova-compute[72809]:       <target dev="tapb4ff2651-84"/>
Aug 09 07:24:24 user nova-compute[72809]:     </interface>
Aug 09 07:24:24 user nova-compute[72809]:     <serial type="pty">
Aug 09 07:24:24 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/748b208f-1bb7-46b2-b914-9f6bdd1f80af/console.log" append="off"/>
Aug 09 07:24:24 user nova-compute[72809]:     </serial>
Aug 09 07:24:24 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 07:24:24 user nova-compute[72809]:     <video>
Aug 09 07:24:24 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:24:24 user nova-compute[72809]:     </video>
Aug 09 07:24:24 user nova-compute[72809]:     <rng model="virtio">
Aug 09 07:24:24 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 07:24:24 user nova-compute[72809]:     </rng>
Aug 09 07:24:24 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 07:24:24 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 07:24:24 user nova-compute[72809]:       <stats period="10"/>
Aug 09 07:24:24 user nova-compute[72809]:     </memballoon>
Aug 09 07:24:24 user nova-compute[72809]:   </devices>
Aug 09 07:24:24 user nova-compute[72809]: </domain>
Aug 09 07:24:24 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1048622649',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1048622649',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1048622',id=49,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIK+35O4mXG7vXom5JwS0dsBYVn/W/4zZ+/VxkAxGKWHyZhBxmW2LCToquM9ga9b/Im7WcL09yDC3xA+eay8vkuf9SmHULZIIgwbEbZgN27+crS8N2wVAXwEaZi+iMK68A==',key_name='tempest-keypair-1911419323',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56fbcffb883548f9a357ace3c4ba93fe',ramdisk_id='',reservation_id='r-32roandp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1105544373',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:24:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2abed58a5e194074be138badc890880b',uuid=748b208f-1bb7-46b2-b914-9f6bdd1f80af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4ff2651-84b6-43c3-8575-d144a6ff524e", "address": "fa:16:3e:e1:81:c7", "network": {"id": "dae64e44-3d73-4cd2-8361-f98f60e96d0d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1582898053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fbcffb883548f9a357ace3c4ba93fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ff2651-84", "ovs_interfaceid": "b4ff2651-84b6-43c3-8575-d144a6ff524e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Converting VIF {"id": "b4ff2651-84b6-43c3-8575-d144a6ff524e", "address": "fa:16:3e:e1:81:c7", "network": {"id": "dae64e44-3d73-4cd2-8361-f98f60e96d0d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1582898053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fbcffb883548f9a357ace3c4ba93fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ff2651-84", "ovs_interfaceid": "b4ff2651-84b6-43c3-8575-d144a6ff524e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:81:c7,bridge_name='br-int',has_traffic_filtering=True,id=b4ff2651-84b6-43c3-8575-d144a6ff524e,network=Network(dae64e44-3d73-4cd2-8361-f98f60e96d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4ff2651-84') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG os_vif [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:81:c7,bridge_name='br-int',has_traffic_filtering=True,id=b4ff2651-84b6-43c3-8575-d144a6ff524e,network=Network(dae64e44-3d73-4cd2-8361-f98f60e96d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4ff2651-84') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4ff2651-84, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb4ff2651-84, col_values=(('external_ids', {'iface-id': 'b4ff2651-84b6-43c3-8575-d144a6ff524e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:81:c7', 'vm-uuid': '748b208f-1bb7-46b2-b914-9f6bdd1f80af'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:24 user nova-compute[72809]: INFO os_vif [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:81:c7,bridge_name='br-int',has_traffic_filtering=True,id=b4ff2651-84b6-43c3-8575-d144a6ff524e,network=Network(dae64e44-3d73-4cd2-8361-f98f60e96d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4ff2651-84')
Aug 09 07:24:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] No VIF found with MAC fa:16:3e:e1:81:c7, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG nova.network.neutron [req-55927113-12c0-428b-ac8f-f5ccdec7265f req-56a5f719-2603-4caa-95f0-582645c4e680 service nova] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Updated VIF entry in instance network info cache for port b4ff2651-84b6-43c3-8575-d144a6ff524e. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG nova.network.neutron [req-55927113-12c0-428b-ac8f-f5ccdec7265f req-56a5f719-2603-4caa-95f0-582645c4e680 service nova] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Updating instance_info_cache with network_info: [{"id": "b4ff2651-84b6-43c3-8575-d144a6ff524e", "address": "fa:16:3e:e1:81:c7", "network": {"id": "dae64e44-3d73-4cd2-8361-f98f60e96d0d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1582898053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fbcffb883548f9a357ace3c4ba93fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ff2651-84", "ovs_interfaceid": "b4ff2651-84b6-43c3-8575-d144a6ff524e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:24:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-55927113-12c0-428b-ac8f-f5ccdec7265f req-56a5f719-2603-4caa-95f0-582645c4e680 service nova] Releasing lock "refresh_cache-748b208f-1bb7-46b2-b914-9f6bdd1f80af" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:24:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:24:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23236303065626339', 'path': '/dev/sdb'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:24:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236303065626339', 'path': '/dev/sdb'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 07:24:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:24:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1242885598',display_name='tempest-TestVolumeBootPattern-server-1242885598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1242885598',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjnvBkBtyKj+KLLI54SBkh5HnXtHKYGIvHET6AohUoc067yu29rFAuYqAakYT1y07YcSfZK33sZkxNs57WMr0x24BQA2oeNeplu2EJ8SgGH8Bvo7ooGDsRYmmPpPFSHcQ==',key_name='tempest-TestVolumeBootPattern-1169256863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cdcd8241b9b47eab16a6e37a9cc5f54',ramdisk_id='',reservation_id='r-ltgta87e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-224847517',owner_user_name='tempest-TestVolumeBootPattern-224847517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:24:15Z,user_data=None,user_id='a7859a38408b426eb9a14ef003483bd3',uuid=1a7c8b14-533d-4913-8d60-4818c3801e54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2816d3a6-e5d7-4189-859b-bd12707eda1c", "address": "fa:16:3e:44:08:ae", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2816d3a6-e5", "ovs_interfaceid": "2816d3a6-e5d7-4189-859b-bd12707eda1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 07:24:25 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converting VIF {"id": "2816d3a6-e5d7-4189-859b-bd12707eda1c", "address": "fa:16:3e:44:08:ae", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2816d3a6-e5", "ovs_interfaceid": "2816d3a6-e5d7-4189-859b-bd12707eda1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:24:25 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:08:ae,bridge_name='br-int',has_traffic_filtering=True,id=2816d3a6-e5d7-4189-859b-bd12707eda1c,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2816d3a6-e5') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:24:25 user nova-compute[72809]: DEBUG nova.objects.instance [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a7c8b14-533d-4913-8d60-4818c3801e54 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:24:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] End _get_guest_xml xml=<domain type="kvm">
Aug 09 07:24:25 user nova-compute[72809]:   <uuid>1a7c8b14-533d-4913-8d60-4818c3801e54</uuid>
Aug 09 07:24:25 user nova-compute[72809]:   <name>instance-00000030</name>
Aug 09 07:24:25 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 07:24:25 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 07:24:25 user nova-compute[72809]:   <metadata>
Aug 09 07:24:25 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 07:24:25 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 07:24:25 user nova-compute[72809]:       <nova:name>tempest-TestVolumeBootPattern-server-1242885598</nova:name>
Aug 09 07:24:25 user nova-compute[72809]:       <nova:creationTime>2023-08-09 07:24:23</nova:creationTime>
Aug 09 07:24:25 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 07:24:25 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 07:24:25 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 07:24:25 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 07:24:25 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 07:24:25 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 07:24:25 user nova-compute[72809]:       </nova:flavor>
Aug 09 07:24:25 user nova-compute[72809]:       <nova:owner>
Aug 09 07:24:25 user nova-compute[72809]:         <nova:user uuid="a7859a38408b426eb9a14ef003483bd3">tempest-TestVolumeBootPattern-224847517-project-member</nova:user>
Aug 09 07:24:25 user nova-compute[72809]:         <nova:project uuid="8cdcd8241b9b47eab16a6e37a9cc5f54">tempest-TestVolumeBootPattern-224847517</nova:project>
Aug 09 07:24:25 user nova-compute[72809]:       </nova:owner>
Aug 09 07:24:25 user nova-compute[72809]:       <nova:ports>
Aug 09 07:24:25 user nova-compute[72809]:         <nova:port uuid="2816d3a6-e5d7-4189-859b-bd12707eda1c">
Aug 09 07:24:25 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 07:24:25 user nova-compute[72809]:         </nova:port>
Aug 09 07:24:25 user nova-compute[72809]:       </nova:ports>
Aug 09 07:24:25 user nova-compute[72809]:     </nova:instance>
Aug 09 07:24:25 user nova-compute[72809]:   </metadata>
Aug 09 07:24:25 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 07:24:25 user nova-compute[72809]:     <system>
Aug 09 07:24:25 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 07:24:25 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 07:24:25 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 07:24:25 user nova-compute[72809]:       <entry name="serial">1a7c8b14-533d-4913-8d60-4818c3801e54</entry>
Aug 09 07:24:25 user nova-compute[72809]:       <entry name="uuid">1a7c8b14-533d-4913-8d60-4818c3801e54</entry>
Aug 09 07:24:25 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 07:24:25 user nova-compute[72809]:     </system>
Aug 09 07:24:25 user nova-compute[72809]:   </sysinfo>
Aug 09 07:24:25 user nova-compute[72809]:   <os>
Aug 09 07:24:25 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 07:24:25 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 07:24:25 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 07:24:25 user nova-compute[72809]:   </os>
Aug 09 07:24:25 user nova-compute[72809]:   <features>
Aug 09 07:24:25 user nova-compute[72809]:     <acpi/>
Aug 09 07:24:25 user nova-compute[72809]:     <apic/>
Aug 09 07:24:25 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 07:24:25 user nova-compute[72809]:   </features>
Aug 09 07:24:25 user nova-compute[72809]:   <clock offset="utc">
Aug 09 07:24:25 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 07:24:25 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 07:24:25 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 07:24:25 user nova-compute[72809]:   </clock>
Aug 09 07:24:25 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 07:24:25 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 07:24:25 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 07:24:25 user nova-compute[72809]:   </cpu>
Aug 09 07:24:25 user nova-compute[72809]:   <devices>
Aug 09 07:24:25 user nova-compute[72809]:     <disk type="block" device="disk">
Aug 09 07:24:25 user nova-compute[72809]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:24:25 user nova-compute[72809]:       <source dev="/dev/sdb"/>
Aug 09 07:24:25 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 07:24:25 user nova-compute[72809]:       <serial>e4daa5fd-e98f-45cb-a865-913dcce3e753</serial>
Aug 09 07:24:25 user nova-compute[72809]:     </disk>
Aug 09 07:24:25 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 07:24:25 user nova-compute[72809]:       <mac address="fa:16:3e:44:08:ae"/>
Aug 09 07:24:25 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:24:25 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 07:24:25 user nova-compute[72809]:       <target dev="tap2816d3a6-e5"/>
Aug 09 07:24:25 user nova-compute[72809]:     </interface>
Aug 09 07:24:25 user nova-compute[72809]:     <serial type="pty">
Aug 09 07:24:25 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/1a7c8b14-533d-4913-8d60-4818c3801e54/console.log" append="off"/>
Aug 09 07:24:25 user nova-compute[72809]:     </serial>
Aug 09 07:24:25 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 07:24:25 user nova-compute[72809]:     <video>
Aug 09 07:24:25 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:24:25 user nova-compute[72809]:     </video>
Aug 09 07:24:25 user nova-compute[72809]:     <rng model="virtio">
Aug 09 07:24:25 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 07:24:25 user nova-compute[72809]:     </rng>
Aug 09 07:24:25 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 07:24:25 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 07:24:25 user nova-compute[72809]:       <stats period="10"/>
Aug 09 07:24:25 user nova-compute[72809]:     </memballoon>
Aug 09 07:24:25 user nova-compute[72809]:   </devices>
Aug 09 07:24:25 user nova-compute[72809]: </domain>
Aug 09 07:24:25 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 07:24:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:24:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1242885598',display_name='tempest-TestVolumeBootPattern-server-1242885598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1242885598',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjnvBkBtyKj+KLLI54SBkh5HnXtHKYGIvHET6AohUoc067yu29rFAuYqAakYT1y07YcSfZK33sZkxNs57WMr0x24BQA2oeNeplu2EJ8SgGH8Bvo7ooGDsRYmmPpPFSHcQ==',key_name='tempest-TestVolumeBootPattern-1169256863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cdcd8241b9b47eab16a6e37a9cc5f54',ramdisk_id='',reservation_id='r-ltgta87e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-224847517',owner_user_name='tempest-TestVolumeBootPattern-224847517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:24:15Z,user_data=None,user_id='a7859a38408b426eb9a14ef003483bd3',uuid=1a7c8b14-533d-4913-8d60-4818c3801e54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2816d3a6-e5d7-4189-859b-bd12707eda1c", "address": "fa:16:3e:44:08:ae", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2816d3a6-e5", "ovs_interfaceid": "2816d3a6-e5d7-4189-859b-bd12707eda1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 07:24:25 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converting VIF {"id": "2816d3a6-e5d7-4189-859b-bd12707eda1c", "address": "fa:16:3e:44:08:ae", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2816d3a6-e5", "ovs_interfaceid": "2816d3a6-e5d7-4189-859b-bd12707eda1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:24:25 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:08:ae,bridge_name='br-int',has_traffic_filtering=True,id=2816d3a6-e5d7-4189-859b-bd12707eda1c,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2816d3a6-e5') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:24:25 user nova-compute[72809]: DEBUG os_vif [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:08:ae,bridge_name='br-int',has_traffic_filtering=True,id=2816d3a6-e5d7-4189-859b-bd12707eda1c,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2816d3a6-e5') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 07:24:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:24:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 07:24:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2816d3a6-e5, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:24:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2816d3a6-e5, col_values=(('external_ids', {'iface-id': '2816d3a6-e5d7-4189-859b-bd12707eda1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:08:ae', 'vm-uuid': '1a7c8b14-533d-4913-8d60-4818c3801e54'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:24:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:24:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:25 user nova-compute[72809]: INFO os_vif [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:08:ae,bridge_name='br-int',has_traffic_filtering=True,id=2816d3a6-e5d7-4189-859b-bd12707eda1c,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2816d3a6-e5')
Aug 09 07:24:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:24:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] No VIF found with MAC fa:16:3e:44:08:ae, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:24:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:26 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:26 user nova-compute[72809]: DEBUG nova.compute.manager [req-da673cd2-ba17-43dc-90de-5043a539a788 req-ca1589d0-8f46-4242-8b0a-9b953fa3194d service nova] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Received event network-vif-plugged-b4ff2651-84b6-43c3-8575-d144a6ff524e {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:24:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-da673cd2-ba17-43dc-90de-5043a539a788 req-ca1589d0-8f46-4242-8b0a-9b953fa3194d service nova] Acquiring lock "748b208f-1bb7-46b2-b914-9f6bdd1f80af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:24:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-da673cd2-ba17-43dc-90de-5043a539a788 req-ca1589d0-8f46-4242-8b0a-9b953fa3194d service nova] Lock "748b208f-1bb7-46b2-b914-9f6bdd1f80af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:24:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-da673cd2-ba17-43dc-90de-5043a539a788 req-ca1589d0-8f46-4242-8b0a-9b953fa3194d service nova] Lock "748b208f-1bb7-46b2-b914-9f6bdd1f80af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:24:26 user nova-compute[72809]: DEBUG nova.compute.manager [req-da673cd2-ba17-43dc-90de-5043a539a788 req-ca1589d0-8f46-4242-8b0a-9b953fa3194d service nova] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] No waiting events found dispatching network-vif-plugged-b4ff2651-84b6-43c3-8575-d144a6ff524e {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:24:26 user nova-compute[72809]: WARNING nova.compute.manager [req-da673cd2-ba17-43dc-90de-5043a539a788 req-ca1589d0-8f46-4242-8b0a-9b953fa3194d service nova] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Received unexpected event network-vif-plugged-b4ff2651-84b6-43c3-8575-d144a6ff524e for instance with vm_state building and task_state spawning.
Aug 09 07:24:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:27 user nova-compute[72809]: DEBUG nova.compute.manager [req-562312dc-912d-4919-a83d-5eee7da794b7 req-91b96670-884d-41d3-9b04-90de42dd2439 service nova] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Received event network-vif-plugged-2816d3a6-e5d7-4189-859b-bd12707eda1c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:24:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-562312dc-912d-4919-a83d-5eee7da794b7 req-91b96670-884d-41d3-9b04-90de42dd2439 service nova] Acquiring lock "1a7c8b14-533d-4913-8d60-4818c3801e54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:24:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-562312dc-912d-4919-a83d-5eee7da794b7 req-91b96670-884d-41d3-9b04-90de42dd2439 service nova] Lock "1a7c8b14-533d-4913-8d60-4818c3801e54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:24:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-562312dc-912d-4919-a83d-5eee7da794b7 req-91b96670-884d-41d3-9b04-90de42dd2439 service nova] Lock "1a7c8b14-533d-4913-8d60-4818c3801e54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:24:27 user nova-compute[72809]: DEBUG nova.compute.manager [req-562312dc-912d-4919-a83d-5eee7da794b7 req-91b96670-884d-41d3-9b04-90de42dd2439 service nova] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] No waiting events found dispatching network-vif-plugged-2816d3a6-e5d7-4189-859b-bd12707eda1c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:24:27 user nova-compute[72809]: WARNING nova.compute.manager [req-562312dc-912d-4919-a83d-5eee7da794b7 req-91b96670-884d-41d3-9b04-90de42dd2439 service nova] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Received unexpected event network-vif-plugged-2816d3a6-e5d7-4189-859b-bd12707eda1c for instance with vm_state building and task_state spawning.
Aug 09 07:24:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:28 user nova-compute[72809]: DEBUG nova.compute.manager [req-9eb81f1c-9cef-48d0-a302-d41ba5938245 req-027e8904-fc9e-4d6b-9de4-f6b262b58a1b service nova] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Received event network-vif-plugged-b4ff2651-84b6-43c3-8575-d144a6ff524e {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:24:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9eb81f1c-9cef-48d0-a302-d41ba5938245 req-027e8904-fc9e-4d6b-9de4-f6b262b58a1b service nova] Acquiring lock "748b208f-1bb7-46b2-b914-9f6bdd1f80af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:24:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9eb81f1c-9cef-48d0-a302-d41ba5938245 req-027e8904-fc9e-4d6b-9de4-f6b262b58a1b service nova] Lock "748b208f-1bb7-46b2-b914-9f6bdd1f80af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:24:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-9eb81f1c-9cef-48d0-a302-d41ba5938245 req-027e8904-fc9e-4d6b-9de4-f6b262b58a1b service nova] Lock "748b208f-1bb7-46b2-b914-9f6bdd1f80af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:24:28 user nova-compute[72809]: DEBUG nova.compute.manager [req-9eb81f1c-9cef-48d0-a302-d41ba5938245 req-027e8904-fc9e-4d6b-9de4-f6b262b58a1b service nova] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] No waiting events found dispatching network-vif-plugged-b4ff2651-84b6-43c3-8575-d144a6ff524e {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:24:28 user nova-compute[72809]: WARNING nova.compute.manager [req-9eb81f1c-9cef-48d0-a302-d41ba5938245 req-027e8904-fc9e-4d6b-9de4-f6b262b58a1b service nova] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Received unexpected event network-vif-plugged-b4ff2651-84b6-43c3-8575-d144a6ff524e for instance with vm_state building and task_state spawning.
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691565869.159003, 748b208f-1bb7-46b2-b914-9f6bdd1f80af => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:24:29 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] VM Resumed (Lifecycle Event)
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 07:24:29 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Instance spawned successfully.
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:24:29 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691565869.1606843, 748b208f-1bb7-46b2-b914-9f6bdd1f80af => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:24:29 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] VM Started (Lifecycle Event)
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.compute.manager [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 07:24:29 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691565869.2430475, 1a7c8b14-533d-4913-8d60-4818c3801e54 => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:24:29 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] VM Resumed (Lifecycle Event)
Aug 09 07:24:29 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Instance spawned successfully.
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:24:29 user nova-compute[72809]: INFO nova.compute.manager [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Took 6.67 seconds to spawn the instance on the hypervisor.
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:24:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:29 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691565869.2445877, 1a7c8b14-533d-4913-8d60-4818c3801e54 => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:24:29 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] VM Started (Lifecycle Event)
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-6bd23bd0-8188-4099-a1aa-cdfab679668e req-b2f74baa-27bd-4fa2-a3d7-5d4990cb54a5 service nova] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Received event network-vif-plugged-2816d3a6-e5d7-4189-859b-bd12707eda1c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:24:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6bd23bd0-8188-4099-a1aa-cdfab679668e req-b2f74baa-27bd-4fa2-a3d7-5d4990cb54a5 service nova] Acquiring lock "1a7c8b14-533d-4913-8d60-4818c3801e54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:24:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6bd23bd0-8188-4099-a1aa-cdfab679668e req-b2f74baa-27bd-4fa2-a3d7-5d4990cb54a5 service nova] Lock "1a7c8b14-533d-4913-8d60-4818c3801e54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:24:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-6bd23bd0-8188-4099-a1aa-cdfab679668e req-b2f74baa-27bd-4fa2-a3d7-5d4990cb54a5 service nova] Lock "1a7c8b14-533d-4913-8d60-4818c3801e54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.compute.manager [req-6bd23bd0-8188-4099-a1aa-cdfab679668e req-b2f74baa-27bd-4fa2-a3d7-5d4990cb54a5 service nova] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] No waiting events found dispatching network-vif-plugged-2816d3a6-e5d7-4189-859b-bd12707eda1c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:24:29 user nova-compute[72809]: WARNING nova.compute.manager [req-6bd23bd0-8188-4099-a1aa-cdfab679668e req-b2f74baa-27bd-4fa2-a3d7-5d4990cb54a5 service nova] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Received unexpected event network-vif-plugged-2816d3a6-e5d7-4189-859b-bd12707eda1c for instance with vm_state building and task_state spawning.
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:24:29 user nova-compute[72809]: INFO nova.compute.manager [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Took 5.77 seconds to spawn the instance on the hypervisor.
Aug 09 07:24:29 user nova-compute[72809]: DEBUG nova.compute.manager [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:24:29 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:24:29 user nova-compute[72809]: INFO nova.compute.manager [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Took 7.26 seconds to build instance.
Aug 09 07:24:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-bdde596c-a04e-41fe-8288-deda934d4ad8 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lock "748b208f-1bb7-46b2-b914-9f6bdd1f80af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.360s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:24:29 user nova-compute[72809]: INFO nova.compute.manager [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Took 14.35 seconds to build instance.
Aug 09 07:24:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-cd501aa9-96f7-499c-b2c1-af1b897f1edc tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "1a7c8b14-533d-4913-8d60-4818c3801e54" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.448s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:24:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:34 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:35 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:40 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:50 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:51 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:24:52 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:24:52 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 07:24:52 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Rebuilding the list of instances to heal {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 07:24:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-1a7c8b14-533d-4913-8d60-4818c3801e54" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:24:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-1a7c8b14-533d-4913-8d60-4818c3801e54" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:24:52 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 07:24:52 user nova-compute[72809]: DEBUG nova.objects.instance [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lazy-loading 'info_cache' on Instance uuid 1a7c8b14-533d-4913-8d60-4818c3801e54 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:24:53 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Updating instance_info_cache with network_info: [{"id": "2816d3a6-e5d7-4189-859b-bd12707eda1c", "address": "fa:16:3e:44:08:ae", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2816d3a6-e5", "ovs_interfaceid": "2816d3a6-e5d7-4189-859b-bd12707eda1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:24:53 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-1a7c8b14-533d-4913-8d60-4818c3801e54" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:24:53 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 07:24:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:54 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:24:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:24:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:24:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:24:54 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 07:24:54 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748b208f-1bb7-46b2-b914-9f6bdd1f80af/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:24:54 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748b208f-1bb7-46b2-b914-9f6bdd1f80af/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:24:54 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748b208f-1bb7-46b2-b914-9f6bdd1f80af/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:24:55 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:24:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748b208f-1bb7-46b2-b914-9f6bdd1f80af/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:24:55 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:24:55 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:24:55 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:24:55 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=8466MB free_disk=25.147602081298828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 07:24:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:24:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:24:55 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 1a7c8b14-533d-4913-8d60-4818c3801e54 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:24:55 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 748b208f-1bb7-46b2-b914-9f6bdd1f80af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:24:55 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 07:24:55 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 07:24:55 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:24:55 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:24:55 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 07:24:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.336s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:24:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:25:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:25:02 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:25:02 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Cleaning up deleted instances {{(pid=72809) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 07:25:02 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] There are 0 instances to clean {{(pid=72809) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 07:25:03 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:25:03 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:25:04 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:25:04 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 07:25:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:25:05 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:25:07 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:25:08 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:25:08 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72809) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 07:25:09 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:25:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:25:11 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:25:14 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:25:15 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:25:20 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:25:25 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:25:30 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:25:35 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:25:40 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:25:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:25:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:25:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=72809) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 07:25:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:25:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:25:45 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:25:50 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:25:52 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:25:52 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 07:25:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-748b208f-1bb7-46b2-b914-9f6bdd1f80af" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:25:52 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-748b208f-1bb7-46b2-b914-9f6bdd1f80af" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:25:52 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 07:25:53 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Updating instance_info_cache with network_info: [{"id": "b4ff2651-84b6-43c3-8575-d144a6ff524e", "address": "fa:16:3e:e1:81:c7", "network": {"id": "dae64e44-3d73-4cd2-8361-f98f60e96d0d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1582898053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fbcffb883548f9a357ace3c4ba93fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ff2651-84", "ovs_interfaceid": "b4ff2651-84b6-43c3-8575-d144a6ff524e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:25:53 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-748b208f-1bb7-46b2-b914-9f6bdd1f80af" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:25:53 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 07:25:53 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:25:55 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:25:55 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:25:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:25:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:25:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:25:55 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 07:25:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748b208f-1bb7-46b2-b914-9f6bdd1f80af/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:25:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748b208f-1bb7-46b2-b914-9f6bdd1f80af/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:25:55 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748b208f-1bb7-46b2-b914-9f6bdd1f80af/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:25:56 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748b208f-1bb7-46b2-b914-9f6bdd1f80af/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:25:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:25:56 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:25:56 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:25:56 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=8596MB free_disk=25.146846771240234GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 07:25:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:25:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:25:56 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 1a7c8b14-533d-4913-8d60-4818c3801e54 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:25:56 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 748b208f-1bb7-46b2-b914-9f6bdd1f80af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:25:56 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 07:25:56 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 07:25:56 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Refreshing inventories for resource provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 07:25:56 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Updating ProviderTree inventory for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 07:25:56 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Updating inventory in ProviderTree for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 07:25:56 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Refreshing aggregate associations for resource provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3, aggregates: None {{(pid=72809) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 07:25:56 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Refreshing trait associations for resource provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI {{(pid=72809) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 07:25:56 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:25:56 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:25:56 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 07:25:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.333s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:26:00 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._sync_power_states {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:26:00 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Triggering sync for uuid 1a7c8b14-533d-4913-8d60-4818c3801e54 {{(pid=72809) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 07:26:00 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Triggering sync for uuid 748b208f-1bb7-46b2-b914-9f6bdd1f80af {{(pid=72809) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 07:26:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "1a7c8b14-533d-4913-8d60-4818c3801e54" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:26:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "1a7c8b14-533d-4913-8d60-4818c3801e54" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:26:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "748b208f-1bb7-46b2-b914-9f6bdd1f80af" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:26:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "748b208f-1bb7-46b2-b914-9f6bdd1f80af" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:26:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "1a7c8b14-533d-4913-8d60-4818c3801e54" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:26:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "748b208f-1bb7-46b2-b914-9f6bdd1f80af" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:26:00 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:26:03 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:26:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:26:05 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:26:05 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:26:05 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:26:05 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 07:26:05 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:26:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-d2ac95f2-05cb-4d69-83bd-332f1fa887f5 req-9df11065-704e-42b4-b0a4-896b548bff05 service nova] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Received event network-changed-2816d3a6-e5d7-4189-859b-bd12707eda1c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:26:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-d2ac95f2-05cb-4d69-83bd-332f1fa887f5 req-9df11065-704e-42b4-b0a4-896b548bff05 service nova] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Refreshing instance network info cache due to event network-changed-2816d3a6-e5d7-4189-859b-bd12707eda1c. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:26:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d2ac95f2-05cb-4d69-83bd-332f1fa887f5 req-9df11065-704e-42b4-b0a4-896b548bff05 service nova] Acquiring lock "refresh_cache-1a7c8b14-533d-4913-8d60-4818c3801e54" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:26:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d2ac95f2-05cb-4d69-83bd-332f1fa887f5 req-9df11065-704e-42b4-b0a4-896b548bff05 service nova] Acquired lock "refresh_cache-1a7c8b14-533d-4913-8d60-4818c3801e54" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:26:07 user nova-compute[72809]: DEBUG nova.network.neutron [req-d2ac95f2-05cb-4d69-83bd-332f1fa887f5 req-9df11065-704e-42b4-b0a4-896b548bff05 service nova] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Refreshing network info cache for port 2816d3a6-e5d7-4189-859b-bd12707eda1c {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:26:07 user nova-compute[72809]: DEBUG nova.network.neutron [req-d2ac95f2-05cb-4d69-83bd-332f1fa887f5 req-9df11065-704e-42b4-b0a4-896b548bff05 service nova] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Updated VIF entry in instance network info cache for port 2816d3a6-e5d7-4189-859b-bd12707eda1c. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:26:07 user nova-compute[72809]: DEBUG nova.network.neutron [req-d2ac95f2-05cb-4d69-83bd-332f1fa887f5 req-9df11065-704e-42b4-b0a4-896b548bff05 service nova] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Updating instance_info_cache with network_info: [{"id": "2816d3a6-e5d7-4189-859b-bd12707eda1c", "address": "fa:16:3e:44:08:ae", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2816d3a6-e5", "ovs_interfaceid": "2816d3a6-e5d7-4189-859b-bd12707eda1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:26:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-d2ac95f2-05cb-4d69-83bd-332f1fa887f5 req-9df11065-704e-42b4-b0a4-896b548bff05 service nova] Releasing lock "refresh_cache-1a7c8b14-533d-4913-8d60-4818c3801e54" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:26:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "1a7c8b14-533d-4913-8d60-4818c3801e54" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:26:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "1a7c8b14-533d-4913-8d60-4818c3801e54" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:26:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "1a7c8b14-533d-4913-8d60-4818c3801e54-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:26:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "1a7c8b14-533d-4913-8d60-4818c3801e54-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:26:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "1a7c8b14-533d-4913-8d60-4818c3801e54-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:26:07 user nova-compute[72809]: INFO nova.compute.manager [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Terminating instance
Aug 09 07:26:07 user nova-compute[72809]: DEBUG nova.compute.manager [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:26:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:26:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:26:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:26:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:26:07 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:26:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-516692f9-bc8b-4072-baf5-3dba16a9e59f req-ced6bcab-7f75-421e-acef-a0d2f7ad46b4 service nova] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Received event network-vif-unplugged-2816d3a6-e5d7-4189-859b-bd12707eda1c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:26:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-516692f9-bc8b-4072-baf5-3dba16a9e59f req-ced6bcab-7f75-421e-acef-a0d2f7ad46b4 service nova] Acquiring lock "1a7c8b14-533d-4913-8d60-4818c3801e54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:26:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-516692f9-bc8b-4072-baf5-3dba16a9e59f req-ced6bcab-7f75-421e-acef-a0d2f7ad46b4 service nova] Lock "1a7c8b14-533d-4913-8d60-4818c3801e54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:26:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-516692f9-bc8b-4072-baf5-3dba16a9e59f req-ced6bcab-7f75-421e-acef-a0d2f7ad46b4 service nova] Lock "1a7c8b14-533d-4913-8d60-4818c3801e54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:26:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-516692f9-bc8b-4072-baf5-3dba16a9e59f req-ced6bcab-7f75-421e-acef-a0d2f7ad46b4 service nova] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] No waiting events found dispatching network-vif-unplugged-2816d3a6-e5d7-4189-859b-bd12707eda1c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:26:07 user nova-compute[72809]: DEBUG nova.compute.manager [req-516692f9-bc8b-4072-baf5-3dba16a9e59f req-ced6bcab-7f75-421e-acef-a0d2f7ad46b4 service nova] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Received event network-vif-unplugged-2816d3a6-e5d7-4189-859b-bd12707eda1c for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:26:08 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Instance destroyed successfully.
Aug 09 07:26:08 user nova-compute[72809]: DEBUG nova.objects.instance [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lazy-loading 'resources' on Instance uuid 1a7c8b14-533d-4913-8d60-4818c3801e54 {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:24:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1242885598',display_name='tempest-TestVolumeBootPattern-server-1242885598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1242885598',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjnvBkBtyKj+KLLI54SBkh5HnXtHKYGIvHET6AohUoc067yu29rFAuYqAakYT1y07YcSfZK33sZkxNs57WMr0x24BQA2oeNeplu2EJ8SgGH8Bvo7ooGDsRYmmPpPFSHcQ==',key_name='tempest-TestVolumeBootPattern-1169256863',keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:24:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8cdcd8241b9b47eab16a6e37a9cc5f54',ramdisk_id='',reservation_id='r-ltgta87e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-224847517',owner_user_name='tempest-TestVolumeBootPattern-224847517-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:24:29Z,user_data=None,user_id='a7859a38408b426eb9a14ef003483bd3',uuid=1a7c8b14-533d-4913-8d60-4818c3801e54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2816d3a6-e5d7-4189-859b-bd12707eda1c", "address": "fa:16:3e:44:08:ae", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2816d3a6-e5", "ovs_interfaceid": "2816d3a6-e5d7-4189-859b-bd12707eda1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converting VIF {"id": "2816d3a6-e5d7-4189-859b-bd12707eda1c", "address": "fa:16:3e:44:08:ae", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2816d3a6-e5", "ovs_interfaceid": "2816d3a6-e5d7-4189-859b-bd12707eda1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:08:ae,bridge_name='br-int',has_traffic_filtering=True,id=2816d3a6-e5d7-4189-859b-bd12707eda1c,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2816d3a6-e5') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG os_vif [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:08:ae,bridge_name='br-int',has_traffic_filtering=True,id=2816d3a6-e5d7-4189-859b-bd12707eda1c,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2816d3a6-e5') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2816d3a6-e5, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:26:08 user nova-compute[72809]: INFO os_vif [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:08:ae,bridge_name='br-int',has_traffic_filtering=True,id=2816d3a6-e5d7-4189-859b-bd12707eda1c,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2816d3a6-e5')
Aug 09 07:26:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewTXjsCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:26:08 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:26:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4ea1ca-181d-4a78-8653-53cc6c15ddfd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd29676-9307-443a-be9b-bd69e26c6d87]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 (non-flash)
Aug 09 07:26:08 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 (non-flash)
Aug 09 07:26:08 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc1384551b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753'): ({'sdb'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Removing single pathed devices sdb {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bae717-268d-43c7-a89b-43e993894e66]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af69082-5942-415c-a5af-2132dece7718]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Flushing IO for device /dev/sdb {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3ceae3-848c-4418-9e4e-c7c1ca4040b9]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1171029-16f8-4a9d-aded-cc5d69da68f3]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] SCSI volumes sdb have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_2ced98e1', '/dev/disk/by-id/scsi-23236303065626339', '/dev/disk/by-id/scsi-1SCST_BIO2ced98e1-2600ebc9735ba172') {{(pid=83900) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8dd592-b968-4e0b-948f-d32f67eb0601]: (4, None) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[10162909-fcef-41ff-84e5-f5a65d5707d8]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d4c79b-06c4-4183-844c-5ff318f453ac]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753, portal: 172.16.0.220,3260]
Aug 09 07:26:08 user nova-compute[72809]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753, portal: 172.16.0.220,3260] successful.
Aug 09 07:26:08 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[097bc322-88f6-41eb-b6a7-34d4d3e2758c]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.251s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] <== disconnect_volume: return (253ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:26:08 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Deleting instance files /opt/stack/data/nova/instances/1a7c8b14-533d-4913-8d60-4818c3801e54_del
Aug 09 07:26:08 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Deletion of /opt/stack/data/nova/instances/1a7c8b14-533d-4913-8d60-4818c3801e54_del complete
Aug 09 07:26:08 user nova-compute[72809]: INFO nova.compute.manager [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Took 1.09 seconds to destroy the instance on the hypervisor.
Aug 09 07:26:08 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:26:08 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:26:09 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:26:09 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Took 0.72 seconds to deallocate network for instance.
Aug 09 07:26:09 user nova-compute[72809]: DEBUG nova.compute.manager [req-f4164d58-fe02-49ff-aba0-515d84eed13f req-b00b979e-a1c5-4bdc-98cf-494703810d0d service nova] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Received event network-vif-deleted-2816d3a6-e5d7-4189-859b-bd12707eda1c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:26:09 user nova-compute[72809]: INFO nova.compute.manager [req-f4164d58-fe02-49ff-aba0-515d84eed13f req-b00b979e-a1c5-4bdc-98cf-494703810d0d service nova] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Neutron deleted interface 2816d3a6-e5d7-4189-859b-bd12707eda1c; detaching it from the instance and deleting it from the info cache
Aug 09 07:26:09 user nova-compute[72809]: DEBUG nova.network.neutron [req-f4164d58-fe02-49ff-aba0-515d84eed13f req-b00b979e-a1c5-4bdc-98cf-494703810d0d service nova] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:26:09 user nova-compute[72809]: DEBUG nova.compute.manager [req-f4164d58-fe02-49ff-aba0-515d84eed13f req-b00b979e-a1c5-4bdc-98cf-494703810d0d service nova] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Detach interface failed, port_id=2816d3a6-e5d7-4189-859b-bd12707eda1c, reason: Instance 1a7c8b14-533d-4913-8d60-4818c3801e54 could not be found. {{(pid=72809) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 07:26:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:26:09 user nova-compute[72809]: DEBUG nova.compute.manager [req-5a3d09a1-7873-498c-93bf-c3be49eeed9f req-9dc8f507-15ab-47c9-ad77-21cebefa1396 service nova] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Received event network-vif-plugged-2816d3a6-e5d7-4189-859b-bd12707eda1c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:26:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5a3d09a1-7873-498c-93bf-c3be49eeed9f req-9dc8f507-15ab-47c9-ad77-21cebefa1396 service nova] Acquiring lock "1a7c8b14-533d-4913-8d60-4818c3801e54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:26:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5a3d09a1-7873-498c-93bf-c3be49eeed9f req-9dc8f507-15ab-47c9-ad77-21cebefa1396 service nova] Lock "1a7c8b14-533d-4913-8d60-4818c3801e54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:26:09 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5a3d09a1-7873-498c-93bf-c3be49eeed9f req-9dc8f507-15ab-47c9-ad77-21cebefa1396 service nova] Lock "1a7c8b14-533d-4913-8d60-4818c3801e54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:26:09 user nova-compute[72809]: DEBUG nova.compute.manager [req-5a3d09a1-7873-498c-93bf-c3be49eeed9f req-9dc8f507-15ab-47c9-ad77-21cebefa1396 service nova] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] No waiting events found dispatching network-vif-plugged-2816d3a6-e5d7-4189-859b-bd12707eda1c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:26:09 user nova-compute[72809]: WARNING nova.compute.manager [req-5a3d09a1-7873-498c-93bf-c3be49eeed9f req-9dc8f507-15ab-47c9-ad77-21cebefa1396 service nova] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Received unexpected event network-vif-plugged-2816d3a6-e5d7-4189-859b-bd12707eda1c for instance with vm_state active and task_state deleting.
Aug 09 07:26:10 user nova-compute[72809]: INFO nova.compute.manager [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Took 0.75 seconds to detach 1 volumes for instance.
Aug 09 07:26:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:26:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:26:10 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:26:10 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:26:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.126s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:26:10 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Deleted allocations for instance 1a7c8b14-533d-4913-8d60-4818c3801e54
Aug 09 07:26:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-a4964172-35fe-4dc6-a947-cd53298bbb52 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "1a7c8b14-533d-4913-8d60-4818c3801e54" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.864s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:26:12 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:26:13 user nova-compute[72809]: DEBUG nova.compute.manager [req-a69e4417-8ffa-4d21-b973-743174f56a91 req-f26d51f6-0e65-477f-af34-411be21c91f4 service nova] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Received event network-changed-b4ff2651-84b6-43c3-8575-d144a6ff524e {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:26:13 user nova-compute[72809]: DEBUG nova.compute.manager [req-a69e4417-8ffa-4d21-b973-743174f56a91 req-f26d51f6-0e65-477f-af34-411be21c91f4 service nova] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Refreshing instance network info cache due to event network-changed-b4ff2651-84b6-43c3-8575-d144a6ff524e. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:26:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a69e4417-8ffa-4d21-b973-743174f56a91 req-f26d51f6-0e65-477f-af34-411be21c91f4 service nova] Acquiring lock "refresh_cache-748b208f-1bb7-46b2-b914-9f6bdd1f80af" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:26:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a69e4417-8ffa-4d21-b973-743174f56a91 req-f26d51f6-0e65-477f-af34-411be21c91f4 service nova] Acquired lock "refresh_cache-748b208f-1bb7-46b2-b914-9f6bdd1f80af" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:26:13 user nova-compute[72809]: DEBUG nova.network.neutron [req-a69e4417-8ffa-4d21-b973-743174f56a91 req-f26d51f6-0e65-477f-af34-411be21c91f4 service nova] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Refreshing network info cache for port b4ff2651-84b6-43c3-8575-d144a6ff524e {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:26:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:26:13 user nova-compute[72809]: DEBUG nova.network.neutron [req-a69e4417-8ffa-4d21-b973-743174f56a91 req-f26d51f6-0e65-477f-af34-411be21c91f4 service nova] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Updated VIF entry in instance network info cache for port b4ff2651-84b6-43c3-8575-d144a6ff524e. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:26:13 user nova-compute[72809]: DEBUG nova.network.neutron [req-a69e4417-8ffa-4d21-b973-743174f56a91 req-f26d51f6-0e65-477f-af34-411be21c91f4 service nova] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Updating instance_info_cache with network_info: [{"id": "b4ff2651-84b6-43c3-8575-d144a6ff524e", "address": "fa:16:3e:e1:81:c7", "network": {"id": "dae64e44-3d73-4cd2-8361-f98f60e96d0d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1582898053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fbcffb883548f9a357ace3c4ba93fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ff2651-84", "ovs_interfaceid": "b4ff2651-84b6-43c3-8575-d144a6ff524e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:26:13 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-a69e4417-8ffa-4d21-b973-743174f56a91 req-f26d51f6-0e65-477f-af34-411be21c91f4 service nova] Releasing lock "refresh_cache-748b208f-1bb7-46b2-b914-9f6bdd1f80af" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:26:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:26:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Acquiring lock "748b208f-1bb7-46b2-b914-9f6bdd1f80af" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:26:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lock "748b208f-1bb7-46b2-b914-9f6bdd1f80af" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:26:17 user nova-compute[72809]: DEBUG nova.objects.instance [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lazy-loading 'flavor' on Instance uuid 748b208f-1bb7-46b2-b914-9f6bdd1f80af {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:26:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lock "748b208f-1bb7-46b2-b914-9f6bdd1f80af" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:26:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Acquiring lock "748b208f-1bb7-46b2-b914-9f6bdd1f80af" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:26:17 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lock "748b208f-1bb7-46b2-b914-9f6bdd1f80af" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:26:17 user nova-compute[72809]: INFO nova.compute.manager [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Attaching volume bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e to /dev/vdb
Aug 09 07:26:17 user nova-compute[72809]: DEBUG os_brick.utils [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:26:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:17 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b872d31f-0fd3-43f1-ba7f-18a6d51aa397]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:17 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a76019-44b2-4e11-a03b-ea47b15d513c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:17 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c6f854-fb61-4aa5-9491-29478c197dfd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:17 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fc1ad3-eeb7-4cd8-ab41-fa8eb0e11f1f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:26:17 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 07:26:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:17 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:26:17 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 07:26:17 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3812f4b8-73fc-46d3-a434-8b4259e42cf2]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:17 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 07:26:17 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 07:26:17 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 07:26:17 user nova-compute[72809]: DEBUG os_brick.utils [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:26:17 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Updating existing volume attachment record: 7861e26a-f920-403c-a532-112d8db62066 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 07:26:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:26:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:26:23 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691565968.214932, 1a7c8b14-533d-4913-8d60-4818c3801e54 => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:26:23 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] VM Stopped (Lifecycle Event)
Aug 09 07:26:23 user nova-compute[72809]: DEBUG nova.compute.manager [None req-3e26a670-f01b-42ed-9cf8-e63e420a3c81 None None] [instance: 1a7c8b14-533d-4913-8d60-4818c3801e54] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:26:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:26:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BVMlbvoD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:26:25 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:26:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:26:25 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:26:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:26:25 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 07:26:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08ea6e7-fd6c-4684-a814-fb8c54b74c13]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 07:26:25 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa1cf86-0635-42f5-8e27-119f766e5b46]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e] added
Aug 09 07:26:25 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce30eb3e-a057-4a35-883e-5257c700e84e]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2899cb49-543d-416e-9be4-04bf1c1c3826]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BVMlbvoD {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BVMlbvoD" returned: 0 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[1570921b-249c-4dd7-8aa4-08037f118f04]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BVMlbvoD'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1aedb6-4334-4c01-bf77-4972a09c73c9]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9c723a-ce34-41e0-bccd-c5c1244c5097]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 07:26:25 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 07:26:25 user nova-compute[72809]:  {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:26:25 user nova-compute[72809]: WARNING os_brick.initiator.connectors.iscsi [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 07:26:25 user nova-compute[72809]: 
Aug 09 07:26:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc7c6a8-cb20-423f-a417-cdb4367666ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e, portal: 172.16.0.220,3260]
Aug 09 07:26:25 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e, portal: 172.16.0.220,3260] successful.
Aug 09 07:26:25 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b8276d-5eaf-4126-8090-1bc5cc64c0c0]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74a8daf-1f30-4858-a3bd-eb1a3ac1408c]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e (non-flash)
Aug 09 07:26:25 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e (non-flash)
Aug 09 07:26:25 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c84f907-c3d1-4df4-9ebb-69e5e5331687]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:25 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:26:26 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:26:26 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BVMlbvoD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 07:26:26 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:26:26 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23465643034623661', 'path': '/dev/sdb'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:26:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465643034623661', 'path': '/dev/sdb'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 07:26:26 user nova-compute[72809]: DEBUG nova.objects.instance [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lazy-loading 'flavor' on Instance uuid 748b208f-1bb7-46b2-b914-9f6bdd1f80af {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:26:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 07:26:26 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:26:26 user nova-compute[72809]:   <source dev="/dev/sdb"/>
Aug 09 07:26:26 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:26:26 user nova-compute[72809]:   <serial>bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e</serial>
Aug 09 07:26:26 user nova-compute[72809]: </disk>
Aug 09 07:26:26 user nova-compute[72809]:  {{(pid=72809) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 07:26:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:26:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:26:26 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] No VIF found with MAC fa:16:3e:e1:81:c7, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:26:27 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-4739ddb3-6d23-4e8d-b96f-be3e751e4ac9 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lock "748b208f-1bb7-46b2-b914-9f6bdd1f80af" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.596s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Acquiring lock "748b208f-1bb7-46b2-b914-9f6bdd1f80af" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lock "748b208f-1bb7-46b2-b914-9f6bdd1f80af" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:26:28 user nova-compute[72809]: INFO nova.compute.manager [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Detaching volume bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e
Aug 09 07:26:28 user nova-compute[72809]: INFO nova.virt.block_device [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Attempting to driver detach volume bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e from mountpoint /dev/vdb
Aug 09 07:26:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Attempting to detach device vdb from instance 748b208f-1bb7-46b2-b914-9f6bdd1f80af from the persistent domain config. {{(pid=72809) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:26:28 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:26:28 user nova-compute[72809]:   <source dev="/dev/sdb"/>
Aug 09 07:26:28 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:26:28 user nova-compute[72809]:   <serial>bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e</serial>
Aug 09 07:26:28 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 07:26:28 user nova-compute[72809]: </disk>
Aug 09 07:26:28 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:26:28 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Successfully detached device vdb from instance 748b208f-1bb7-46b2-b914-9f6bdd1f80af from the persistent domain config.
Aug 09 07:26:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 748b208f-1bb7-46b2-b914-9f6bdd1f80af from the live domain config. {{(pid=72809) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.guest [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 07:26:28 user nova-compute[72809]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:26:28 user nova-compute[72809]:   <source dev="/dev/sdb"/>
Aug 09 07:26:28 user nova-compute[72809]:   <target dev="vdb" bus="virtio"/>
Aug 09 07:26:28 user nova-compute[72809]:   <serial>bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e</serial>
Aug 09 07:26:28 user nova-compute[72809]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 07:26:28 user nova-compute[72809]: </disk>
Aug 09 07:26:28 user nova-compute[72809]:  {{(pid=72809) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Received event <DeviceRemovedEvent: 1691565988.5736039, 748b208f-1bb7-46b2-b914-9f6bdd1f80af => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72809) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 748b208f-1bb7-46b2-b914-9f6bdd1f80af {{(pid=72809) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 07:26:28 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Successfully detached device vdb from instance 748b208f-1bb7-46b2-b914-9f6bdd1f80af from the live domain config.
Aug 09 07:26:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BVMlbvoD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:26:28 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:26:28 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e3e5a4-a36e-4df1-89dc-8d2bf29f0821]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5df323e-5c36-415e-91e9-b9050bdb78d1]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e (non-flash)
Aug 09 07:26:28 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e (non-flash)
Aug 09 07:26:28 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc1386cc4c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e'): ({'sdb'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Removing single pathed devices sdb {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d92d53-df79-4634-86fa-c8a402f2a477]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6126d35-8fa2-4dcb-971c-9c493dd19879]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Flushing IO for device /dev/sdb {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17de6b3-cd84-47a8-85dc-76aac858fd4a]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe30ac1-96c8-4cbf-8174-8fda06b399d5]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] SCSI volumes sdb have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e32390f-89cc-4bd5-be1f-e3d9d7b76e67]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dc949b-792f-450f-8ad0-43e09ac4351f]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e, portal: 172.16.0.220,3260]
Aug 09 07:26:28 user nova-compute[72809]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e, portal: 172.16.0.220,3260] successful.
Aug 09 07:26:28 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf074691-d2ff-4fe9-b5e4-1aa9f62ea03e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8691b1e-1bfe-4f90-bbfd-995e784acbcc]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.248s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] <== disconnect_volume: return (250ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:26:28 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:26:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:26:29 user nova-compute[72809]: DEBUG nova.objects.instance [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lazy-loading 'flavor' on Instance uuid 748b208f-1bb7-46b2-b914-9f6bdd1f80af {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:26:29 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-1099362d-c233-4e55-9627-20e342a60f2c tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lock "748b208f-1bb7-46b2-b914-9f6bdd1f80af" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.522s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:26:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:26:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:26:43 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:26:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:26:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:26:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:26:53 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:26:53 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 07:26:53 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Rebuilding the list of instances to heal {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 07:26:53 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-748b208f-1bb7-46b2-b914-9f6bdd1f80af" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:26:53 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-748b208f-1bb7-46b2-b914-9f6bdd1f80af" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:26:53 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 07:26:53 user nova-compute[72809]: DEBUG nova.objects.instance [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lazy-loading 'info_cache' on Instance uuid 748b208f-1bb7-46b2-b914-9f6bdd1f80af {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:26:54 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Updating instance_info_cache with network_info: [{"id": "b4ff2651-84b6-43c3-8575-d144a6ff524e", "address": "fa:16:3e:e1:81:c7", "network": {"id": "dae64e44-3d73-4cd2-8361-f98f60e96d0d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1582898053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fbcffb883548f9a357ace3c4ba93fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ff2651-84", "ovs_interfaceid": "b4ff2651-84b6-43c3-8575-d144a6ff524e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:26:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-748b208f-1bb7-46b2-b914-9f6bdd1f80af" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:26:54 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 07:26:54 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:26:57 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:26:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:26:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:26:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:26:57 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 07:26:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748b208f-1bb7-46b2-b914-9f6bdd1f80af/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748b208f-1bb7-46b2-b914-9f6bdd1f80af/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748b208f-1bb7-46b2-b914-9f6bdd1f80af/disk --force-share --output=json {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:58 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/748b208f-1bb7-46b2-b914-9f6bdd1f80af/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:26:58 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:26:58 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:26:58 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=8706MB free_disk=25.145328521728516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 07:26:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:26:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.014s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:26:58 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 748b208f-1bb7-46b2-b914-9f6bdd1f80af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:26:58 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 07:26:58 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 07:26:58 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:26:58 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:26:58 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 07:26:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:26:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "7a7080a1-7ff9-4057-8043-614acd38b71f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:26:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "7a7080a1-7ff9-4057-8043-614acd38b71f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:26:59 user nova-compute[72809]: DEBUG nova.compute.manager [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 07:26:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:26:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:26:59 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 07:26:59 user nova-compute[72809]: INFO nova.compute.claims [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Claim successful on node user
Aug 09 07:26:59 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:26:59 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:26:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.259s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:26:59 user nova-compute[72809]: DEBUG nova.compute.manager [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 07:26:59 user nova-compute[72809]: DEBUG nova.compute.manager [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 07:26:59 user nova-compute[72809]: DEBUG nova.network.neutron [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 07:26:59 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 07:26:59 user nova-compute[72809]: DEBUG nova.compute.manager [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 07:26:59 user nova-compute[72809]: INFO nova.virt.block_device [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Booting with volume e4daa5fd-e98f-45cb-a865-913dcce3e753 at /dev/vda
Aug 09 07:26:59 user nova-compute[72809]: DEBUG nova.policy [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a7859a38408b426eb9a14ef003483bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8241b9b47eab16a6e37a9cc5f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 07:26:59 user nova-compute[72809]: DEBUG os_brick.utils [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:26:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:59 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebad5c9-bc6f-4d28-ab52-b1ce2e98e99e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:59 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a5ab2d-b54e-4485-a596-57a6a0fb8b28]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:26:59 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bef2e13-9a22-4a1f-ac16-2f1b43a3276d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:59 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5d5e15-5af7-47d8-bac0-92639f3e35a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:26:59 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 07:26:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:26:59 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:26:59 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 07:26:59 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cef26c6-e487-4849-b990-8fbc83577a09]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:26:59 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 07:26:59 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 07:26:59 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 07:26:59 user nova-compute[72809]: DEBUG os_brick.utils [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:26:59 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Updating existing volume attachment record: cd951964-9234-40dc-b9e7-2a848fed9a98 {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 07:27:00 user nova-compute[72809]: DEBUG nova.network.neutron [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Successfully created port: 77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 07:27:00 user nova-compute[72809]: DEBUG nova.network.neutron [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Successfully updated port: 77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 07:27:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "refresh_cache-7a7080a1-7ff9-4057-8043-614acd38b71f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:27:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquired lock "refresh_cache-7a7080a1-7ff9-4057-8043-614acd38b71f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:27:00 user nova-compute[72809]: DEBUG nova.network.neutron [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:27:01 user nova-compute[72809]: DEBUG nova.compute.manager [req-213f6ae1-33a5-44ac-bb5a-224e28d8cecc req-751ea5ef-bfd5-4476-9b38-c1a074899322 service nova] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Received event network-changed-77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:27:01 user nova-compute[72809]: DEBUG nova.compute.manager [req-213f6ae1-33a5-44ac-bb5a-224e28d8cecc req-751ea5ef-bfd5-4476-9b38-c1a074899322 service nova] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Refreshing instance network info cache due to event network-changed-77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:27:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-213f6ae1-33a5-44ac-bb5a-224e28d8cecc req-751ea5ef-bfd5-4476-9b38-c1a074899322 service nova] Acquiring lock "refresh_cache-7a7080a1-7ff9-4057-8043-614acd38b71f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:27:01 user nova-compute[72809]: DEBUG nova.network.neutron [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 07:27:01 user nova-compute[72809]: DEBUG nova.network.neutron [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Updating instance_info_cache with network_info: [{"id": "77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c", "address": "fa:16:3e:cb:05:46", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77831bb5-c5", "ovs_interfaceid": "77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:27:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Releasing lock "refresh_cache-7a7080a1-7ff9-4057-8043-614acd38b71f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:27:01 user nova-compute[72809]: DEBUG nova.compute.manager [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Instance network_info: |[{"id": "77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c", "address": "fa:16:3e:cb:05:46", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77831bb5-c5", "ovs_interfaceid": "77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 07:27:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-213f6ae1-33a5-44ac-bb5a-224e28d8cecc req-751ea5ef-bfd5-4476-9b38-c1a074899322 service nova] Acquired lock "refresh_cache-7a7080a1-7ff9-4057-8043-614acd38b71f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:27:01 user nova-compute[72809]: DEBUG nova.network.neutron [req-213f6ae1-33a5-44ac-bb5a-224e28d8cecc req-751ea5ef-bfd5-4476-9b38-c1a074899322 service nova] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Refreshing network info cache for port 77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:27:01 user nova-compute[72809]: DEBUG nova.network.neutron [req-213f6ae1-33a5-44ac-bb5a-224e28d8cecc req-751ea5ef-bfd5-4476-9b38-c1a074899322 service nova] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Updated VIF entry in instance network info cache for port 77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:27:01 user nova-compute[72809]: DEBUG nova.network.neutron [req-213f6ae1-33a5-44ac-bb5a-224e28d8cecc req-751ea5ef-bfd5-4476-9b38-c1a074899322 service nova] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Updating instance_info_cache with network_info: [{"id": "77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c", "address": "fa:16:3e:cb:05:46", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77831bb5-c5", "ovs_interfaceid": "77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:27:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-213f6ae1-33a5-44ac-bb5a-224e28d8cecc req-751ea5ef-bfd5-4476-9b38-c1a074899322 service nova] Releasing lock "refresh_cache-7a7080a1-7ff9-4057-8043-614acd38b71f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:27:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:27:06 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:27:06 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG nova.compute.manager [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 07:27:07 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Creating image(s)
Aug 09 07:27:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Did not create local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Ensure instance console log exists: /opt/stack/data/nova/instances/7a7080a1-7ff9-4057-8043-614acd38b71f/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Start _get_guest_xml network_info=[{"id": "77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c", "address": "fa:16:3e:cb:05:46", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77831bb5-c5", "ovs_interfaceid": "77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewTXjsCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7a7080a1-7ff9-4057-8043-614acd38b71f', 'attached_at': '', 'detached_at': '', 'volume_id': 'e4daa5fd-e98f-45cb-a865-913dcce3e753', 'serial': 'e4daa5fd-e98f-45cb-a865-913dcce3e753'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': 0, 'attachment_id': 'cd951964-9234-40dc-b9e7-2a848fed9a98', 'volume_type': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 07:27:07 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:27:07 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:27:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewTXjsCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:27:07 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:27:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:27:07 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:27:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:27:07 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[598e8c46-d8ca-4dd4-8d12-1db0bc59471e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 07:27:07 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4629e7-6086-471d-8ed0-705d31b8ab2c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753] added
Aug 09 07:27:07 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[30854578-e948-4da0-b183-adda93582e43]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[a046ab33-9727-4164-b004-cdd04232f00e]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ewTXjsCP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ewTXjsCP" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e0c611-f680-4394-89cf-cb4fa98dbd33]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ewTXjsCP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[09945d04-a870-4d27-9c42-a2cebee18223]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[1223c68f-9d56-4981-a86a-df03cebda3f0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 07:27:07 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 07:27:07 user nova-compute[72809]:  {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:27:07 user nova-compute[72809]: WARNING os_brick.initiator.connectors.iscsi [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 07:27:07 user nova-compute[72809]: 
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade387b2-6dcf-4675-9264-092231be35ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753, portal: 172.16.0.220,3260]
Aug 09 07:27:07 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753, portal: 172.16.0.220,3260] successful.
Aug 09 07:27:07 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a75b3e-ae5f-4b97-9dd2-b9ab5dd0ae7e]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cde233-650e-4cfa-88c3-42ec1af9150a]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 (non-flash)
Aug 09 07:27:07 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 (non-flash)
Aug 09 07:27:07 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6028c3f-e452-47b6-9c8d-958e2fed65ce]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:27:07 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:27:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:27:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72809) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 07:27:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:27:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:27:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:08 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:27:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewTXjsCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 07:27:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:27:08 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23236303065626339', 'path': '/dev/sdb'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:27:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236303065626339', 'path': '/dev/sdb'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 07:27:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:26:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-688465389',display_name='tempest-TestVolumeBootPattern-server-688465389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-688465389',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjnvBkBtyKj+KLLI54SBkh5HnXtHKYGIvHET6AohUoc067yu29rFAuYqAakYT1y07YcSfZK33sZkxNs57WMr0x24BQA2oeNeplu2EJ8SgGH8Bvo7ooGDsRYmmPpPFSHcQ==',key_name='tempest-TestVolumeBootPattern-1169256863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cdcd8241b9b47eab16a6e37a9cc5f54',ramdisk_id='',reservation_id='r-7jb0zdie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-224847517',owner_user_name='tempest-TestVolumeBootPattern-224847517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:27:00Z,user_data=None,user_id='a7859a38408b426eb9a14ef003483bd3',uuid=7a7080a1-7ff9-4057-8043-614acd38b71f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c", "address": "fa:16:3e:cb:05:46", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77831bb5-c5", "ovs_interfaceid": "77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 07:27:08 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converting VIF {"id": "77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c", "address": "fa:16:3e:cb:05:46", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77831bb5-c5", "ovs_interfaceid": "77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:27:08 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:05:46,bridge_name='br-int',has_traffic_filtering=True,id=77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77831bb5-c5') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:27:08 user nova-compute[72809]: DEBUG nova.objects.instance [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lazy-loading 'pci_devices' on Instance uuid 7a7080a1-7ff9-4057-8043-614acd38b71f {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:27:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] End _get_guest_xml xml=<domain type="kvm">
Aug 09 07:27:08 user nova-compute[72809]:   <uuid>7a7080a1-7ff9-4057-8043-614acd38b71f</uuid>
Aug 09 07:27:08 user nova-compute[72809]:   <name>instance-00000032</name>
Aug 09 07:27:08 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 07:27:08 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 07:27:08 user nova-compute[72809]:   <metadata>
Aug 09 07:27:08 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 07:27:08 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 07:27:08 user nova-compute[72809]:       <nova:name>tempest-TestVolumeBootPattern-server-688465389</nova:name>
Aug 09 07:27:08 user nova-compute[72809]:       <nova:creationTime>2023-08-09 07:27:07</nova:creationTime>
Aug 09 07:27:08 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 07:27:08 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 07:27:08 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 07:27:08 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 07:27:08 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 07:27:08 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 07:27:08 user nova-compute[72809]:       </nova:flavor>
Aug 09 07:27:08 user nova-compute[72809]:       <nova:owner>
Aug 09 07:27:08 user nova-compute[72809]:         <nova:user uuid="a7859a38408b426eb9a14ef003483bd3">tempest-TestVolumeBootPattern-224847517-project-member</nova:user>
Aug 09 07:27:08 user nova-compute[72809]:         <nova:project uuid="8cdcd8241b9b47eab16a6e37a9cc5f54">tempest-TestVolumeBootPattern-224847517</nova:project>
Aug 09 07:27:08 user nova-compute[72809]:       </nova:owner>
Aug 09 07:27:08 user nova-compute[72809]:       <nova:ports>
Aug 09 07:27:08 user nova-compute[72809]:         <nova:port uuid="77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c">
Aug 09 07:27:08 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 07:27:08 user nova-compute[72809]:         </nova:port>
Aug 09 07:27:08 user nova-compute[72809]:       </nova:ports>
Aug 09 07:27:08 user nova-compute[72809]:     </nova:instance>
Aug 09 07:27:08 user nova-compute[72809]:   </metadata>
Aug 09 07:27:08 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 07:27:08 user nova-compute[72809]:     <system>
Aug 09 07:27:08 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 07:27:08 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 07:27:08 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 07:27:08 user nova-compute[72809]:       <entry name="serial">7a7080a1-7ff9-4057-8043-614acd38b71f</entry>
Aug 09 07:27:08 user nova-compute[72809]:       <entry name="uuid">7a7080a1-7ff9-4057-8043-614acd38b71f</entry>
Aug 09 07:27:08 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 07:27:08 user nova-compute[72809]:     </system>
Aug 09 07:27:08 user nova-compute[72809]:   </sysinfo>
Aug 09 07:27:08 user nova-compute[72809]:   <os>
Aug 09 07:27:08 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 07:27:08 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 07:27:08 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 07:27:08 user nova-compute[72809]:   </os>
Aug 09 07:27:08 user nova-compute[72809]:   <features>
Aug 09 07:27:08 user nova-compute[72809]:     <acpi/>
Aug 09 07:27:08 user nova-compute[72809]:     <apic/>
Aug 09 07:27:08 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 07:27:08 user nova-compute[72809]:   </features>
Aug 09 07:27:08 user nova-compute[72809]:   <clock offset="utc">
Aug 09 07:27:08 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 07:27:08 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 07:27:08 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 07:27:08 user nova-compute[72809]:   </clock>
Aug 09 07:27:08 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 07:27:08 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 07:27:08 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 07:27:08 user nova-compute[72809]:   </cpu>
Aug 09 07:27:08 user nova-compute[72809]:   <devices>
Aug 09 07:27:08 user nova-compute[72809]:     <disk type="block" device="disk">
Aug 09 07:27:08 user nova-compute[72809]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:27:08 user nova-compute[72809]:       <source dev="/dev/sdb"/>
Aug 09 07:27:08 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 07:27:08 user nova-compute[72809]:       <serial>e4daa5fd-e98f-45cb-a865-913dcce3e753</serial>
Aug 09 07:27:08 user nova-compute[72809]:     </disk>
Aug 09 07:27:08 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 07:27:08 user nova-compute[72809]:       <mac address="fa:16:3e:cb:05:46"/>
Aug 09 07:27:08 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:27:08 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 07:27:08 user nova-compute[72809]:       <target dev="tap77831bb5-c5"/>
Aug 09 07:27:08 user nova-compute[72809]:     </interface>
Aug 09 07:27:08 user nova-compute[72809]:     <serial type="pty">
Aug 09 07:27:08 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/7a7080a1-7ff9-4057-8043-614acd38b71f/console.log" append="off"/>
Aug 09 07:27:08 user nova-compute[72809]:     </serial>
Aug 09 07:27:08 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 07:27:08 user nova-compute[72809]:     <video>
Aug 09 07:27:08 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:27:08 user nova-compute[72809]:     </video>
Aug 09 07:27:08 user nova-compute[72809]:     <rng model="virtio">
Aug 09 07:27:08 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 07:27:08 user nova-compute[72809]:     </rng>
Aug 09 07:27:08 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 07:27:08 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 07:27:08 user nova-compute[72809]:       <stats period="10"/>
Aug 09 07:27:08 user nova-compute[72809]:     </memballoon>
Aug 09 07:27:08 user nova-compute[72809]:   </devices>
Aug 09 07:27:08 user nova-compute[72809]: </domain>
Aug 09 07:27:08 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 07:27:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:26:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-688465389',display_name='tempest-TestVolumeBootPattern-server-688465389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-688465389',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjnvBkBtyKj+KLLI54SBkh5HnXtHKYGIvHET6AohUoc067yu29rFAuYqAakYT1y07YcSfZK33sZkxNs57WMr0x24BQA2oeNeplu2EJ8SgGH8Bvo7ooGDsRYmmPpPFSHcQ==',key_name='tempest-TestVolumeBootPattern-1169256863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cdcd8241b9b47eab16a6e37a9cc5f54',ramdisk_id='',reservation_id='r-7jb0zdie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-224847517',owner_user_name='tempest-TestVolumeBootPattern-224847517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:27:00Z,user_data=None,user_id='a7859a38408b426eb9a14ef003483bd3',uuid=7a7080a1-7ff9-4057-8043-614acd38b71f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c", "address": "fa:16:3e:cb:05:46", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77831bb5-c5", "ovs_interfaceid": "77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 07:27:08 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converting VIF {"id": "77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c", "address": "fa:16:3e:cb:05:46", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77831bb5-c5", "ovs_interfaceid": "77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:27:08 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:05:46,bridge_name='br-int',has_traffic_filtering=True,id=77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77831bb5-c5') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:27:08 user nova-compute[72809]: DEBUG os_vif [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:05:46,bridge_name='br-int',has_traffic_filtering=True,id=77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77831bb5-c5') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 07:27:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:27:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 07:27:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77831bb5-c5, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:27:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap77831bb5-c5, col_values=(('external_ids', {'iface-id': '77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:05:46', 'vm-uuid': '7a7080a1-7ff9-4057-8043-614acd38b71f'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:27:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:27:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:08 user nova-compute[72809]: INFO os_vif [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:05:46,bridge_name='br-int',has_traffic_filtering=True,id=77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77831bb5-c5')
Aug 09 07:27:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:27:08 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] No VIF found with MAC fa:16:3e:cb:05:46, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:27:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:10 user nova-compute[72809]: DEBUG nova.compute.manager [req-3970ff4e-27bd-4ac6-bac9-20685562fee3 req-4df71bcb-db94-4181-b308-5136f269575a service nova] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Received event network-vif-plugged-77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:27:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3970ff4e-27bd-4ac6-bac9-20685562fee3 req-4df71bcb-db94-4181-b308-5136f269575a service nova] Acquiring lock "7a7080a1-7ff9-4057-8043-614acd38b71f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:27:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3970ff4e-27bd-4ac6-bac9-20685562fee3 req-4df71bcb-db94-4181-b308-5136f269575a service nova] Lock "7a7080a1-7ff9-4057-8043-614acd38b71f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:27:10 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3970ff4e-27bd-4ac6-bac9-20685562fee3 req-4df71bcb-db94-4181-b308-5136f269575a service nova] Lock "7a7080a1-7ff9-4057-8043-614acd38b71f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:27:10 user nova-compute[72809]: DEBUG nova.compute.manager [req-3970ff4e-27bd-4ac6-bac9-20685562fee3 req-4df71bcb-db94-4181-b308-5136f269575a service nova] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] No waiting events found dispatching network-vif-plugged-77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:27:10 user nova-compute[72809]: WARNING nova.compute.manager [req-3970ff4e-27bd-4ac6-bac9-20685562fee3 req-4df71bcb-db94-4181-b308-5136f269575a service nova] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Received unexpected event network-vif-plugged-77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c for instance with vm_state building and task_state spawning.
Aug 09 07:27:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:10 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:12 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691566032.2205567, 7a7080a1-7ff9-4057-8043-614acd38b71f => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:27:12 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] VM Resumed (Lifecycle Event)
Aug 09 07:27:12 user nova-compute[72809]: DEBUG nova.compute.manager [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 07:27:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 07:27:12 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Instance spawned successfully.
Aug 09 07:27:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 07:27:12 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:27:12 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:27:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:27:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:27:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:27:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:27:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:27:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:27:12 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:27:12 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691566032.222417, 7a7080a1-7ff9-4057-8043-614acd38b71f => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:27:12 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] VM Started (Lifecycle Event)
Aug 09 07:27:12 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:27:12 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:27:12 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:27:12 user nova-compute[72809]: INFO nova.compute.manager [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Took 4.98 seconds to spawn the instance on the hypervisor.
Aug 09 07:27:12 user nova-compute[72809]: DEBUG nova.compute.manager [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:27:12 user nova-compute[72809]: INFO nova.compute.manager [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Took 13.27 seconds to build instance.
Aug 09 07:27:12 user nova-compute[72809]: DEBUG nova.compute.manager [req-31912399-5b7f-4c02-a338-5019dbcabeda req-56bd75b0-d0fe-4b36-8d2e-4393701ffcf9 service nova] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Received event network-vif-plugged-77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:27:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-31912399-5b7f-4c02-a338-5019dbcabeda req-56bd75b0-d0fe-4b36-8d2e-4393701ffcf9 service nova] Acquiring lock "7a7080a1-7ff9-4057-8043-614acd38b71f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:27:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-31912399-5b7f-4c02-a338-5019dbcabeda req-56bd75b0-d0fe-4b36-8d2e-4393701ffcf9 service nova] Lock "7a7080a1-7ff9-4057-8043-614acd38b71f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:27:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-31912399-5b7f-4c02-a338-5019dbcabeda req-56bd75b0-d0fe-4b36-8d2e-4393701ffcf9 service nova] Lock "7a7080a1-7ff9-4057-8043-614acd38b71f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:27:12 user nova-compute[72809]: DEBUG nova.compute.manager [req-31912399-5b7f-4c02-a338-5019dbcabeda req-56bd75b0-d0fe-4b36-8d2e-4393701ffcf9 service nova] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] No waiting events found dispatching network-vif-plugged-77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:27:12 user nova-compute[72809]: WARNING nova.compute.manager [req-31912399-5b7f-4c02-a338-5019dbcabeda req-56bd75b0-d0fe-4b36-8d2e-4393701ffcf9 service nova] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Received unexpected event network-vif-plugged-77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c for instance with vm_state active and task_state None.
Aug 09 07:27:12 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-fb617bc1-303f-4da0-b2e2-68bcc1789e54 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "7a7080a1-7ff9-4057-8043-614acd38b71f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.362s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:27:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:14 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:27:18 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:27:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:27:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72809) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 07:27:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:27:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:27:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b7a2758c-c37f-4d54-907e-5be85a35784e tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Acquiring lock "748b208f-1bb7-46b2-b914-9f6bdd1f80af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:27:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b7a2758c-c37f-4d54-907e-5be85a35784e tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lock "748b208f-1bb7-46b2-b914-9f6bdd1f80af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:27:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b7a2758c-c37f-4d54-907e-5be85a35784e tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Acquiring lock "748b208f-1bb7-46b2-b914-9f6bdd1f80af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:27:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b7a2758c-c37f-4d54-907e-5be85a35784e tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lock "748b208f-1bb7-46b2-b914-9f6bdd1f80af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:27:23 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b7a2758c-c37f-4d54-907e-5be85a35784e tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lock "748b208f-1bb7-46b2-b914-9f6bdd1f80af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:27:23 user nova-compute[72809]: INFO nova.compute.manager [None req-b7a2758c-c37f-4d54-907e-5be85a35784e tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Terminating instance
Aug 09 07:27:23 user nova-compute[72809]: DEBUG nova.compute.manager [None req-b7a2758c-c37f-4d54-907e-5be85a35784e tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:27:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:24 user nova-compute[72809]: DEBUG nova.compute.manager [req-c6180cec-9eb8-44db-bdb7-be0e54de6432 req-b1752bf2-913b-4d3b-96c6-dddf0fc7c51e service nova] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Received event network-vif-unplugged-b4ff2651-84b6-43c3-8575-d144a6ff524e {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:27:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c6180cec-9eb8-44db-bdb7-be0e54de6432 req-b1752bf2-913b-4d3b-96c6-dddf0fc7c51e service nova] Acquiring lock "748b208f-1bb7-46b2-b914-9f6bdd1f80af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:27:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c6180cec-9eb8-44db-bdb7-be0e54de6432 req-b1752bf2-913b-4d3b-96c6-dddf0fc7c51e service nova] Lock "748b208f-1bb7-46b2-b914-9f6bdd1f80af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:27:24 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-c6180cec-9eb8-44db-bdb7-be0e54de6432 req-b1752bf2-913b-4d3b-96c6-dddf0fc7c51e service nova] Lock "748b208f-1bb7-46b2-b914-9f6bdd1f80af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:27:24 user nova-compute[72809]: DEBUG nova.compute.manager [req-c6180cec-9eb8-44db-bdb7-be0e54de6432 req-b1752bf2-913b-4d3b-96c6-dddf0fc7c51e service nova] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] No waiting events found dispatching network-vif-unplugged-b4ff2651-84b6-43c3-8575-d144a6ff524e {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:27:24 user nova-compute[72809]: DEBUG nova.compute.manager [req-c6180cec-9eb8-44db-bdb7-be0e54de6432 req-b1752bf2-913b-4d3b-96c6-dddf0fc7c51e service nova] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Received event network-vif-unplugged-b4ff2651-84b6-43c3-8575-d144a6ff524e for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:27:24 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Instance destroyed successfully.
Aug 09 07:27:24 user nova-compute[72809]: DEBUG nova.objects.instance [None req-b7a2758c-c37f-4d54-907e-5be85a35784e tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lazy-loading 'resources' on Instance uuid 748b208f-1bb7-46b2-b914-9f6bdd1f80af {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:27:24 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-b7a2758c-c37f-4d54-907e-5be85a35784e tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1048622649',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1048622649',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1048622',id=49,image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIK+35O4mXG7vXom5JwS0dsBYVn/W/4zZ+/VxkAxGKWHyZhBxmW2LCToquM9ga9b/Im7WcL09yDC3xA+eay8vkuf9SmHULZIIgwbEbZgN27+crS8N2wVAXwEaZi+iMK68A==',key_name='tempest-keypair-1911419323',keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:24:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56fbcffb883548f9a357ace3c4ba93fe',ramdisk_id='',reservation_id='r-32roandp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ba0d3e02-2e8a-403f-97cd-a9787534aa58',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1105544373',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:24:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2abed58a5e194074be138badc890880b',uuid=748b208f-1bb7-46b2-b914-9f6bdd1f80af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4ff2651-84b6-43c3-8575-d144a6ff524e", "address": "fa:16:3e:e1:81:c7", "network": {"id": "dae64e44-3d73-4cd2-8361-f98f60e96d0d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1582898053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fbcffb883548f9a357ace3c4ba93fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ff2651-84", "ovs_interfaceid": "b4ff2651-84b6-43c3-8575-d144a6ff524e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:27:24 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-b7a2758c-c37f-4d54-907e-5be85a35784e tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Converting VIF {"id": "b4ff2651-84b6-43c3-8575-d144a6ff524e", "address": "fa:16:3e:e1:81:c7", "network": {"id": "dae64e44-3d73-4cd2-8361-f98f60e96d0d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1582898053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fbcffb883548f9a357ace3c4ba93fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4ff2651-84", "ovs_interfaceid": "b4ff2651-84b6-43c3-8575-d144a6ff524e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:27:24 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-b7a2758c-c37f-4d54-907e-5be85a35784e tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:81:c7,bridge_name='br-int',has_traffic_filtering=True,id=b4ff2651-84b6-43c3-8575-d144a6ff524e,network=Network(dae64e44-3d73-4cd2-8361-f98f60e96d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4ff2651-84') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:27:24 user nova-compute[72809]: DEBUG os_vif [None req-b7a2758c-c37f-4d54-907e-5be85a35784e tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:81:c7,bridge_name='br-int',has_traffic_filtering=True,id=b4ff2651-84b6-43c3-8575-d144a6ff524e,network=Network(dae64e44-3d73-4cd2-8361-f98f60e96d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4ff2651-84') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:27:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4ff2651-84, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:27:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:27:24 user nova-compute[72809]: INFO os_vif [None req-b7a2758c-c37f-4d54-907e-5be85a35784e tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:81:c7,bridge_name='br-int',has_traffic_filtering=True,id=b4ff2651-84b6-43c3-8575-d144a6ff524e,network=Network(dae64e44-3d73-4cd2-8361-f98f60e96d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4ff2651-84')
Aug 09 07:27:24 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-b7a2758c-c37f-4d54-907e-5be85a35784e tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Deleting instance files /opt/stack/data/nova/instances/748b208f-1bb7-46b2-b914-9f6bdd1f80af_del
Aug 09 07:27:24 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-b7a2758c-c37f-4d54-907e-5be85a35784e tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Deletion of /opt/stack/data/nova/instances/748b208f-1bb7-46b2-b914-9f6bdd1f80af_del complete
Aug 09 07:27:24 user nova-compute[72809]: INFO nova.compute.manager [None req-b7a2758c-c37f-4d54-907e-5be85a35784e tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 09 07:27:24 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-b7a2758c-c37f-4d54-907e-5be85a35784e tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:27:24 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:27:24 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:27:25 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:27:25 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Took 0.85 seconds to deallocate network for instance.
Aug 09 07:27:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b7a2758c-c37f-4d54-907e-5be85a35784e tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:27:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b7a2758c-c37f-4d54-907e-5be85a35784e tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:27:25 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-b7a2758c-c37f-4d54-907e-5be85a35784e tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:27:25 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-b7a2758c-c37f-4d54-907e-5be85a35784e tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:27:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b7a2758c-c37f-4d54-907e-5be85a35784e tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:27:25 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-b7a2758c-c37f-4d54-907e-5be85a35784e tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Deleted allocations for instance 748b208f-1bb7-46b2-b914-9f6bdd1f80af
Aug 09 07:27:25 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-b7a2758c-c37f-4d54-907e-5be85a35784e tempest-TestServerVolumeAttachScenarioOldVersion-1105544373 tempest-TestServerVolumeAttachScenarioOldVersion-1105544373-project-member] Lock "748b208f-1bb7-46b2-b914-9f6bdd1f80af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.105s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:27:26 user nova-compute[72809]: DEBUG nova.compute.manager [req-5b442756-9f8e-4951-b56f-ad230af979ca req-4d4ce6ff-df8d-488d-8416-d33ac7df9dbc service nova] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Received event network-vif-plugged-b4ff2651-84b6-43c3-8575-d144a6ff524e {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:27:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5b442756-9f8e-4951-b56f-ad230af979ca req-4d4ce6ff-df8d-488d-8416-d33ac7df9dbc service nova] Acquiring lock "748b208f-1bb7-46b2-b914-9f6bdd1f80af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:27:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5b442756-9f8e-4951-b56f-ad230af979ca req-4d4ce6ff-df8d-488d-8416-d33ac7df9dbc service nova] Lock "748b208f-1bb7-46b2-b914-9f6bdd1f80af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:27:26 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5b442756-9f8e-4951-b56f-ad230af979ca req-4d4ce6ff-df8d-488d-8416-d33ac7df9dbc service nova] Lock "748b208f-1bb7-46b2-b914-9f6bdd1f80af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:27:26 user nova-compute[72809]: DEBUG nova.compute.manager [req-5b442756-9f8e-4951-b56f-ad230af979ca req-4d4ce6ff-df8d-488d-8416-d33ac7df9dbc service nova] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] No waiting events found dispatching network-vif-plugged-b4ff2651-84b6-43c3-8575-d144a6ff524e {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:27:26 user nova-compute[72809]: WARNING nova.compute.manager [req-5b442756-9f8e-4951-b56f-ad230af979ca req-4d4ce6ff-df8d-488d-8416-d33ac7df9dbc service nova] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Received unexpected event network-vif-plugged-b4ff2651-84b6-43c3-8575-d144a6ff524e for instance with vm_state deleted and task_state None.
Aug 09 07:27:26 user nova-compute[72809]: DEBUG nova.compute.manager [req-5b442756-9f8e-4951-b56f-ad230af979ca req-4d4ce6ff-df8d-488d-8416-d33ac7df9dbc service nova] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Received event network-vif-deleted-b4ff2651-84b6-43c3-8575-d144a6ff524e {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:27:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:34 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:34 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:39 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691566044.5888743, 748b208f-1bb7-46b2-b914-9f6bdd1f80af => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:27:39 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] VM Stopped (Lifecycle Event)
Aug 09 07:27:39 user nova-compute[72809]: DEBUG nova.compute.manager [None req-5b945ba2-f529-4f12-a68f-ab0f9206408e None None] [instance: 748b208f-1bb7-46b2-b914-9f6bdd1f80af] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:27:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:27:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:27:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72809) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 07:27:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:27:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:27:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:27:54 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:27:54 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 07:27:54 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Rebuilding the list of instances to heal {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 07:27:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-7a7080a1-7ff9-4057-8043-614acd38b71f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:27:54 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-7a7080a1-7ff9-4057-8043-614acd38b71f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:27:54 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 07:27:54 user nova-compute[72809]: DEBUG nova.objects.instance [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lazy-loading 'info_cache' on Instance uuid 7a7080a1-7ff9-4057-8043-614acd38b71f {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:27:55 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Updating instance_info_cache with network_info: [{"id": "77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c", "address": "fa:16:3e:cb:05:46", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77831bb5-c5", "ovs_interfaceid": "77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:27:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-7a7080a1-7ff9-4057-8043-614acd38b71f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:27:55 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 07:27:56 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:27:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:27:59 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:27:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:27:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:27:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:27:59 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 07:27:59 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:28:00 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:28:00 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:28:00 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=8700MB free_disk=25.163501739501953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 07:28:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:28:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:28:00 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 7a7080a1-7ff9-4057-8043-614acd38b71f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:28:00 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 07:28:00 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 07:28:00 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:28:00 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:28:00 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 07:28:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:28:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:28:08 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:28:08 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:28:08 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:28:08 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:28:08 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 07:28:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:28:09 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:28:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:28:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:28:16 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:28:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:28:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:28:20 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:28:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:28:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:28:34 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:28:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:28:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:28:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72809) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 07:28:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:28:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:28:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:28:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:28:49 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:28:51 user nova-compute[72809]: DEBUG nova.compute.manager [req-5224734b-4fdf-4201-a3e3-b55ff14e0ed6 req-582c2d9e-e49d-4e9a-9418-d380fc069ecb service nova] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Received event network-changed-77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:28:51 user nova-compute[72809]: DEBUG nova.compute.manager [req-5224734b-4fdf-4201-a3e3-b55ff14e0ed6 req-582c2d9e-e49d-4e9a-9418-d380fc069ecb service nova] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Refreshing instance network info cache due to event network-changed-77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:28:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5224734b-4fdf-4201-a3e3-b55ff14e0ed6 req-582c2d9e-e49d-4e9a-9418-d380fc069ecb service nova] Acquiring lock "refresh_cache-7a7080a1-7ff9-4057-8043-614acd38b71f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:28:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5224734b-4fdf-4201-a3e3-b55ff14e0ed6 req-582c2d9e-e49d-4e9a-9418-d380fc069ecb service nova] Acquired lock "refresh_cache-7a7080a1-7ff9-4057-8043-614acd38b71f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:28:51 user nova-compute[72809]: DEBUG nova.network.neutron [req-5224734b-4fdf-4201-a3e3-b55ff14e0ed6 req-582c2d9e-e49d-4e9a-9418-d380fc069ecb service nova] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Refreshing network info cache for port 77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:28:51 user nova-compute[72809]: DEBUG nova.network.neutron [req-5224734b-4fdf-4201-a3e3-b55ff14e0ed6 req-582c2d9e-e49d-4e9a-9418-d380fc069ecb service nova] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Updated VIF entry in instance network info cache for port 77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:28:51 user nova-compute[72809]: DEBUG nova.network.neutron [req-5224734b-4fdf-4201-a3e3-b55ff14e0ed6 req-582c2d9e-e49d-4e9a-9418-d380fc069ecb service nova] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Updating instance_info_cache with network_info: [{"id": "77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c", "address": "fa:16:3e:cb:05:46", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77831bb5-c5", "ovs_interfaceid": "77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:28:51 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-5224734b-4fdf-4201-a3e3-b55ff14e0ed6 req-582c2d9e-e49d-4e9a-9418-d380fc069ecb service nova] Releasing lock "refresh_cache-7a7080a1-7ff9-4057-8043-614acd38b71f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:28:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:28:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:28:55 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:28:55 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 07:28:55 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Rebuilding the list of instances to heal {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 07:28:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-7a7080a1-7ff9-4057-8043-614acd38b71f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:28:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-7a7080a1-7ff9-4057-8043-614acd38b71f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:28:55 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 07:28:55 user nova-compute[72809]: DEBUG nova.objects.instance [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lazy-loading 'info_cache' on Instance uuid 7a7080a1-7ff9-4057-8043-614acd38b71f {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:28:56 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Updating instance_info_cache with network_info: [{"id": "77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c", "address": "fa:16:3e:cb:05:46", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77831bb5-c5", "ovs_interfaceid": "77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:28:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-7a7080a1-7ff9-4057-8043-614acd38b71f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:28:56 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 07:28:58 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:28:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:28:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:29:01 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:29:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:29:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:29:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:29:01 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 07:29:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:29:02 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:29:02 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:29:02 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=8772MB free_disk=25.162151336669922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 07:29:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:29:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:29:02 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 7a7080a1-7ff9-4057-8043-614acd38b71f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:29:02 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 07:29:02 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 07:29:02 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:29:02 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:29:02 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 07:29:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:29:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "a9393776-c460-4fa2-b159-ac2168a520ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:29:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "a9393776-c460-4fa2-b159-ac2168a520ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:29:02 user nova-compute[72809]: DEBUG nova.compute.manager [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Starting instance... {{(pid=72809) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 07:29:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:29:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:29:03 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72809) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 07:29:03 user nova-compute[72809]: INFO nova.compute.claims [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Claim successful on node user
Aug 09 07:29:03 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:29:03 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:29:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.213s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:29:03 user nova-compute[72809]: DEBUG nova.compute.manager [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Start building networks asynchronously for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 07:29:03 user nova-compute[72809]: DEBUG nova.compute.manager [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Allocating IP information in the background. {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 07:29:03 user nova-compute[72809]: DEBUG nova.network.neutron [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] allocate_for_instance() {{(pid=72809) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 07:29:03 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 07:29:03 user nova-compute[72809]: DEBUG nova.compute.manager [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Start building block device mappings for instance. {{(pid=72809) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 07:29:03 user nova-compute[72809]: INFO nova.virt.block_device [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Booting with volume 9e579133-987f-42e3-bc87-b2f013141335 at /dev/vda
Aug 09 07:29:03 user nova-compute[72809]: DEBUG nova.policy [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a7859a38408b426eb9a14ef003483bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8241b9b47eab16a6e37a9cc5f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72809) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 07:29:03 user nova-compute[72809]: DEBUG os_brick.utils [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:29:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:29:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:29:03 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d304755-ba1f-414b-8d5f-b0510c0b3870]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f4e29fd9c8a2\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:29:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:29:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:29:03 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37c1ed1-f867-43d1-be23-55d3db9ea4f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:29:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:29:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:29:03 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec471cb-ce73-4967-83a0-267da53996b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:29:03 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de558da-b1ea-4f88-a309-dc59083e01b0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:29:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Running cmd (subprocess): nvme version {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:29:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] 'nvme version' failed. Not Retrying. {{(pid=72809) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:29:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] nvme not present on system {{(pid=72809) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 07:29:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:29:03 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 07:29:03 user nova-compute[72809]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 07:29:03 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b6d0c0-9948-408a-b13b-d2f2eab7c642]: (4, '') {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:29:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72809) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 07:29:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 07:29:03 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.lightos [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] LIGHTOS: no hostnqn found. {{(pid=72809) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 07:29:03 user nova-compute[72809]: DEBUG os_brick.utils [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f4e29fd9c8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:29:03 user nova-compute[72809]: DEBUG nova.virt.block_device [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Updating existing volume attachment record: edcdd68c-0748-4467-bdfc-d631865426cc {{(pid=72809) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 07:29:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:29:04 user nova-compute[72809]: DEBUG nova.network.neutron [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Successfully created port: b1379c35-425a-442e-85c0-593c48b5160c {{(pid=72809) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 07:29:04 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:29:04 user nova-compute[72809]: DEBUG nova.network.neutron [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Successfully updated port: b1379c35-425a-442e-85c0-593c48b5160c {{(pid=72809) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 07:29:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "refresh_cache-a9393776-c460-4fa2-b159-ac2168a520ff" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:29:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquired lock "refresh_cache-a9393776-c460-4fa2-b159-ac2168a520ff" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:29:04 user nova-compute[72809]: DEBUG nova.network.neutron [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Building network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 07:29:04 user nova-compute[72809]: DEBUG nova.compute.manager [req-e4608d82-db8e-4bb2-a4c0-719db615e729 req-8d356ff7-abda-4aa1-92d3-e8618fd820a5 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Received event network-changed-b1379c35-425a-442e-85c0-593c48b5160c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:29:04 user nova-compute[72809]: DEBUG nova.compute.manager [req-e4608d82-db8e-4bb2-a4c0-719db615e729 req-8d356ff7-abda-4aa1-92d3-e8618fd820a5 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Refreshing instance network info cache due to event network-changed-b1379c35-425a-442e-85c0-593c48b5160c. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:29:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e4608d82-db8e-4bb2-a4c0-719db615e729 req-8d356ff7-abda-4aa1-92d3-e8618fd820a5 service nova] Acquiring lock "refresh_cache-a9393776-c460-4fa2-b159-ac2168a520ff" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:29:04 user nova-compute[72809]: DEBUG nova.network.neutron [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Instance cache missing network info. {{(pid=72809) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 07:29:05 user nova-compute[72809]: DEBUG nova.network.neutron [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Updating instance_info_cache with network_info: [{"id": "b1379c35-425a-442e-85c0-593c48b5160c", "address": "fa:16:3e:f9:c6:1d", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1379c35-42", "ovs_interfaceid": "b1379c35-425a-442e-85c0-593c48b5160c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:29:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Releasing lock "refresh_cache-a9393776-c460-4fa2-b159-ac2168a520ff" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:29:05 user nova-compute[72809]: DEBUG nova.compute.manager [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Instance network_info: |[{"id": "b1379c35-425a-442e-85c0-593c48b5160c", "address": "fa:16:3e:f9:c6:1d", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1379c35-42", "ovs_interfaceid": "b1379c35-425a-442e-85c0-593c48b5160c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72809) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 07:29:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e4608d82-db8e-4bb2-a4c0-719db615e729 req-8d356ff7-abda-4aa1-92d3-e8618fd820a5 service nova] Acquired lock "refresh_cache-a9393776-c460-4fa2-b159-ac2168a520ff" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:29:05 user nova-compute[72809]: DEBUG nova.network.neutron [req-e4608d82-db8e-4bb2-a4c0-719db615e729 req-8d356ff7-abda-4aa1-92d3-e8618fd820a5 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Refreshing network info cache for port b1379c35-425a-442e-85c0-593c48b5160c {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:29:05 user nova-compute[72809]: DEBUG nova.network.neutron [req-e4608d82-db8e-4bb2-a4c0-719db615e729 req-8d356ff7-abda-4aa1-92d3-e8618fd820a5 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Updated VIF entry in instance network info cache for port b1379c35-425a-442e-85c0-593c48b5160c. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:29:05 user nova-compute[72809]: DEBUG nova.network.neutron [req-e4608d82-db8e-4bb2-a4c0-719db615e729 req-8d356ff7-abda-4aa1-92d3-e8618fd820a5 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Updating instance_info_cache with network_info: [{"id": "b1379c35-425a-442e-85c0-593c48b5160c", "address": "fa:16:3e:f9:c6:1d", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1379c35-42", "ovs_interfaceid": "b1379c35-425a-442e-85c0-593c48b5160c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:29:05 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-e4608d82-db8e-4bb2-a4c0-719db615e729 req-8d356ff7-abda-4aa1-92d3-e8618fd820a5 service nova] Releasing lock "refresh_cache-a9393776-c460-4fa2-b159-ac2168a520ff" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:29:09 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:29:09 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 07:29:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:29:09 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:29:09 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:29:09 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:29:10 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:29:10 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG nova.compute.manager [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Start spawning the instance on the hypervisor. {{(pid=72809) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Creating instance directory {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 07:29:11 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Creating image(s)
Aug 09 07:29:11 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Did not create local disks {{(pid=72809) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Ensure instance console log exists: /opt/stack/data/nova/instances/a9393776-c460-4fa2-b159-ac2168a520ff/console.log {{(pid=72809) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Start _get_guest_xml network_info=[{"id": "b1379c35-425a-442e-85c0-593c48b5160c", "address": "fa:16:3e:f9:c6:1d", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1379c35-42", "ovs_interfaceid": "b1379c35-425a-442e-85c0-593c48b5160c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZylUdCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a9393776-c460-4fa2-b159-ac2168a520ff', 'attached_at': '', 'detached_at': '', 'volume_id': '9e579133-987f-42e3-bc87-b2f013141335', 'serial': '9e579133-987f-42e3-bc87-b2f013141335'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': 0, 'attachment_id': 'edcdd68c-0748-4467-bdfc-d631865426cc', 'volume_type': None} {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 07:29:11 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:29:11 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:29:11 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] CPU controller missing on host. {{(pid=72809) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG nova.virt.libvirt.host [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] CPU controller found on host. {{(pid=72809) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72809) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T06:44:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Flavor limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Image limits 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Flavor pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Image pref 0:0:0 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Got 1 possible topologies {{(pid=72809) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG nova.virt.hardware [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72809) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Calling os-brick to attach iSCSI Volume {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZylUdCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:29:11 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:29:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:29:11 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:29:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:29:11 user nova-compute[72809]: INFO os_brick.initiator.connectors.iscsi [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335 -p 172.16.0.220:3260 {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4bca80-f4ae-45ab-8ca8-5f013ce19f60]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 07:29:11 user nova-compute[72809]:  {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335 -p 172.16.0.220:3260 --interface default --op new {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[1304c3c4-79a5-434b-bb0c-d1b84b64212f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335] added\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335] added
Aug 09 07:29:11 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8487ae-9af9-4b24-908a-a241e0159e1f]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26e72fe-e559-4be6-9a8b-b3b5ee45db03]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tZylUdCI {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tZylUdCI" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[1268af72-c0a9-44a8-97d6-4d8675b5855c]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tZylUdCI'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[269c98ea-dfcd-4319-b582-2069bdd2cc50]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[287d969e-e096-470b-ae20-977d322614d5]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 (non-flash)
Aug 09 07:29:11 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 (non-flash)
Aug 09 07:29:11 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335 -p 172.16.0.220:3260 --login {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[543618f0-9443-42d4-bb74-dd489d1eb35c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335, portal: 172.16.0.220,3260]
Aug 09 07:29:11 user nova-compute[72809]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335, portal: 172.16.0.220,3260] successful.
Aug 09 07:29:11 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[14230eec-2663-4cc0-8f28-ba468cb5b9cd]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c14c61c-e6fc-48fb-accd-0649027f0b63]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 (non-flash)
Aug 09 07:29:11 user nova-compute[72809]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335 (non-flash)
Aug 09 07:29:11 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 (non-flash)
Aug 09 07:29:11 user nova-compute[72809]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335 (non-flash)
Aug 09 07:29:11 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Connected to 172.16.0.220:3260 {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=72809) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72809) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65993cd-f86a-48a9-9b72-72f4a343510e]: (4, ('- - 0', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:29:11 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: None {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:29:12 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72809) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 07:29:12 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZylUdCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72809) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 07:29:12 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:29:12 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23165366166613932', 'path': '/dev/sdc'} {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:29:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165366166613932', 'path': '/dev/sdc'} {{(pid=72809) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 07:29:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:29:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1069192733',display_name='tempest-TestVolumeBootPattern-server-1069192733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1069192733',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjnvBkBtyKj+KLLI54SBkh5HnXtHKYGIvHET6AohUoc067yu29rFAuYqAakYT1y07YcSfZK33sZkxNs57WMr0x24BQA2oeNeplu2EJ8SgGH8Bvo7ooGDsRYmmPpPFSHcQ==',key_name='tempest-TestVolumeBootPattern-1169256863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cdcd8241b9b47eab16a6e37a9cc5f54',ramdisk_id='',reservation_id='r-j3s8mcch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-224847517',owner_user_name='tempest-TestVolumeBootPattern-224847517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:29:03Z,user_data=None,user_id='a7859a38408b426eb9a14ef003483bd3',uuid=a9393776-c460-4fa2-b159-ac2168a520ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1379c35-425a-442e-85c0-593c48b5160c", "address": "fa:16:3e:f9:c6:1d", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1379c35-42", "ovs_interfaceid": "b1379c35-425a-442e-85c0-593c48b5160c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72809) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 07:29:12 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converting VIF {"id": "b1379c35-425a-442e-85c0-593c48b5160c", "address": "fa:16:3e:f9:c6:1d", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1379c35-42", "ovs_interfaceid": "b1379c35-425a-442e-85c0-593c48b5160c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:29:12 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:c6:1d,bridge_name='br-int',has_traffic_filtering=True,id=b1379c35-425a-442e-85c0-593c48b5160c,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1379c35-42') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:29:12 user nova-compute[72809]: DEBUG nova.objects.instance [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lazy-loading 'pci_devices' on Instance uuid a9393776-c460-4fa2-b159-ac2168a520ff {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:29:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] End _get_guest_xml xml=<domain type="kvm">
Aug 09 07:29:12 user nova-compute[72809]:   <uuid>a9393776-c460-4fa2-b159-ac2168a520ff</uuid>
Aug 09 07:29:12 user nova-compute[72809]:   <name>instance-00000033</name>
Aug 09 07:29:12 user nova-compute[72809]:   <memory>524288</memory>
Aug 09 07:29:12 user nova-compute[72809]:   <vcpu>1</vcpu>
Aug 09 07:29:12 user nova-compute[72809]:   <metadata>
Aug 09 07:29:12 user nova-compute[72809]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 07:29:12 user nova-compute[72809]:       <nova:package version="0.0.0"/>
Aug 09 07:29:12 user nova-compute[72809]:       <nova:name>tempest-TestVolumeBootPattern-server-1069192733</nova:name>
Aug 09 07:29:12 user nova-compute[72809]:       <nova:creationTime>2023-08-09 07:29:11</nova:creationTime>
Aug 09 07:29:12 user nova-compute[72809]:       <nova:flavor name="m1.tiny">
Aug 09 07:29:12 user nova-compute[72809]:         <nova:memory>512</nova:memory>
Aug 09 07:29:12 user nova-compute[72809]:         <nova:disk>1</nova:disk>
Aug 09 07:29:12 user nova-compute[72809]:         <nova:swap>0</nova:swap>
Aug 09 07:29:12 user nova-compute[72809]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 07:29:12 user nova-compute[72809]:         <nova:vcpus>1</nova:vcpus>
Aug 09 07:29:12 user nova-compute[72809]:       </nova:flavor>
Aug 09 07:29:12 user nova-compute[72809]:       <nova:owner>
Aug 09 07:29:12 user nova-compute[72809]:         <nova:user uuid="a7859a38408b426eb9a14ef003483bd3">tempest-TestVolumeBootPattern-224847517-project-member</nova:user>
Aug 09 07:29:12 user nova-compute[72809]:         <nova:project uuid="8cdcd8241b9b47eab16a6e37a9cc5f54">tempest-TestVolumeBootPattern-224847517</nova:project>
Aug 09 07:29:12 user nova-compute[72809]:       </nova:owner>
Aug 09 07:29:12 user nova-compute[72809]:       <nova:ports>
Aug 09 07:29:12 user nova-compute[72809]:         <nova:port uuid="b1379c35-425a-442e-85c0-593c48b5160c">
Aug 09 07:29:12 user nova-compute[72809]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 07:29:12 user nova-compute[72809]:         </nova:port>
Aug 09 07:29:12 user nova-compute[72809]:       </nova:ports>
Aug 09 07:29:12 user nova-compute[72809]:     </nova:instance>
Aug 09 07:29:12 user nova-compute[72809]:   </metadata>
Aug 09 07:29:12 user nova-compute[72809]:   <sysinfo type="smbios">
Aug 09 07:29:12 user nova-compute[72809]:     <system>
Aug 09 07:29:12 user nova-compute[72809]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 07:29:12 user nova-compute[72809]:       <entry name="product">OpenStack Nova</entry>
Aug 09 07:29:12 user nova-compute[72809]:       <entry name="version">0.0.0</entry>
Aug 09 07:29:12 user nova-compute[72809]:       <entry name="serial">a9393776-c460-4fa2-b159-ac2168a520ff</entry>
Aug 09 07:29:12 user nova-compute[72809]:       <entry name="uuid">a9393776-c460-4fa2-b159-ac2168a520ff</entry>
Aug 09 07:29:12 user nova-compute[72809]:       <entry name="family">Virtual Machine</entry>
Aug 09 07:29:12 user nova-compute[72809]:     </system>
Aug 09 07:29:12 user nova-compute[72809]:   </sysinfo>
Aug 09 07:29:12 user nova-compute[72809]:   <os>
Aug 09 07:29:12 user nova-compute[72809]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 07:29:12 user nova-compute[72809]:     <boot dev="hd"/>
Aug 09 07:29:12 user nova-compute[72809]:     <smbios mode="sysinfo"/>
Aug 09 07:29:12 user nova-compute[72809]:   </os>
Aug 09 07:29:12 user nova-compute[72809]:   <features>
Aug 09 07:29:12 user nova-compute[72809]:     <acpi/>
Aug 09 07:29:12 user nova-compute[72809]:     <apic/>
Aug 09 07:29:12 user nova-compute[72809]:     <vmcoreinfo/>
Aug 09 07:29:12 user nova-compute[72809]:   </features>
Aug 09 07:29:12 user nova-compute[72809]:   <clock offset="utc">
Aug 09 07:29:12 user nova-compute[72809]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 07:29:12 user nova-compute[72809]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 07:29:12 user nova-compute[72809]:     <timer name="hpet" present="no"/>
Aug 09 07:29:12 user nova-compute[72809]:   </clock>
Aug 09 07:29:12 user nova-compute[72809]:   <cpu mode="custom" match="exact">
Aug 09 07:29:12 user nova-compute[72809]:     <model>Nehalem</model>
Aug 09 07:29:12 user nova-compute[72809]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 07:29:12 user nova-compute[72809]:   </cpu>
Aug 09 07:29:12 user nova-compute[72809]:   <devices>
Aug 09 07:29:12 user nova-compute[72809]:     <disk type="block" device="disk">
Aug 09 07:29:12 user nova-compute[72809]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 07:29:12 user nova-compute[72809]:       <source dev="/dev/sdc"/>
Aug 09 07:29:12 user nova-compute[72809]:       <target dev="vda" bus="virtio"/>
Aug 09 07:29:12 user nova-compute[72809]:       <serial>9e579133-987f-42e3-bc87-b2f013141335</serial>
Aug 09 07:29:12 user nova-compute[72809]:     </disk>
Aug 09 07:29:12 user nova-compute[72809]:     <interface type="ethernet">
Aug 09 07:29:12 user nova-compute[72809]:       <mac address="fa:16:3e:f9:c6:1d"/>
Aug 09 07:29:12 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:29:12 user nova-compute[72809]:       <mtu size="1442"/>
Aug 09 07:29:12 user nova-compute[72809]:       <target dev="tapb1379c35-42"/>
Aug 09 07:29:12 user nova-compute[72809]:     </interface>
Aug 09 07:29:12 user nova-compute[72809]:     <serial type="pty">
Aug 09 07:29:12 user nova-compute[72809]:       <log file="/opt/stack/data/nova/instances/a9393776-c460-4fa2-b159-ac2168a520ff/console.log" append="off"/>
Aug 09 07:29:12 user nova-compute[72809]:     </serial>
Aug 09 07:29:12 user nova-compute[72809]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 07:29:12 user nova-compute[72809]:     <video>
Aug 09 07:29:12 user nova-compute[72809]:       <model type="virtio"/>
Aug 09 07:29:12 user nova-compute[72809]:     </video>
Aug 09 07:29:12 user nova-compute[72809]:     <rng model="virtio">
Aug 09 07:29:12 user nova-compute[72809]:       <backend model="random">/dev/urandom</backend>
Aug 09 07:29:12 user nova-compute[72809]:     </rng>
Aug 09 07:29:12 user nova-compute[72809]:     <controller type="usb" index="0" model="none"/>
Aug 09 07:29:12 user nova-compute[72809]:     <memballoon model="virtio">
Aug 09 07:29:12 user nova-compute[72809]:       <stats period="10"/>
Aug 09 07:29:12 user nova-compute[72809]:     </memballoon>
Aug 09 07:29:12 user nova-compute[72809]:   </devices>
Aug 09 07:29:12 user nova-compute[72809]: </domain>
Aug 09 07:29:12 user nova-compute[72809]:  {{(pid=72809) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 07:29:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:29:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1069192733',display_name='tempest-TestVolumeBootPattern-server-1069192733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1069192733',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjnvBkBtyKj+KLLI54SBkh5HnXtHKYGIvHET6AohUoc067yu29rFAuYqAakYT1y07YcSfZK33sZkxNs57WMr0x24BQA2oeNeplu2EJ8SgGH8Bvo7ooGDsRYmmPpPFSHcQ==',key_name='tempest-TestVolumeBootPattern-1169256863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cdcd8241b9b47eab16a6e37a9cc5f54',ramdisk_id='',reservation_id='r-j3s8mcch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-224847517',owner_user_name='tempest-TestVolumeBootPattern-224847517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T07:29:03Z,user_data=None,user_id='a7859a38408b426eb9a14ef003483bd3',uuid=a9393776-c460-4fa2-b159-ac2168a520ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1379c35-425a-442e-85c0-593c48b5160c", "address": "fa:16:3e:f9:c6:1d", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1379c35-42", "ovs_interfaceid": "b1379c35-425a-442e-85c0-593c48b5160c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 07:29:12 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converting VIF {"id": "b1379c35-425a-442e-85c0-593c48b5160c", "address": "fa:16:3e:f9:c6:1d", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1379c35-42", "ovs_interfaceid": "b1379c35-425a-442e-85c0-593c48b5160c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:29:12 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:c6:1d,bridge_name='br-int',has_traffic_filtering=True,id=b1379c35-425a-442e-85c0-593c48b5160c,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1379c35-42') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:29:12 user nova-compute[72809]: DEBUG os_vif [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:c6:1d,bridge_name='br-int',has_traffic_filtering=True,id=b1379c35-425a-442e-85c0-593c48b5160c,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1379c35-42') {{(pid=72809) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 07:29:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:29:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:29:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 07:29:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:29:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1379c35-42, may_exist=True, interface_attrs={}) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:29:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb1379c35-42, col_values=(('external_ids', {'iface-id': 'b1379c35-425a-442e-85c0-593c48b5160c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:c6:1d', 'vm-uuid': 'a9393776-c460-4fa2-b159-ac2168a520ff'}),), if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:29:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:29:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:29:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:29:12 user nova-compute[72809]: INFO os_vif [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:c6:1d,bridge_name='br-int',has_traffic_filtering=True,id=b1379c35-425a-442e-85c0-593c48b5160c,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1379c35-42')
Aug 09 07:29:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] No BDM found with device name vda, not building metadata. {{(pid=72809) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 07:29:12 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] No VIF found with MAC fa:16:3e:f9:c6:1d, not building metadata {{(pid=72809) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 07:29:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:29:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:29:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:29:14 user nova-compute[72809]: DEBUG nova.compute.manager [req-11a5f19a-2c0a-4186-a521-81e119667717 req-f8c728cb-2b0e-49a9-ae6d-d875c041a246 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Received event network-vif-plugged-b1379c35-425a-442e-85c0-593c48b5160c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:29:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-11a5f19a-2c0a-4186-a521-81e119667717 req-f8c728cb-2b0e-49a9-ae6d-d875c041a246 service nova] Acquiring lock "a9393776-c460-4fa2-b159-ac2168a520ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:29:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-11a5f19a-2c0a-4186-a521-81e119667717 req-f8c728cb-2b0e-49a9-ae6d-d875c041a246 service nova] Lock "a9393776-c460-4fa2-b159-ac2168a520ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:29:14 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-11a5f19a-2c0a-4186-a521-81e119667717 req-f8c728cb-2b0e-49a9-ae6d-d875c041a246 service nova] Lock "a9393776-c460-4fa2-b159-ac2168a520ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:29:14 user nova-compute[72809]: DEBUG nova.compute.manager [req-11a5f19a-2c0a-4186-a521-81e119667717 req-f8c728cb-2b0e-49a9-ae6d-d875c041a246 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] No waiting events found dispatching network-vif-plugged-b1379c35-425a-442e-85c0-593c48b5160c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:29:14 user nova-compute[72809]: WARNING nova.compute.manager [req-11a5f19a-2c0a-4186-a521-81e119667717 req-f8c728cb-2b0e-49a9-ae6d-d875c041a246 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Received unexpected event network-vif-plugged-b1379c35-425a-442e-85c0-593c48b5160c for instance with vm_state building and task_state spawning.
Aug 09 07:29:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:29:14 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:29:16 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691566156.365325, a9393776-c460-4fa2-b159-ac2168a520ff => Resumed> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:29:16 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] VM Resumed (Lifecycle Event)
Aug 09 07:29:16 user nova-compute[72809]: DEBUG nova.compute.manager [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Instance event wait completed in 0 seconds for  {{(pid=72809) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 07:29:16 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Guest created on hypervisor {{(pid=72809) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 07:29:16 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Instance spawned successfully.
Aug 09 07:29:16 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 07:29:16 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:29:16 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:29:16 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Found default for hw_cdrom_bus of ide {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:29:16 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Found default for hw_disk_bus of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:29:16 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Found default for hw_input_bus of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:29:16 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Found default for hw_pointer_model of None {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:29:16 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Found default for hw_video_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:29:16 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Found default for hw_vif_model of virtio {{(pid=72809) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 07:29:16 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:29:16 user nova-compute[72809]: DEBUG nova.virt.driver [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] Emitting event <LifecycleEvent: 1691566156.3669827, a9393776-c460-4fa2-b159-ac2168a520ff => Started> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:29:16 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] VM Started (Lifecycle Event)
Aug 09 07:29:16 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:29:16 user nova-compute[72809]: DEBUG nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72809) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 07:29:16 user nova-compute[72809]: INFO nova.compute.manager [None req-bc3f0a0c-d716-4019-94b1-0ae65aad1cd9 None None] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 07:29:16 user nova-compute[72809]: INFO nova.compute.manager [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Took 4.99 seconds to spawn the instance on the hypervisor.
Aug 09 07:29:16 user nova-compute[72809]: DEBUG nova.compute.manager [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:29:16 user nova-compute[72809]: DEBUG nova.compute.manager [req-8c749c93-afdd-434f-a9df-4433bd712ae8 req-ee2a44bf-68af-4c74-9e5f-69197dcd96bd service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Received event network-vif-plugged-b1379c35-425a-442e-85c0-593c48b5160c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:29:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-8c749c93-afdd-434f-a9df-4433bd712ae8 req-ee2a44bf-68af-4c74-9e5f-69197dcd96bd service nova] Acquiring lock "a9393776-c460-4fa2-b159-ac2168a520ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:29:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-8c749c93-afdd-434f-a9df-4433bd712ae8 req-ee2a44bf-68af-4c74-9e5f-69197dcd96bd service nova] Lock "a9393776-c460-4fa2-b159-ac2168a520ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:29:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-8c749c93-afdd-434f-a9df-4433bd712ae8 req-ee2a44bf-68af-4c74-9e5f-69197dcd96bd service nova] Lock "a9393776-c460-4fa2-b159-ac2168a520ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:29:16 user nova-compute[72809]: DEBUG nova.compute.manager [req-8c749c93-afdd-434f-a9df-4433bd712ae8 req-ee2a44bf-68af-4c74-9e5f-69197dcd96bd service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] No waiting events found dispatching network-vif-plugged-b1379c35-425a-442e-85c0-593c48b5160c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:29:16 user nova-compute[72809]: WARNING nova.compute.manager [req-8c749c93-afdd-434f-a9df-4433bd712ae8 req-ee2a44bf-68af-4c74-9e5f-69197dcd96bd service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Received unexpected event network-vif-plugged-b1379c35-425a-442e-85c0-593c48b5160c for instance with vm_state building and task_state spawning.
Aug 09 07:29:16 user nova-compute[72809]: INFO nova.compute.manager [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Took 13.51 seconds to build instance.
Aug 09 07:29:16 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-26886877-fb24-41f8-b116-ee1e1254d6c3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "a9393776-c460-4fa2-b159-ac2168a520ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.598s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:29:16 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:29:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:29:19 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:29:21 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:29:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:29:24 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:29:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:29:29 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:29:32 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:29:34 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:29:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:29:39 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:29:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:29:44 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:29:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:29:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:29:55 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:29:55 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 07:29:55 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Rebuilding the list of instances to heal {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 07:29:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-7a7080a1-7ff9-4057-8043-614acd38b71f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:29:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-7a7080a1-7ff9-4057-8043-614acd38b71f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:29:55 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 07:29:55 user nova-compute[72809]: DEBUG nova.objects.instance [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lazy-loading 'info_cache' on Instance uuid 7a7080a1-7ff9-4057-8043-614acd38b71f {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:29:56 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Updating instance_info_cache with network_info: [{"id": "77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c", "address": "fa:16:3e:cb:05:46", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77831bb5-c5", "ovs_interfaceid": "77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:29:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-7a7080a1-7ff9-4057-8043-614acd38b71f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:29:56 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 07:29:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:29:58 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:30:01 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:30:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:30:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:30:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:30:01 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 07:30:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:30:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:30:02 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:30:02 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:30:02 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=8690MB free_disk=25.160503387451172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 07:30:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:30:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:30:02 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 7a7080a1-7ff9-4057-8043-614acd38b71f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:30:02 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance a9393776-c460-4fa2-b159-ac2168a520ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:30:02 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 07:30:02 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 07:30:02 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:30:02 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:30:02 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 07:30:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.364s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:30:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:30:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:30:08 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:30:08 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Cleaning up deleted instances {{(pid=72809) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 07:30:08 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] There are 0 instances to clean {{(pid=72809) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 07:30:09 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:30:09 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 07:30:10 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:30:10 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:30:10 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:30:12 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:30:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:30:13 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:30:13 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72809) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 07:30:14 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:30:17 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:30:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:30:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:30:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:30:32 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:30:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:30:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:30:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:30:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:30:54 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:30:55 user nova-compute[72809]: DEBUG nova.compute.manager [req-1c98974e-1847-42e9-9195-e58d64b6617c req-d944d276-ad3e-419d-94f6-6f14d0916418 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Received event network-changed-b1379c35-425a-442e-85c0-593c48b5160c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:30:55 user nova-compute[72809]: DEBUG nova.compute.manager [req-1c98974e-1847-42e9-9195-e58d64b6617c req-d944d276-ad3e-419d-94f6-6f14d0916418 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Refreshing instance network info cache due to event network-changed-b1379c35-425a-442e-85c0-593c48b5160c. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:30:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1c98974e-1847-42e9-9195-e58d64b6617c req-d944d276-ad3e-419d-94f6-6f14d0916418 service nova] Acquiring lock "refresh_cache-a9393776-c460-4fa2-b159-ac2168a520ff" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:30:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1c98974e-1847-42e9-9195-e58d64b6617c req-d944d276-ad3e-419d-94f6-6f14d0916418 service nova] Acquired lock "refresh_cache-a9393776-c460-4fa2-b159-ac2168a520ff" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:30:55 user nova-compute[72809]: DEBUG nova.network.neutron [req-1c98974e-1847-42e9-9195-e58d64b6617c req-d944d276-ad3e-419d-94f6-6f14d0916418 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Refreshing network info cache for port b1379c35-425a-442e-85c0-593c48b5160c {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:30:55 user nova-compute[72809]: DEBUG nova.network.neutron [req-1c98974e-1847-42e9-9195-e58d64b6617c req-d944d276-ad3e-419d-94f6-6f14d0916418 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Updated VIF entry in instance network info cache for port b1379c35-425a-442e-85c0-593c48b5160c. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:30:55 user nova-compute[72809]: DEBUG nova.network.neutron [req-1c98974e-1847-42e9-9195-e58d64b6617c req-d944d276-ad3e-419d-94f6-6f14d0916418 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Updating instance_info_cache with network_info: [{"id": "b1379c35-425a-442e-85c0-593c48b5160c", "address": "fa:16:3e:f9:c6:1d", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1379c35-42", "ovs_interfaceid": "b1379c35-425a-442e-85c0-593c48b5160c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:30:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-1c98974e-1847-42e9-9195-e58d64b6617c req-d944d276-ad3e-419d-94f6-6f14d0916418 service nova] Releasing lock "refresh_cache-a9393776-c460-4fa2-b159-ac2168a520ff" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:30:55 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:30:55 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 07:30:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-a9393776-c460-4fa2-b159-ac2168a520ff" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:30:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-a9393776-c460-4fa2-b159-ac2168a520ff" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:30:55 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 07:30:56 user nova-compute[72809]: DEBUG nova.compute.manager [req-41477852-d143-47c5-8b09-524d42bde767 req-5897d9ae-44ab-4209-ab36-aa2b99b5b980 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Received event network-changed-b1379c35-425a-442e-85c0-593c48b5160c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:30:56 user nova-compute[72809]: DEBUG nova.compute.manager [req-41477852-d143-47c5-8b09-524d42bde767 req-5897d9ae-44ab-4209-ab36-aa2b99b5b980 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Refreshing instance network info cache due to event network-changed-b1379c35-425a-442e-85c0-593c48b5160c. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:30:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-41477852-d143-47c5-8b09-524d42bde767 req-5897d9ae-44ab-4209-ab36-aa2b99b5b980 service nova] Acquiring lock "refresh_cache-a9393776-c460-4fa2-b159-ac2168a520ff" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:30:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "a9393776-c460-4fa2-b159-ac2168a520ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:30:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "a9393776-c460-4fa2-b159-ac2168a520ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:30:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "a9393776-c460-4fa2-b159-ac2168a520ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:30:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "a9393776-c460-4fa2-b159-ac2168a520ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:30:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "a9393776-c460-4fa2-b159-ac2168a520ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:30:56 user nova-compute[72809]: INFO nova.compute.manager [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Terminating instance
Aug 09 07:30:56 user nova-compute[72809]: DEBUG nova.compute.manager [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:30:56 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Updating instance_info_cache with network_info: [{"id": "b1379c35-425a-442e-85c0-593c48b5160c", "address": "fa:16:3e:f9:c6:1d", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1379c35-42", "ovs_interfaceid": "b1379c35-425a-442e-85c0-593c48b5160c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:30:56 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:30:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-a9393776-c460-4fa2-b159-ac2168a520ff" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:30:56 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 07:30:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-41477852-d143-47c5-8b09-524d42bde767 req-5897d9ae-44ab-4209-ab36-aa2b99b5b980 service nova] Acquired lock "refresh_cache-a9393776-c460-4fa2-b159-ac2168a520ff" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:30:56 user nova-compute[72809]: DEBUG nova.network.neutron [req-41477852-d143-47c5-8b09-524d42bde767 req-5897d9ae-44ab-4209-ab36-aa2b99b5b980 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Refreshing network info cache for port b1379c35-425a-442e-85c0-593c48b5160c {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:30:56 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:30:56 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:30:56 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:30:56 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:30:56 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:30:56 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:30:56 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Instance destroyed successfully.
Aug 09 07:30:56 user nova-compute[72809]: DEBUG nova.objects.instance [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lazy-loading 'resources' on Instance uuid a9393776-c460-4fa2-b159-ac2168a520ff {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:30:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:29:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1069192733',display_name='tempest-TestVolumeBootPattern-server-1069192733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1069192733',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjnvBkBtyKj+KLLI54SBkh5HnXtHKYGIvHET6AohUoc067yu29rFAuYqAakYT1y07YcSfZK33sZkxNs57WMr0x24BQA2oeNeplu2EJ8SgGH8Bvo7ooGDsRYmmPpPFSHcQ==',key_name='tempest-TestVolumeBootPattern-1169256863',keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:29:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8cdcd8241b9b47eab16a6e37a9cc5f54',ramdisk_id='',reservation_id='r-j3s8mcch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-224847517',owner_user_name='tempest-TestVolumeBootPattern-224847517-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:29:17Z,user_data=None,user_id='a7859a38408b426eb9a14ef003483bd3',uuid=a9393776-c460-4fa2-b159-ac2168a520ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1379c35-425a-442e-85c0-593c48b5160c", "address": "fa:16:3e:f9:c6:1d", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1379c35-42", "ovs_interfaceid": "b1379c35-425a-442e-85c0-593c48b5160c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:30:56 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converting VIF {"id": "b1379c35-425a-442e-85c0-593c48b5160c", "address": "fa:16:3e:f9:c6:1d", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1379c35-42", "ovs_interfaceid": "b1379c35-425a-442e-85c0-593c48b5160c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:30:56 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:c6:1d,bridge_name='br-int',has_traffic_filtering=True,id=b1379c35-425a-442e-85c0-593c48b5160c,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1379c35-42') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:30:56 user nova-compute[72809]: DEBUG os_vif [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:c6:1d,bridge_name='br-int',has_traffic_filtering=True,id=b1379c35-425a-442e-85c0-593c48b5160c,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1379c35-42') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:30:56 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:30:56 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1379c35-42, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:30:56 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:30:56 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:30:56 user nova-compute[72809]: INFO os_vif [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:c6:1d,bridge_name='br-int',has_traffic_filtering=True,id=b1379c35-425a-442e-85c0-593c48b5160c,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1379c35-42')
Aug 09 07:30:56 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:30:56 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZylUdCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:30:56 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:30:56 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:30:56 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:30:56 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:30:56 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a3c7ef-afbe-40c2-a5c6-d8bcf5816a91]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG nova.network.neutron [req-41477852-d143-47c5-8b09-524d42bde767 req-5897d9ae-44ab-4209-ab36-aa2b99b5b980 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Updated VIF entry in instance network info cache for port b1379c35-425a-442e-85c0-593c48b5160c. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG nova.network.neutron [req-41477852-d143-47c5-8b09-524d42bde767 req-5897d9ae-44ab-4209-ab36-aa2b99b5b980 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Updating instance_info_cache with network_info: [{"id": "b1379c35-425a-442e-85c0-593c48b5160c", "address": "fa:16:3e:f9:c6:1d", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1379c35-42", "ovs_interfaceid": "b1379c35-425a-442e-85c0-593c48b5160c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.056s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef18320d-d6cd-4317-acf5-00028b57fe44]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 (non-flash)
Aug 09 07:30:57 user nova-compute[72809]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335 (non-flash)
Aug 09 07:30:57 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 (non-flash)
Aug 09 07:30:57 user nova-compute[72809]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335 (non-flash)
Aug 09 07:30:57 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc1386ceef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335'): ({'sdc'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Removing single pathed devices sdc {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-41477852-d143-47c5-8b09-524d42bde767 req-5897d9ae-44ab-4209-ab36-aa2b99b5b980 service nova] Releasing lock "refresh_cache-a9393776-c460-4fa2-b159-ac2168a520ff" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf0ff16-1fed-47d7-bb6a-3cb6bc4769e9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[da476c43-412e-4108-9078-0b4f3ffa01dd]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Flushing IO for device /dev/sdc {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1627b5-8d3b-4931-a7b0-797ce7a3d915]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[372866b1-84be-4b2f-9a35-ff5b44f297d9]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] SCSI volumes sdc have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23165366166613932', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ad01ea59', '/dev/disk/by-id/scsi-1SCST_BIOad01ea59-1e6afa92c580ee3f') {{(pid=83900) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2342e2b-67c7-475c-92ca-407c6f5460ee]: (4, None) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6726a6-e4dc-4e82-b7d5-f1f173bba067]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335 -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG nova.compute.manager [req-0d0b1e43-f105-4a52-8226-1cb34f59013f req-bc8d1443-3b6b-4be1-bdef-0884ea5bf045 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Received event network-vif-unplugged-b1379c35-425a-442e-85c0-593c48b5160c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0d0b1e43-f105-4a52-8226-1cb34f59013f req-bc8d1443-3b6b-4be1-bdef-0884ea5bf045 service nova] Acquiring lock "a9393776-c460-4fa2-b159-ac2168a520ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0d0b1e43-f105-4a52-8226-1cb34f59013f req-bc8d1443-3b6b-4be1-bdef-0884ea5bf045 service nova] Lock "a9393776-c460-4fa2-b159-ac2168a520ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0d0b1e43-f105-4a52-8226-1cb34f59013f req-bc8d1443-3b6b-4be1-bdef-0884ea5bf045 service nova] Lock "a9393776-c460-4fa2-b159-ac2168a520ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG nova.compute.manager [req-0d0b1e43-f105-4a52-8226-1cb34f59013f req-bc8d1443-3b6b-4be1-bdef-0884ea5bf045 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] No waiting events found dispatching network-vif-unplugged-b1379c35-425a-442e-85c0-593c48b5160c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG nova.compute.manager [req-0d0b1e43-f105-4a52-8226-1cb34f59013f req-bc8d1443-3b6b-4be1-bdef-0884ea5bf045 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Received event network-vif-unplugged-b1379c35-425a-442e-85c0-593c48b5160c for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG nova.compute.manager [req-0d0b1e43-f105-4a52-8226-1cb34f59013f req-bc8d1443-3b6b-4be1-bdef-0884ea5bf045 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Received event network-vif-plugged-b1379c35-425a-442e-85c0-593c48b5160c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0d0b1e43-f105-4a52-8226-1cb34f59013f req-bc8d1443-3b6b-4be1-bdef-0884ea5bf045 service nova] Acquiring lock "a9393776-c460-4fa2-b159-ac2168a520ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0d0b1e43-f105-4a52-8226-1cb34f59013f req-bc8d1443-3b6b-4be1-bdef-0884ea5bf045 service nova] Lock "a9393776-c460-4fa2-b159-ac2168a520ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-0d0b1e43-f105-4a52-8226-1cb34f59013f req-bc8d1443-3b6b-4be1-bdef-0884ea5bf045 service nova] Lock "a9393776-c460-4fa2-b159-ac2168a520ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG nova.compute.manager [req-0d0b1e43-f105-4a52-8226-1cb34f59013f req-bc8d1443-3b6b-4be1-bdef-0884ea5bf045 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] No waiting events found dispatching network-vif-plugged-b1379c35-425a-442e-85c0-593c48b5160c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:30:57 user nova-compute[72809]: WARNING nova.compute.manager [req-0d0b1e43-f105-4a52-8226-1cb34f59013f req-bc8d1443-3b6b-4be1-bdef-0884ea5bf045 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Received unexpected event network-vif-plugged-b1379c35-425a-442e-85c0-593c48b5160c for instance with vm_state active and task_state deleting.
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9bf58a-3276-424b-b6b7-0c1c7267f935]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335, portal: 172.16.0.220,3260]
Aug 09 07:30:57 user nova-compute[72809]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335, portal: 172.16.0.220,3260] successful.
Aug 09 07:30:57 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335 -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e579133-987f-42e3-bc87-b2f013141335 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a36eb1-cb48-4d47-8c2f-6aeff641e718]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] <== disconnect_volume: return (337ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:30:57 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Deleting instance files /opt/stack/data/nova/instances/a9393776-c460-4fa2-b159-ac2168a520ff_del
Aug 09 07:30:57 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Deletion of /opt/stack/data/nova/instances/a9393776-c460-4fa2-b159-ac2168a520ff_del complete
Aug 09 07:30:57 user nova-compute[72809]: INFO nova.compute.manager [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 09 07:30:57 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:30:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:30:58 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:30:58 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Took 0.85 seconds to deallocate network for instance.
Aug 09 07:30:58 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:30:58 user nova-compute[72809]: INFO nova.compute.manager [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Took 0.71 seconds to detach 1 volumes for instance.
Aug 09 07:30:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:30:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:30:58 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Refreshing inventories for resource provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 07:30:59 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Updating ProviderTree inventory for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 07:30:59 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Updating inventory in ProviderTree for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 07:30:59 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Refreshing aggregate associations for resource provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3, aggregates: None {{(pid=72809) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 07:30:59 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Refreshing trait associations for resource provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI {{(pid=72809) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 07:30:59 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:30:59 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:30:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.262s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:30:59 user nova-compute[72809]: DEBUG nova.compute.manager [req-b095a257-d7c3-4b87-96b7-f7a1314de65f req-729e4653-fe2a-4f62-8d55-fea392dd0458 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Received event network-vif-plugged-b1379c35-425a-442e-85c0-593c48b5160c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:30:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b095a257-d7c3-4b87-96b7-f7a1314de65f req-729e4653-fe2a-4f62-8d55-fea392dd0458 service nova] Acquiring lock "a9393776-c460-4fa2-b159-ac2168a520ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:30:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b095a257-d7c3-4b87-96b7-f7a1314de65f req-729e4653-fe2a-4f62-8d55-fea392dd0458 service nova] Lock "a9393776-c460-4fa2-b159-ac2168a520ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:30:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b095a257-d7c3-4b87-96b7-f7a1314de65f req-729e4653-fe2a-4f62-8d55-fea392dd0458 service nova] Lock "a9393776-c460-4fa2-b159-ac2168a520ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:30:59 user nova-compute[72809]: DEBUG nova.compute.manager [req-b095a257-d7c3-4b87-96b7-f7a1314de65f req-729e4653-fe2a-4f62-8d55-fea392dd0458 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] No waiting events found dispatching network-vif-plugged-b1379c35-425a-442e-85c0-593c48b5160c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:30:59 user nova-compute[72809]: WARNING nova.compute.manager [req-b095a257-d7c3-4b87-96b7-f7a1314de65f req-729e4653-fe2a-4f62-8d55-fea392dd0458 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Received unexpected event network-vif-plugged-b1379c35-425a-442e-85c0-593c48b5160c for instance with vm_state deleted and task_state None.
Aug 09 07:30:59 user nova-compute[72809]: DEBUG nova.compute.manager [req-b095a257-d7c3-4b87-96b7-f7a1314de65f req-729e4653-fe2a-4f62-8d55-fea392dd0458 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Received event network-vif-plugged-b1379c35-425a-442e-85c0-593c48b5160c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:30:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b095a257-d7c3-4b87-96b7-f7a1314de65f req-729e4653-fe2a-4f62-8d55-fea392dd0458 service nova] Acquiring lock "a9393776-c460-4fa2-b159-ac2168a520ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:30:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b095a257-d7c3-4b87-96b7-f7a1314de65f req-729e4653-fe2a-4f62-8d55-fea392dd0458 service nova] Lock "a9393776-c460-4fa2-b159-ac2168a520ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:30:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b095a257-d7c3-4b87-96b7-f7a1314de65f req-729e4653-fe2a-4f62-8d55-fea392dd0458 service nova] Lock "a9393776-c460-4fa2-b159-ac2168a520ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:30:59 user nova-compute[72809]: DEBUG nova.compute.manager [req-b095a257-d7c3-4b87-96b7-f7a1314de65f req-729e4653-fe2a-4f62-8d55-fea392dd0458 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] No waiting events found dispatching network-vif-plugged-b1379c35-425a-442e-85c0-593c48b5160c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:30:59 user nova-compute[72809]: WARNING nova.compute.manager [req-b095a257-d7c3-4b87-96b7-f7a1314de65f req-729e4653-fe2a-4f62-8d55-fea392dd0458 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Received unexpected event network-vif-plugged-b1379c35-425a-442e-85c0-593c48b5160c for instance with vm_state deleted and task_state None.
Aug 09 07:30:59 user nova-compute[72809]: DEBUG nova.compute.manager [req-b095a257-d7c3-4b87-96b7-f7a1314de65f req-729e4653-fe2a-4f62-8d55-fea392dd0458 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Received event network-vif-unplugged-b1379c35-425a-442e-85c0-593c48b5160c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:30:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b095a257-d7c3-4b87-96b7-f7a1314de65f req-729e4653-fe2a-4f62-8d55-fea392dd0458 service nova] Acquiring lock "a9393776-c460-4fa2-b159-ac2168a520ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:30:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b095a257-d7c3-4b87-96b7-f7a1314de65f req-729e4653-fe2a-4f62-8d55-fea392dd0458 service nova] Lock "a9393776-c460-4fa2-b159-ac2168a520ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:30:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b095a257-d7c3-4b87-96b7-f7a1314de65f req-729e4653-fe2a-4f62-8d55-fea392dd0458 service nova] Lock "a9393776-c460-4fa2-b159-ac2168a520ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:30:59 user nova-compute[72809]: DEBUG nova.compute.manager [req-b095a257-d7c3-4b87-96b7-f7a1314de65f req-729e4653-fe2a-4f62-8d55-fea392dd0458 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] No waiting events found dispatching network-vif-unplugged-b1379c35-425a-442e-85c0-593c48b5160c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:30:59 user nova-compute[72809]: WARNING nova.compute.manager [req-b095a257-d7c3-4b87-96b7-f7a1314de65f req-729e4653-fe2a-4f62-8d55-fea392dd0458 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Received unexpected event network-vif-unplugged-b1379c35-425a-442e-85c0-593c48b5160c for instance with vm_state deleted and task_state None.
Aug 09 07:30:59 user nova-compute[72809]: DEBUG nova.compute.manager [req-b095a257-d7c3-4b87-96b7-f7a1314de65f req-729e4653-fe2a-4f62-8d55-fea392dd0458 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Received event network-vif-plugged-b1379c35-425a-442e-85c0-593c48b5160c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:30:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b095a257-d7c3-4b87-96b7-f7a1314de65f req-729e4653-fe2a-4f62-8d55-fea392dd0458 service nova] Acquiring lock "a9393776-c460-4fa2-b159-ac2168a520ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:30:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b095a257-d7c3-4b87-96b7-f7a1314de65f req-729e4653-fe2a-4f62-8d55-fea392dd0458 service nova] Lock "a9393776-c460-4fa2-b159-ac2168a520ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:30:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-b095a257-d7c3-4b87-96b7-f7a1314de65f req-729e4653-fe2a-4f62-8d55-fea392dd0458 service nova] Lock "a9393776-c460-4fa2-b159-ac2168a520ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:30:59 user nova-compute[72809]: DEBUG nova.compute.manager [req-b095a257-d7c3-4b87-96b7-f7a1314de65f req-729e4653-fe2a-4f62-8d55-fea392dd0458 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] No waiting events found dispatching network-vif-plugged-b1379c35-425a-442e-85c0-593c48b5160c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:30:59 user nova-compute[72809]: WARNING nova.compute.manager [req-b095a257-d7c3-4b87-96b7-f7a1314de65f req-729e4653-fe2a-4f62-8d55-fea392dd0458 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Received unexpected event network-vif-plugged-b1379c35-425a-442e-85c0-593c48b5160c for instance with vm_state deleted and task_state None.
Aug 09 07:30:59 user nova-compute[72809]: DEBUG nova.compute.manager [req-b095a257-d7c3-4b87-96b7-f7a1314de65f req-729e4653-fe2a-4f62-8d55-fea392dd0458 service nova] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Received event network-vif-deleted-b1379c35-425a-442e-85c0-593c48b5160c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:30:59 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Deleted allocations for instance a9393776-c460-4fa2-b159-ac2168a520ff
Aug 09 07:30:59 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-1aad6ae9-13b8-4b4a-bacd-43a6eb37139b tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "a9393776-c460-4fa2-b159-ac2168a520ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.197s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:30:59 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:31:01 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:31:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:31:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:31:01 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:31:01 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 07:31:01 user nova-compute[72809]: DEBUG nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72809) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 07:31:02 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:31:02 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:31:02 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:31:02 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=8762MB free_disk=25.15953826904297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 07:31:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:31:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:31:02 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Instance 7a7080a1-7ff9-4057-8043-614acd38b71f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72809) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 07:31:02 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 07:31:02 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 07:31:02 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:31:02 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:31:02 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 07:31:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:31:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:31:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:31:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72809) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 07:31:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:31:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:31:07 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:31:11 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691566256.8888638, a9393776-c460-4fa2-b159-ac2168a520ff => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:31:11 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] VM Stopped (Lifecycle Event)
Aug 09 07:31:11 user nova-compute[72809]: DEBUG nova.compute.manager [None req-46312a4b-3c86-4efd-84ef-c4a21a9c64df None None] [instance: a9393776-c460-4fa2-b159-ac2168a520ff] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:31:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:31:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:31:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72809) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 07:31:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:31:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:31:12 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:31:12 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:31:12 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:31:12 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 07:31:12 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:31:12 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:31:14 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:31:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:31:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:31:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72809) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 07:31:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:31:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:31:17 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:31:19 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:31:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:31:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:31:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72809) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 07:31:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:31:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:31:22 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:31:22 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:31:27 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:31:32 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:31:37 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:31:42 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:31:47 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:31:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:31:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:31:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72809) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 07:31:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:31:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:31:52 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:31:55 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:31:55 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 07:31:55 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Rebuilding the list of instances to heal {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 07:31:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "refresh_cache-7a7080a1-7ff9-4057-8043-614acd38b71f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:31:55 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquired lock "refresh_cache-7a7080a1-7ff9-4057-8043-614acd38b71f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:31:55 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Forcefully refreshing network info cache for instance {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 07:31:55 user nova-compute[72809]: DEBUG nova.objects.instance [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lazy-loading 'info_cache' on Instance uuid 7a7080a1-7ff9-4057-8043-614acd38b71f {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:31:56 user nova-compute[72809]: DEBUG nova.network.neutron [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Updating instance_info_cache with network_info: [{"id": "77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c", "address": "fa:16:3e:cb:05:46", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77831bb5-c5", "ovs_interfaceid": "77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:31:56 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Releasing lock "refresh_cache-7a7080a1-7ff9-4057-8043-614acd38b71f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:31:56 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Updated the network info_cache for instance {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 07:31:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:31:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:31:57 user nova-compute[72809]: DEBUG nova.compute.manager [req-ce03a3e2-b65f-4cca-b276-426b399ebff1 req-5d52e091-84e6-46a7-9185-ff568a36ae48 service nova] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Received event network-changed-77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:31:57 user nova-compute[72809]: DEBUG nova.compute.manager [req-ce03a3e2-b65f-4cca-b276-426b399ebff1 req-5d52e091-84e6-46a7-9185-ff568a36ae48 service nova] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Refreshing instance network info cache due to event network-changed-77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c. {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 07:31:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ce03a3e2-b65f-4cca-b276-426b399ebff1 req-5d52e091-84e6-46a7-9185-ff568a36ae48 service nova] Acquiring lock "refresh_cache-7a7080a1-7ff9-4057-8043-614acd38b71f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 07:31:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ce03a3e2-b65f-4cca-b276-426b399ebff1 req-5d52e091-84e6-46a7-9185-ff568a36ae48 service nova] Acquired lock "refresh_cache-7a7080a1-7ff9-4057-8043-614acd38b71f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 07:31:57 user nova-compute[72809]: DEBUG nova.network.neutron [req-ce03a3e2-b65f-4cca-b276-426b399ebff1 req-5d52e091-84e6-46a7-9185-ff568a36ae48 service nova] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Refreshing network info cache for port 77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c {{(pid=72809) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 07:31:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "7a7080a1-7ff9-4057-8043-614acd38b71f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:31:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "7a7080a1-7ff9-4057-8043-614acd38b71f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:31:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "7a7080a1-7ff9-4057-8043-614acd38b71f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:31:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "7a7080a1-7ff9-4057-8043-614acd38b71f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:31:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "7a7080a1-7ff9-4057-8043-614acd38b71f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:31:57 user nova-compute[72809]: INFO nova.compute.manager [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Terminating instance
Aug 09 07:31:57 user nova-compute[72809]: DEBUG nova.compute.manager [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Start destroying the instance on the hypervisor. {{(pid=72809) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 07:31:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:31:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:31:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:31:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:31:57 user nova-compute[72809]: DEBUG nova.network.neutron [req-ce03a3e2-b65f-4cca-b276-426b399ebff1 req-5d52e091-84e6-46a7-9185-ff568a36ae48 service nova] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Updated VIF entry in instance network info cache for port 77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c. {{(pid=72809) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 07:31:57 user nova-compute[72809]: DEBUG nova.network.neutron [req-ce03a3e2-b65f-4cca-b276-426b399ebff1 req-5d52e091-84e6-46a7-9185-ff568a36ae48 service nova] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Updating instance_info_cache with network_info: [{"id": "77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c", "address": "fa:16:3e:cb:05:46", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77831bb5-c5", "ovs_interfaceid": "77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:31:57 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-ce03a3e2-b65f-4cca-b276-426b399ebff1 req-5d52e091-84e6-46a7-9185-ff568a36ae48 service nova] Releasing lock "refresh_cache-7a7080a1-7ff9-4057-8043-614acd38b71f" {{(pid=72809) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG nova.compute.manager [req-dadf2cf1-0690-4072-b356-cdd4a3010754 req-c6196341-594f-45f8-b02d-d5ee547c00d7 service nova] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Received event network-vif-unplugged-77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-dadf2cf1-0690-4072-b356-cdd4a3010754 req-c6196341-594f-45f8-b02d-d5ee547c00d7 service nova] Acquiring lock "7a7080a1-7ff9-4057-8043-614acd38b71f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-dadf2cf1-0690-4072-b356-cdd4a3010754 req-c6196341-594f-45f8-b02d-d5ee547c00d7 service nova] Lock "7a7080a1-7ff9-4057-8043-614acd38b71f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-dadf2cf1-0690-4072-b356-cdd4a3010754 req-c6196341-594f-45f8-b02d-d5ee547c00d7 service nova] Lock "7a7080a1-7ff9-4057-8043-614acd38b71f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG nova.compute.manager [req-dadf2cf1-0690-4072-b356-cdd4a3010754 req-c6196341-594f-45f8-b02d-d5ee547c00d7 service nova] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] No waiting events found dispatching network-vif-unplugged-77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG nova.compute.manager [req-dadf2cf1-0690-4072-b356-cdd4a3010754 req-c6196341-594f-45f8-b02d-d5ee547c00d7 service nova] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Received event network-vif-unplugged-77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c for instance with task_state deleting. {{(pid=72809) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 07:31:58 user nova-compute[72809]: INFO nova.virt.libvirt.driver [-] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Instance destroyed successfully.
Aug 09 07:31:58 user nova-compute[72809]: DEBUG nova.objects.instance [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lazy-loading 'resources' on Instance uuid 7a7080a1-7ff9-4057-8043-614acd38b71f {{(pid=72809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.vif [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T07:26:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-688465389',display_name='tempest-TestVolumeBootPattern-server-688465389',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-688465389',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjnvBkBtyKj+KLLI54SBkh5HnXtHKYGIvHET6AohUoc067yu29rFAuYqAakYT1y07YcSfZK33sZkxNs57WMr0x24BQA2oeNeplu2EJ8SgGH8Bvo7ooGDsRYmmPpPFSHcQ==',key_name='tempest-TestVolumeBootPattern-1169256863',keypairs=<?>,launch_index=0,launched_at=2023-08-09T07:27:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8cdcd8241b9b47eab16a6e37a9cc5f54',ramdisk_id='',reservation_id='r-7jb0zdie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-224847517',owner_user_name='tempest-TestVolumeBootPattern-224847517-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T07:27:12Z,user_data=None,user_id='a7859a38408b426eb9a14ef003483bd3',uuid=7a7080a1-7ff9-4057-8043-614acd38b71f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c", "address": "fa:16:3e:cb:05:46", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77831bb5-c5", "ovs_interfaceid": "77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converting VIF {"id": "77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c", "address": "fa:16:3e:cb:05:46", "network": {"id": "f70731c0-dfd1-45f9-af2f-5d731c06e518", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1228592126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdcd8241b9b47eab16a6e37a9cc5f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77831bb5-c5", "ovs_interfaceid": "77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG nova.network.os_vif_util [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:05:46,bridge_name='br-int',has_traffic_filtering=True,id=77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77831bb5-c5') {{(pid=72809) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG os_vif [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:05:46,bridge_name='br-int',has_traffic_filtering=True,id=77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77831bb5-c5') {{(pid=72809) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77831bb5-c5, bridge=br-int, if_exists=True) {{(pid=72809) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:31:58 user nova-compute[72809]: INFO os_vif [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:05:46,bridge_name='br-int',has_traffic_filtering=True,id=77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c,network=Network(f70731c0-dfd1-45f9-af2f-5d731c06e518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77831bb5-c5')
Aug 09 07:31:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] calling os-brick to detach iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc15843b3d0>, {'target_iqns': ['iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewTXjsCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 07:31:58 user nova-compute[72809]: WARNING os_brick.initiator.connectors.base [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 07:31:58 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753', 0)] {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f2376e-985a-4052-b427-8b1b4ae8c9a6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b101e7-2211-403c-b6e0-21d1d4d19219]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 (non-flash)\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 (non-flash)
Aug 09 07:31:58 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 (non-flash)
Aug 09 07:31:58 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc138300ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753'): ({'sdb'}, set())}) {{(pid=72809) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Removing single pathed devices sdb {{(pid=72809) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[3210e286-a56a-4b1e-9e25-1af07fa58cd0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1f48ef-8767-484c-9d50-39e508aac06c]: (4, ('ok\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Flushing IO for device /dev/sdb {{(pid=72809) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[367bf36c-4f7c-49ef-9179-7115ae78d9b2]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72809) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[6206bbc8-d9ce-4a0c-8092-868ff6e71006]: (4, ('1', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG os_brick.initiator.linuxscsi [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] SCSI volumes sdb have been removed. {{(pid=72809) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_2ced98e1', '/dev/disk/by-id/scsi-23236303065626339', '/dev/disk/by-id/scsi-1SCST_BIO2ced98e1-2600ebc9735ba172') {{(pid=83900) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ef7289-5852-43a1-923a-edf3811833ec]: (4, None) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753')] {{(pid=72809) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a1baff-f4ee-403d-85c0-b8d9a1589162]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --logout {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[7193eb67-dbc6-4342-bb3c-d7d4e95deade]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753, portal: 172.16.0.220,3260]
Aug 09 07:31:58 user nova-compute[72809]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753, portal: 172.16.0.220,3260] successful.
Aug 09 07:31:58 user nova-compute[72809]:  stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --op delete {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4daa5fd-e98f-45cb-a865-913dcce3e753 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83900) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6acccbd-0cc0-4287-9e05-99a0922d8582]: (4, ('', '')) {{(pid=83900) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72809) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.base [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] <== disconnect_volume: return (278ms) None {{(pid=72809) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Disconnected iSCSI Volume {{(pid=72809) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 07:31:58 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Deleting instance files /opt/stack/data/nova/instances/7a7080a1-7ff9-4057-8043-614acd38b71f_del
Aug 09 07:31:58 user nova-compute[72809]: INFO nova.virt.libvirt.driver [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Deletion of /opt/stack/data/nova/instances/7a7080a1-7ff9-4057-8043-614acd38b71f_del complete
Aug 09 07:31:58 user nova-compute[72809]: INFO nova.compute.manager [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 09 07:31:58 user nova-compute[72809]: DEBUG oslo.service.loopingcall [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72809) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG nova.compute.manager [-] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Deallocating network for instance {{(pid=72809) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 07:31:58 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] deallocate_for_instance() {{(pid=72809) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 07:31:59 user nova-compute[72809]: DEBUG nova.network.neutron [-] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Updating instance_info_cache with network_info: [] {{(pid=72809) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 07:31:59 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Took 0.49 seconds to deallocate network for instance.
Aug 09 07:31:59 user nova-compute[72809]: DEBUG nova.compute.manager [req-ce4863c9-ce58-4a46-945d-34a0d22debed req-4e9f61f9-d192-4b04-beba-cba28912293a service nova] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Received event network-vif-deleted-77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:31:59 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:32:00 user nova-compute[72809]: INFO nova.compute.manager [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Took 0.82 seconds to detach 1 volumes for instance.
Aug 09 07:32:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:32:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:32:00 user nova-compute[72809]: DEBUG nova.compute.manager [req-3051e113-548c-4c2f-8a7b-d90a90c7a88b req-348dfaab-a399-4491-9517-1f827b5d7a7f service nova] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Received event network-vif-plugged-77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c {{(pid=72809) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 07:32:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3051e113-548c-4c2f-8a7b-d90a90c7a88b req-348dfaab-a399-4491-9517-1f827b5d7a7f service nova] Acquiring lock "7a7080a1-7ff9-4057-8043-614acd38b71f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:32:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3051e113-548c-4c2f-8a7b-d90a90c7a88b req-348dfaab-a399-4491-9517-1f827b5d7a7f service nova] Lock "7a7080a1-7ff9-4057-8043-614acd38b71f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:32:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [req-3051e113-548c-4c2f-8a7b-d90a90c7a88b req-348dfaab-a399-4491-9517-1f827b5d7a7f service nova] Lock "7a7080a1-7ff9-4057-8043-614acd38b71f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:32:00 user nova-compute[72809]: DEBUG nova.compute.manager [req-3051e113-548c-4c2f-8a7b-d90a90c7a88b req-348dfaab-a399-4491-9517-1f827b5d7a7f service nova] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] No waiting events found dispatching network-vif-plugged-77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c {{(pid=72809) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 07:32:00 user nova-compute[72809]: WARNING nova.compute.manager [req-3051e113-548c-4c2f-8a7b-d90a90c7a88b req-348dfaab-a399-4491-9517-1f827b5d7a7f service nova] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Received unexpected event network-vif-plugged-77831bb5-c5bf-4a25-8e9a-7b98dbf82d3c for instance with vm_state deleted and task_state None.
Aug 09 07:32:00 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:32:00 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:32:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:32:00 user nova-compute[72809]: INFO nova.scheduler.client.report [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Deleted allocations for instance 7a7080a1-7ff9-4057-8043-614acd38b71f
Aug 09 07:32:00 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-38f828d9-03ee-4451-96a4-fd236e90a9e3 tempest-TestVolumeBootPattern-224847517 tempest-TestVolumeBootPattern-224847517-project-member] Lock "7a7080a1-7ff9-4057-8043-614acd38b71f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.709s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:32:02 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:32:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:32:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:32:02 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:32:02 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 07:32:03 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:32:03 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:32:03 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=8912MB free_disk=25.158641815185547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 07:32:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:32:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:32:03 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 07:32:03 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 07:32:03 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:32:03 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:32:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:32:03 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 07:32:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:32:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:32:12 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:32:12 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:32:13 user nova-compute[72809]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691566318.3372622, 7a7080a1-7ff9-4057-8043-614acd38b71f => Stopped> {{(pid=72809) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 07:32:13 user nova-compute[72809]: INFO nova.compute.manager [-] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] VM Stopped (Lifecycle Event)
Aug 09 07:32:13 user nova-compute[72809]: DEBUG nova.compute.manager [None req-4c7fd381-d405-4cc2-bf2b-b8608c685b3c None None] [instance: 7a7080a1-7ff9-4057-8043-614acd38b71f] Checking state {{(pid=72809) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 07:32:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:32:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:32:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72809) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 07:32:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:32:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:32:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:32:13 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:32:13 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 07:32:14 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:32:16 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:32:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:32:21 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:32:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:32:28 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:32:33 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:32:38 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:32:43 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:32:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:32:48 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:32:53 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:32:56 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:32:56 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Starting heal instance info cache {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 07:32:56 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Rebuilding the list of instances to heal {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 07:32:56 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Didn't find any instances for network info cache update. {{(pid=72809) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 07:32:57 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:32:58 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:32:59 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:33:01 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:33:03 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:33:03 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:33:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:33:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:33:03 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:33:03 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Auditing locally available compute resources for user (node: user) {{(pid=72809) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 07:33:04 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:33:04 user nova-compute[72809]: WARNING nova.virt.libvirt.driver [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 07:33:04 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Hypervisor/Node resource view: name=user free_ram=8959MB free_disk=25.157188415527344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72809) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 07:33:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 07:33:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 07:33:04 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 07:33:04 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72809) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 07:33:04 user nova-compute[72809]: DEBUG nova.compute.provider_tree [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed in ProviderTree for provider: 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 {{(pid=72809) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 07:33:04 user nova-compute[72809]: DEBUG nova.scheduler.client.report [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Inventory has not changed for provider 28f55a7b-2cb8-4eb0-b993-21feaf69c3a3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72809) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 07:33:04 user nova-compute[72809]: DEBUG nova.compute.resource_tracker [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Compute_service record updated for user:user {{(pid=72809) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 07:33:04 user nova-compute[72809]: DEBUG oslo_concurrency.lockutils [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.107s {{(pid=72809) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 07:33:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:33:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 07:33:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72809) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 07:33:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:33:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72809) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 07:33:08 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:33:13 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:33:14 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:33:14 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:33:14 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:33:14 user nova-compute[72809]: DEBUG nova.compute.manager [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72809) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 07:33:16 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:33:16 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 07:33:18 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:33:23 user nova-compute[72809]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72809) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 07:33:23 user nova-compute[72809]: DEBUG oslo_service.periodic_task [None req-ce3885cd-3172-40b5-9362-bb41f8cdb17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72809) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}